A discrete neural network is trained by training a neural network having an output layer so as to output discrete values. The output layer includes a plurality of nodes. Each node corresponding to one of a plurality of classes. The training includes activating the nodes by priority according to the corresponding class.