Emotion classification from EEG brain signal has been a widely research topic recently, because of the complexity of processing the multi channels of the brain signal and also the problem on mapping the human emotion itself. This paper discusses the technique to determine the emotion classification from EEG brain signal using a relative wavelet energy (RWE) as a feature vector and an artificial neural networks (ANN) as a classifier. In this research, two types of ANN classifier was utilized and analyzed, namely, Back-propagation Neural Networks (BPNN) and Probabilistic Neural Networks (PNN). Also reducing the number of the EEG channel to be processed is investigated, in order to decrease the computational cost of the classification system. Results showed that the recognition rate of the reduced utilized channels up to 4 channel are incomparable with that of the full utilization of 32 channels. However, 8 and 14 channels still produced sufficient recognition rate. It is also confirmed from experiments that the BPNN shown as a more reliable classifier compare with the PNN method.