A headphone control system for use within a headphone includes a temperature sensor for detecting whether the circumference temperature of the headphone is relatively far from the human temperature implying the headphone is no longer worn by the user, and a gravity sensor for detecting whether the headphone is stationary implying that the headphone is not used for enabling a power saving mode, or is moving implying that the headphone is not yet unused for maintaining operation. The detection constantly is applied to the headphone disregarding whether the headphone is in an operation mode or a power saving mode so as to efficiently have the headphone operated in response to currently using or power-saved in response to non-using.