A wearable device using a bone conduction speaker, including a wearable band worn on an arm of a user, a communication module attached to the wearable band, an audio processor configured to process an audio signal transmitted and received through the communication module, a microphone configured to transmit a voice signal, which is input in sound by the user, to the audio processor, a bone conduction speaker configured to output a reception audio signal, which is processed by the audio processor, in bone conduction mode, and an echo canceller configured to cancel the voice signal in an audio signal output from the bone conduction speaker, is provided.