An example of an apparatus configured to be worn by a person who has an ear and an ear canal includes a first microphone adapted to be worn about the ear of the person, and a second microphone adapted to be worn at a different location than the first microphone. The apparatus includes a sound processor adapted to process signals from the first microphone to produce a processed sound signal, a receiver adapted to convert the processed sound signal into an audible signal to the wearer of the hearing assistance device, and a voice detector to detect the voice of the wearer. The voice detector includes an adaptive filter to receive signals from the first microphone and the second microphone.