A method of analyzing audio signals, such as for a drive monitoring system, includes recording an audio signal from a mobile device, the audio signal including a background audio stream and a residual audio signal. Communication with an audio database is performed to obtain a reference signal. If a match between the background audio stream and the reference signal is determined, a time alignment between the background audio stream and the reference is computed. At least a portion of the recorded audio signal is aligned with the reference signal using the time alignment. The background audio stream is canceled from the recorded audio signal, to result in the residual audio stream. A computer processor is used to determine a driving behavior factor from the residual audio stream.