A hearing assistive device (10; 60) having an input transducer (12; 61) converting sound into an audio signal applied to a processor (14; 66), the processor (14; 66) is configured to compensate a hearing loss of a user of the hearing assistive device and to output a compensated audio signal, and an output transducer (16; 65) converting the compensated audio signal into sound. The hearing assistive device (10; 60) further comprises a wireless transceiver (21; 67) enabling audio streaming from an external device (30; 80) to the hearing assisting device; an attenuator (23; 66a) associated with said processor (14; 66) applying attenuation to the compensated audio signal; and an audio stream analyzer (22a; 68a) classifying the audio stream received via said wireless transceiver. The attenuator (23; 66a) is controlled in accordance to the audio stream classification from the audio stream analyzer (22a; 68a). The invention further provides a method of operating a hearing assisting device.