A method for operating a hearing device comprising an input transducer (1), an output transducer (3) and a signal processing unit (2) for processing an output signal of the input transducer (1) to obtain an input signal for the output transducer (3) by applying a transfer function to the output signal of the input transducer (1) is disclosed. The method comprises the steps of: extracting features (fv) of the output signal of the input transducer (1), classifying the extracted features (fv) by at least two classifying experts (E1, . . . , Ek), weighting the outputs of the at least two classifying experts (E1, . . . , Ek) by a weight vector (w) in order to obtain a classifier output (co), adjusting at least some parameters of the transfer function in accordance with the classifier output (co), monitoring a user feedback (uf) that is received by the hearing device, and updating the weight vector (w) and/or one of the at least two classifying experts (E1, . . . , Ek) in accordance with the user feedback (uf).