A system and method for operating a household cleaning appliance, including: providing a household cleaning appliance including, a powered and electronically controlled cleaning implement, and at least one physical sensor taken from a group consisting of: an orientation sensor, an acceleration sensor, an inertial sensor, a global positioning sensor, a pressure sensor, a load sensor, audio sensor, humidity sensor, and a temperature sensor; providing a camera associated with the household cleaning appliance; deriving an augmented classification using one or more classifiers classifying the physical sensor data and the image data; and modifying operation of the cleaning implement based upon the augmented classification.