Systems, apparatuses, applications, methodologies and other tools for managing a fleet of output devices are configured to determine whether a substantial change in operations of the fleet of output devices has occurred, based on a comparison of a normal state of plural fleet metrics determined for the fleet over a predetermined period of time with a current state of the plural fleet metrics. When such a change is detected, an alert notification is generated and transmitted to a specified alert destination. Further, the alert notification may include a user-operable part to request a summary of the changes to the fleet as a whole or to operations of the fleet as a whole.