A system for controlling an operation of a machine is disclosed. The system includes an image capturing device and a controller. The image capturing device generates a signal indicative of a surrounding area of the machine. The controller is in communication with the image capturing device. The controller determines a preceding work cycle of the machine comprising a dig segment and determines a preceding segment associated with the preceding work cycle to be a dump segment. The controller further identifies a work aggregate within the surrounding area of the machine, when the preceding segment of the preceding work cycle is the dump segment. Further, the controller determines a distance between an implement of the machine and the work aggregate and issues a shift request to downshift a gear drive of a transmission system of the machine, if the distance is less than a predefined distance.