An operation apparatus through which a user operation is performed to control a plurality of controllable apparatuses includes a detector configured to detect the user operation, and a controller configured to acquire information on an arrangement of the plurality of controllable apparatuses and to switch a control target apparatus among the controllable apparatuses when a user operation is detected which inputs a direction corresponding to an arrangement direction of the plurality of controllable apparatuses indicated by the information on the arrangement.