A gesture interface robot (GIR) automatically measures a work zone to establish virtual puzzle cells located in a user gesture comfortable area. The GIR allows the user to easily move hands to press selected virtual keys so as to prevent injury. The GIR draws virtual keyboard images that display commands on virtual puzzle cells. The GIR uses video vision sensing to detect user's hand location on the virtual keyboard images. Special unique gesture hand sings are designed for enhancing hand control virtual key selections. A push-hand-z-dimensional distant is divided into 3 selectable zones. A real-time display highlights a selected key graphic image to be visually seen by the user. Using a UIRT cable to send IR signal to a remote control computer. The GIR instantly generates a virtual puzzle cell keyboard or controller that the user selected. The GIR introduces a new gesture interface method, a touch screen mouse combined with puzzle cell virtual keys in sandwich layers gesture zones and a method for operating computer keys and mouse operations.