An asynchronous medical image processing system is described that includes a real-time controller connectable to a medical imaging device, a graphics processing unit (GPU) connectable to a display device, and a central processing unit (CPU) that executes an operating system and related application(s). The real-time controller is directly connected to a memory of the GPU and performs respective operations asynchronously with respect to the CPU. The real-time controller additionally obtains medical imaging data, generates instructions for the medical imaging-data and transmits the medical imaging data and the instructions to the memory of the GPU. The GPU additionally receives and processes the medical imaging data based on the instructions from the real-time controller and instructions sent independently from the CPU.