Disclosed is a system and a method for rectifying stereo images, which are acquired by two cameras, in real-time by using a calibration matrix resulting from camera calibration. The system includes a coordinate generation module; a rectification coordinate generation module; a bilinear interpolation value generation module; a rectification coordinate memory; a bilinear interpolation memory; an image buffer; an rectification module; and a control module. A structure of a hardware system capable of real-time stereo rectification is provided, and the operation results have been verified by implementing a hardware device. The real-time stereo rectification system makes it possible to acquire rectified images in real-time without using a separate computer system or a software program.