A progressive JPEG image decoding method is provided. In the decoding method, a non-zero history table and a sign table of each variable length decoding (VLD) result are recorded and used as a reference for decoding the next scan layer. The decoded coefficients are no longer directly stored in a memory so as to save the memory space. Accordingly, an image can be decoded and displayed correctly even with limited memory space.