An image processing apparatus includes a first calculating unit configured to add a pixel value and an output of a filter unit, a first quantizing unit configured to quantize an output of the first calculating unit and output a quantized value serving as ΔΣ modulation data, a second calculating unit configured to calculate a difference between the output of the first calculating unit and the quantized value, thereby obtaining the quantization error, a second quantizing unit configured to quantize a portion of the quantization error and output compensating data, a third calculating unit configured to add the ΔΣ modulation data and the compensating data, thereby generating time-integration-effect-using error diffusion data, a fourth calculating unit configured to calculate a difference between the quantization error and the compensating data, the difference serving as a ΔΣ modulation error, and the filter unit configured to perform filtering in space directions.