An apparatus comprising an inter-prediction motion compensation unit, a transform unit coupled to the inter-prediction motion compensation unit, a quantization unit coupled to the transform unit such that the transform unit is positioned between the inter-prediction motion compensation unit and the quantization unit, a scanning unit coupled to the quantization unit such that the quantization unit is positioned between the transform unit and the scanning unit, and an adaptive scan order predictor unit coupled to the inter-prediction motion compensation unit, the quantization unit, and the scanning unit. An apparatus comprising an entropy decoding unit, an inverse scanning unit coupled to the entropy decoding unit, an inverse quantization unit coupled to the inverse scanning unit such that the inverse scanning unit is positioned between the entropy coding unit and the inverse quantization unit, and an adaptive scan order predictor unit coupled to the entropy decoding unit and the inverse scanning unit.