A multi-layer encoder/decoder system is provided that uses base layer intra mode for enhancement layer intra mode prediction. The encoder provides the base layer intra mode in the base layer of a two layer video encoder, and uses the base layer intra mode as one of a plurality of most probable modes (MPMs). Then in determining the enhancement layer intra mode, the MPMs are used.