Disclosed is a video encoding device including an arithmetic contents determining unit that takes into consideration the arithmetic contents of an SAO arithmetic operation performed on a local decoded image of an already-encoded block pointed to by a motion vector which is searched for through a motion-compensated prediction process performed by a motion-compensated prediction unit, to determine the arithmetic contents of an SAO arithmetic operation to be performed on a local decoded image after a deblocking filter process performed by a deblocking filter unit.