A video processing device configured to encode frames divided into a plurality of layers according to a prediction type includes a pre-processing circuit configured to, generate a mode analysis result by analyzing mode information for each of N neighboring frames neighboring a target frame, and determine a target layer bit numbers allocated to each of the plurality of layers based on the mode analysis result, N being an integer equal to or greater than 2; and a first encoder configured to encode the target frame according to the determined target layer bit numbers.