The method and apparatus for offline video coding, as described herein, calculates per-frame QP offset contribution from the amount of temporal masking effect at a frame, and then properly combines the calculated per-frame QP offset contribution with the original QP offset contribution from the frame type. The resulting frame-level QP offset accounts for both the frame type and temporal masking effect, and hence, is more comprehensive.