Systems, apparatuses, and methods are described for encoding a scene of media content based on visual elements of the scene. A scene of media content may comprise one or more visual elements, such as individual objects in the scene. Each visual element may be classified based on, for example, the motion and/or identity of the visual element. Based on the visual element classifications, scene encoder parameters and/or visual element encoder parameters for different visual elements may be determined. The scene may be encoded using the scene encoder parameters and/or the visual element encoder parameters.