Embodiments are directed towards hue-based video enhancement. An example method includes processing low dynamic range (LDR) video content to generate an inverse tone map (ITM) for transforming the LDR video content to high dynamic range (HDR) video content, converting the LDR video content into Hue, Saturation and Lightness (HSY) color space to produce H-channel data, S-channel data, and Y-channel data, de-noising the H-channel data, remapping the de-noised H-channel data, the S-channel data, and the Y-channel data based on the ITM; and rendering the HDR video content based thereon.