Provided is a medical video processing system capable of moderating changes in image quality of medical video resulted from encoding, and, an encoder used for the medical video system. A medical video system 1000 has a monitor group 300 and an encoder 400 that accept medical video input from a switches 100 through separate transmission paths, and the encoder 400 subjects the input medical video to encoding as well as image quality adjustment.