A cleaning device for surfaces of cylinders of a printing machine is provided, having at least one nozzle 23 with a nozzle opening 4 for a jet of cleaning fluid 13, a distribution line 22 for cleaning fluids, in which the nozzle 23 is inserted, as well as a cleaning element 20 for lifting contaminants, dissolved by the cleaning fluids, off the surface of the cylinder. The nozzle 23 is embodied as a separate component and detachably inserted in the distribution line 22. The nozzle 23 is made from a soft-elastic material. The nozzle 23 is provided with a deflector surface 6 arranged downstream from the nozzle opening 4 for deflecting and fanning a jet 13 exiting the nozzle opening 4, as well as a base 1 for inserting it into a distribution line 22, and a channel 11, which extends, on the one side, to a base opening 3 and, on the other side, to the nozzle opening 4. Furthermore, the invention relates to a nozzle for insertion in such a cleaning device.