An illumination optical system is capable of changing a light beam diameter in one of first and second cross sections orthogonal to each other that include an optical axis, and includes a light source, a condenser lens that concentrates light from the light source, a first fly-eye lens including a first lens cell on which light concentrated by the condenser lens is incident, a second fly-eye lens including a second lens cell, a polarization conversion element that performs polarization conversion on light from the second fly-eye lens, and an image display element that displays an image based on light from the polarization conversion element, and widths of the image display element and a light emitting surface of the light source, widths of the first and second fly-eye lens, and change rates α and β of the light beam diameters are set within appropriate ranges.