A material generation apparatus includes an acquisition unit configured to acquire a plurality of camera images, and a material data generation unit configured to generate, based on a camera image selected from among the camera images, at least one of a foreground image and a background image as material data to be used for generation of an image corresponding to a designated viewpoint.