Mechanisms are provided to implement a generative adversarial network (GAN) that is trained based on labeled image data, unlabeled image data, and generated image data generated by a generator of the GAN. The GAN comprises a loss function that comprises error components for each of the labeled image data, unlabeled image data, and generated image data which is used to train the GAN. A new data source for which the trained GAN is to be adapted is identified and the trained GAN is adapted for the new data source. Image data in the new data source is classified by applying the adapted GAN to the data in the new data source. Adapting the trained GAN includes obtaining a minimized set of labeled images and utilizing the minimized set of images to perform the adapting of the trained GAN.