Methods, systems, and non-transitory computer readable media are disclosed for intelligently generating partially textured accessible images. In one or more embodiments, the disclosed systems generate or access a color texture map specific to a given color vision deficiency. For example, the disclosed systems generate a color texture map that divides a color space into one or more textured segment of colors and one or more complementary untextured segments of colors. The disclosed systems can utilize the color texture map to intelligently apply different textures to subsets of pixels that contribute to color vision deficiency confusion. For example, the disclosed system maps pixels from a color image to the color texture map to identify a first subset of pixels corresponding to the textured segment of colors. The disclosed system generates a partially textured accessible image by applying a texture to the first subset of pixels.