Systems, methods, and apparatus for simulating natural media painting in a digital painting application (or painting simulation module) may provide user interface elements and methods that allow a user to load a brush with non-uniform paint colors by directly sampling the digital canvas. For example, a user may hover the brush over an area on the canvas having a non-uniform color distribution, and the application (or module) may sample the colors of the pixels under the brush, and load the brush with a collection of paint values reflecting the non-uniform distribution of colors in the sample. The application may support two non-uniform paint loading modes, e.g., one that fills the brush with a distribution of paint matching a single sample, and one that fills the brush with paint continuously as it is swept over the canvas. Non-uniform paint loading may be applied to stamp-based brush models and/or bristle brush models.