A method augments data labels of a machine learning task. The method includes applying at least one labeling function for each of a plurality of pairs of semantic concepts and producing a labeling matrix, computing pairwise similarity scores using similarity metrics for each of the pairs of semantic concepts, augmenting the labeling matrix using the pairwise similarity scores to increase a density of the labeling matrix, and inputting the labeling matrix to a label aggregator to apply a single label for each of the pairs of semantic concepts labeled by the at least one labeling function.