This disclosure relates generally to visual inspection systems, and more particularly to a method and system for facilitating real time detection of linear infrastructural objects in aerial imagery. In one embodiment, a background suppression technique is applied to one or more hardware processors to a HSV image. Further, a mean shift filtering technique is applied to the hardware processors to find a peak of a confidence map and then a gradient image generation is performed for a plurality of edges of the image. A seed point pair along a middle cut portion of a linear feature of the HSV image to identify one or more boundaries of the seed point pair is extracted and then a contour growing approach to detect the boundaries of the linear feature is initiated. Lastly, one or more false positives are removed by using a rigidity feature, the rigidity feature being equivalent to the total sum of gradient orientations.