A targeted object pursuit system comprising a first setting block, a second setting block, a recognition block, a first determination block, a second determination block, and a re-designation block is provided. The first setting block initially designates a partial area as a pursuit area. The second setting block designates the areas displaced from the pursuit area as candidate areas. The recognition block extracts a standard image and candidate images. The first determination block determines in which general direction the targeted object moves is the first or second general direction. Based on the determination made by the first determination block, the second determination block determines in which of the first, second, third, or fourth detailed direction the targeted object has moved. The re-designation block re-designates a candidate area as the new pursuit area.