A card connector includes an insulative housing defining a card receiving space, a number of contacts retained in the insulative housing, an ejector received in the insulative housing and a metal shell covering the insulative housing. The ejector includes a movable slider, a spring, and a pin member, the slider defines a heart-shaped slot, and the pin member has a positioning end being rotatablely retained to the insulative housing and a free end being slidable along the heart-shaped slot to lock the slider. A latching piece is retained to the insulative housing and has a catching portion catching the pin member and an elastic portion connecting with the catching portion. When the pin member slides, the catching portion will bring the elastic portion to deflect and provide an outward or inward force to the pin member so as to control a movement trace of the pin member.