An electrical signal connector for connecting a coaxial cable to a mating connector is disclosed to include a locknut, a metal central tube inserted through the locknut and defining a stop flange at one end, a barbed retaining portion at an opposite end, a locating groove around the periphery between the stop flange and barbed retaining portion and an annular bearing surface portion extending around the periphery between the stop flange and the locating groove, a chuck unit including a collar, which is press-fitted onto the annular bearing surface portion of the metal central tube and having longitudinal clamping strips suspending around the barbed retaining portion of the metal central tube, and a constraint shell surrounding the collar, and an actuation sleeve mounted within the constraint shell around the collar and manually axially movable relative to the chuck unit between two positions to compress or release the longitudinal clamping strips.