The present invention discloses a clip retainer which includes a top surface having a groove and a bottom surface which has stopping ribs and a barb formed between the stopping ribs. The top surface and the stopping ribs of the bottom surface clamp a flange of a clip. A slope of an inclined plane of the barb in a slide-in direction of the clip is smaller than that of an inclined plane of the barb in a slide-out direction of the clip. Based on the above structure, the clip retainer can meet the function requirements of small slide-in force and large slide-out force of the clip and has a simple structure. Furthermore, the clip retainer can produce repeated insertion and extraction deformation and is very reliable to use.