A system and method enable exploration of cold ads in an online information system. Cold ads are ads that are new to the system and do not yet have reliable click through rate (CTR) estimates or click probabilities. The method and system selectively boost the click probabilities of cold ads to increase their likelihood of participating in and winning an auction so that the cold ad get more impressions, but without adversely affecting revenue in a production environment when cold ads are introduced.