Providing backup digital certificates comprises an application provider, such as a digital wallet system, that obtains signed digital certificates from a certificate authority. The digital wallet system provides an application, such as a digital wallet application, to a user computing devise along with a primary digital certificate and a backup digital certificate. The user computing device utilizes the primary digital certificate to ensure a secure connection with the digital wallet system. If the primary digital certificate is compromised, the digital wallet system may communicate the backup digital certificate to the digital wallet system when a subsequent secure connection is requested. The user computing device may access the backup digital certificate and verify the provided digital certificate. The digital wallet system provides a new backup digital certificate to the user computing device, and the user computing device deletes the compromised digital certificate.