A cloud service provider system may receive a commit instruction including a modified build of the software service. The cloud service provider system may use the modified build to perform at least one test of a first operations feature of the software service at an operations stage. Responsive to the at least one test, the cloud service provider system sets a feature toggle for the first operations feature to enable the change to the operations code of the software service. An applications test stage is executed to test the modified build using the first operations feature.