Provided herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for enabling Do Not Disturb functionality in voice responsive devices. An example embodiment operates by: enabling an user to configure Do Not Disturb settings for a voice responsive device; while (a) the Do Not Disturb functionality is activated for the voice responsive device, and (b) within a Do Not Disturb time period specified by the Do Not Disturb settings: disabling one or more microphones; receiving an unambiguous trigger; responsive to receiving the unambiguous trigger, enabling the microphone(s); receiving a voice command; and processing the voice command. An example of an unambiguous trigger may be the user pressing a talk button (either a physical or digital button) on a remote control associated with the voice responsive device.