Systems and methods for managing wake-on-voice buffer quality based on system boot profiling. In an illustrative, non-limiting embodiment, an Information Handling System (IHS) may include at least one logic circuit and at least one memory circuit coupled to the at least one logic circuit, the at least one memory including program instructions stored thereon that, upon execution by the at least one logic circuit, cause the IHS to: determine an expected time duration of a future wake event; receive a verbal command from a user, the verbal command configured to trigger the future wake event; capture the verbal command as an audio signal; adjust at least one of: a quality of the audio signal or a duration of the audio signal, where the adjustment is based, at least in part, upon the expected time duration; and store the adjusted audio signal in a fixed-size buffer.