A system and method provide heart sound tracking, including an input circuit, configured to receive heart sound information, and a heart sound recognition circuit. The heart sound recognition circuit can be coupled to the input circuit and can be configured to recognize, within a particular heart sound of a particular heart sound waveform, a first intra heart sound energy indication and a corresponding first intra heart sound time indication using the heart sound information from the particular heart sound waveform and the heart sound information from at least one other heart sound waveform. The particular heart sound can include at least a portion of one of S1, S2, S3, and S4. Further, the first intra heart sound energy indication and the corresponding first intra heart sound time indication can correspond to the at least a portion of one of S1, S2, S3, and S4, respectively.