A method and system for generating a patient specific anatomical heart model is disclosed. Volumetric image data, such as computed tomography (CT) or echocardiography image data, of a patient's cardiac region is received. Individual models for multiple heart components, such as the left ventricle (LV) endocardium, LV epicardium, right ventricle (RV), left atrium (LA), right atrium (RA), mitral valve, aortic valve, aorta, and pulmonary trunk, are estimated in said volumetric cardiac image data. A patient specific anatomical heart model is generated by integrating the individual models for each of the heart components.