Jointly determining image segmentation and characterization. A computer-generated image of an organ may be received. Organ characteristics estimation may be performed to predict the organ characteristics considering organ segmentation. Organ segmentation may be performed to delineate the organ in the image considering the organ characteristics. A feedback loop feeds the organ characteristics estimation to determine the organ segmentation, and feeds back the organ segmentation to determine the organ characteristics estimation.