A method, system and computer program product for integrating plural modalities of information to obtain values for a specified attribute of a given system. In one embodiment, data of a first modality, conveying a first source of data of a first type of the system is acquired; a simulator is configured with settings of physical sensors; and data of a second modality from the system, conveying a second source of data of a second type of the system is acquired. The data of the second modality is converted to data of the first type, while configuring a virtual set of sensors to enable acquisition of the converted data of the second modality; and an adjoints equipped simulator is configured with settings of the virtual sensors, to mimic collection of data of the first type, while configured to measure data of the second type.