A simultaneous interpretation system includes headsets for inputting and outputting voice, and a portable terminal for receiving an original language voice speech signal to be interpreted that is output from the first headset. The portable terminal outputs an interpreted voice speech signal based on the original language voice speech signal that has been interpreted into a different language to the second headset. The portable terminal either performs the interpretation or accesses an interpretation server to provide the second headset with the interpreted voice speech signal. Hence, the simultaneous interpretation is carried out using the short-range communication between the users by medium of the single portable terminal and thus more efficient and unrestricted conversation is realized.