A method of controlling a conversation in an ambient telephone environment having a plurality of spaces includes providing a plurality of devices distributed in the plurality of spaces used by one or more users, at least one of the plurality of devices is connected to a telecommunications network for enabling communication between the environment and one or more remote terminals; and obtaining signals communicating a conversation between at least one remote terminal and at least one of the plurality of devices and audio from the one or more users. The method further includes identifying a user of the at least one device used in the obtained conversation by detecting interaction of a type corresponding to conversational turn-taking; and tracking movements of the user in the environment to determine its presence in a first of the plurality of spaces.