A method is provided to control the lighting ambience in a space by means of a plurality of controllable light sources (16). The light from the light sources (16) is adapted dependent on a position of an object (20) such as a person in the space. Control comprises capturing an image of at least part of said space. From said image whether light from a selected one of the controllable light sources (16) to points in said space shown at respective image positions in said image has been intercepted by the object (20). This may involve image positions where the object casts a shadow or positions that show a surface on the object that is turned away from the light source (16). From the respective image positions where the light has been detected to be intercepted information indicative of a direction of the intercepting object relative to the selected one of the controllable light sources (16) is detected. Position information that indicates a position of the object (20) in said space is updated according to the direction determined from the respective image positions where the light has been detected to be intercepted. A lighting parameter setting of the controllable light sources (16) is adjusted dependent on the updated position information.