A method of searching for a scene based on a stream of images archived in a video surveillance database including: a first phase of preprocessing prior to archiving of the images including extracting generic information from the images of the stream, systematically annotating the scenes of the images by at least one indication defined as a function of the generic information, and indexing the scenes of the images based on information extracted from the indications originating from one or more streams; a second phase of investigation by preselecting video segments from the stream of images including the annotation indications associated with the images; and a third phase of searching for a particular scene based on at least one additional characteristic not forming part of the annotations associated with the preselected video segments.