A system and method for tap event location includes a device using a selection apparatus that provides accurate point locations. The device determines a 3-dimensional map of a scene in the view frustum of the device relative to a coordinate frame. The device receives an indication of the occurrence of a tap event comprising a contact of the selection apparatus with a subject, and determines the location of the tap event relative to the coordinate frame from the location of the selection apparatus. The location of the tap event may be used to determine a subject. Data associated with the subject may then be processed to provide effects in, or data about, the scene in the view frustum of the device. Embodiments include a selection apparatus that communicates occurrences of tap events to the device and includes features that allow the device to determine the location of the selection apparatus.