Invention Grant
- Patent Title: Eye tracking with prediction and late update to GPU for fast foveated rendering in an HMD environment
-
Application No.: US15982312Application Date: 2018-05-17
-
Publication No.: US11262839B2Publication Date: 2022-03-01
- Inventor: Andrew Young , Javier Fernandez Rico
- Applicant: Sony Interactive Entertainment Inc.
- Applicant Address: JP Tokyo
- Assignee: Sony Interactive Entertainment Inc.
- Current Assignee: Sony Interactive Entertainment Inc.
- Current Assignee Address: JP Tokyo
- Agency: Penilla IP, APC
- Main IPC: G06F3/01
- IPC: G06F3/01 ; G06N5/04 ; G06T15/00

Abstract:
A method for updating information for a graphics pipeline including executing in the first frame period an application on a CPU to generate primitives of a scene for a first video frame. Gaze tracking information is received in a second frame period for an eye of a user. In the second frame period a landing point on an HMD display is predicted at the CPU based at least on the gaze tracking information. A late update of the predicted landing point to a buffer accessible by the GPU is performed in the second frame period. Shader operations are performed in the GPU in the second frame period to generate pixel data based on the primitives and based on the predicted landing point, wherein the pixel data is stored into a frame buffer. The pixel data is scanned out in the third frame period from the frame buffer to the HMD.
Public/Granted literature
- US20190354174A1 EYE TRACKING WITH PREDICTION AND LATE UPDATE TO GPU FOR FAST FOVEATED RENDERING IN AN HMD ENVIRONMENT Public/Granted day:2019-11-21
Information query