公开(公告)号：US20180280656A1

公开(公告)日：2018-10-04

申请号：US15882997

申请日：2018-01-29

Applicant: NextVR Inc.

Inventor： David Cole ,  Hector M. Medina

IPC: A61M21/02 ,  G09B19/00 ,  G09B5/04 ,  G09B5/02 ,  A61B5/00

Abstract: Integrated systems for providing audio, video, light stimulus and/or measuring brain activity through the use of one or more electrodes, e.g., EEG dermatrodes, are described. A system, e.g., a head mounted VR device, for providing stimulation to a user and detecting user responses to said stimulation includes a head mount, a plurality of light emitting elements, e.g., sets of LEDs, a housing secured to said head mount, and at least one or more electrodes for making contact with skin of a user. In various embodiments, the system further determines a user's mental state and provides audio and/or visual feedback to the user.

公开(公告)号：US09894350B2

公开(公告)日：2018-02-13

申请号：US15255135

申请日：2016-09-01

Applicant: NextVR Inc.

Inventor： David Cole ,  Alan McKay Moss ,  Hector M. Medina

IPC: H04N17/00 ,  H04N17/02 ,  H04N13/02 ,  H04N5/232 ,  G06T11/00 ,  G06T15/04 ,  G06T7/80 ,  H04N21/414 ,  H04N21/4402 ,  H04N21/485 ,  H04N21/81 ,  G02B27/01

CPC classification number: H04N17/002 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G06T7/85 ,  G06T11/001 ,  G06T15/04 ,  G06T2207/10021 ,  H04N5/23238 ,  H04N13/232 ,  H04N13/246 ,  H04N13/275 ,  H04N21/41407 ,  H04N21/4402 ,  H04N21/4854 ,  H04N21/816

Abstract: Camera and/or lens calibration information is generated as part of a calibration process in video systems including 3-dimensional (3D) immersive content systems. The calibration information can be used to correct for distortions associated with the source camera and/or lens. A calibration profile can include information sufficient to allow the system to correct for camera and/or lens distortion/variation. This can be accomplished by capturing a calibration image of a physical 3D object corresponding to the simulated 3D environment, and creating the calibration profile by processing the calibration image. The calibration profile can then be used to project the source content directly into the 3D viewing space while also accounting for distortion/variation, and without first translating into an intermediate space (e.g., a rectilinear space) to account for lens distortion.

公开(公告)号：US20170359564A1

公开(公告)日：2017-12-14

申请号：US15672236

申请日：2017-08-08

Applicant: NextVR Inc.

Inventor： David Cole ,  Alan McKay Moss ,  Hector M. Medina

IPC: H04N13/00 ,  H04N19/136 ,  H04N21/81 ,  H04N21/44 ,  H04N21/435 ,  H04N19/172 ,  G06T17/20 ,  H04N19/597 ,  H04N19/44 ,  H04N21/472 ,  G06T15/04 ,  H04N13/02 ,  H04N21/2343 ,  H04N21/437 ,  H04N5/232 ,  H04N21/2387 ,  H04N21/426

CPC classification number: H04N13/189 ,  G06T15/04 ,  G06T17/20 ,  G06T2215/12 ,  H04N5/23238 ,  H04N13/106 ,  H04N13/139 ,  H04N13/161 ,  H04N13/194 ,  H04N13/243 ,  H04N13/275 ,  H04N13/279 ,  H04N19/136 ,  H04N19/172 ,  H04N19/44 ,  H04N19/597 ,  H04N21/234363 ,  H04N21/2387 ,  H04N21/42653 ,  H04N21/435 ,  H04N21/437 ,  H04N21/44016 ,  H04N21/472 ,  H04N21/8146 ,  H04N21/816 ,  H04N2013/0088

Abstract: Methods and apparatus for using selective resolution reduction on images to be transmitted and/or used by a playback device are described. Prior to transmission one or more images of an environment are captured. Based on image content, motion detection and/or user input a resolution reduction operation is selected and performed. The reduced resolution image is communicated to a playback device along with information indicating a UV map corresponding to the selected resolution allocation that should be used by the playback device for rendering the communicated image. By changing the resolution allocation used and which UV map is used by the playback device different resolution allocations can be made with respect to different portions of the environment while allowing the number of pixels in transmitted images to remain constant. The playback device renders the individual images with the UV map corresponding to the resolution allocation used to generate the individual images.

公开(公告)号：US09729850B2

公开(公告)日：2017-08-08

申请号：US15046327

申请日：2016-02-17

Applicant: NextVR Inc.

Inventor： David Cole ,  Alan McKay Moss ,  Hector M. Medina

IPC: H04N19/136 ,  H04N13/00 ,  H04N19/44 ,  G06T17/20 ,  H04N21/44 ,  H04N21/435 ,  H04N21/426 ,  G06T15/04 ,  H04N21/81 ,  H04N13/02 ,  H04N19/172 ,  H04N5/232 ,  H04N21/2343 ,  H04N21/2387 ,  H04N21/437 ,  H04N21/472 ,  H04N19/597

CPC classification number: H04N13/189 ,  G06T15/04 ,  G06T17/20 ,  G06T2215/12 ,  H04N5/23238 ,  H04N13/106 ,  H04N13/139 ,  H04N13/161 ,  H04N13/194 ,  H04N13/243 ,  H04N13/275 ,  H04N13/279 ,  H04N19/136 ,  H04N19/172 ,  H04N19/44 ,  H04N19/597 ,  H04N21/234363 ,  H04N21/2387 ,  H04N21/42653 ,  H04N21/435 ,  H04N21/437 ,  H04N21/44016 ,  H04N21/472 ,  H04N21/8146 ,  H04N21/816 ,  H04N2013/0088

Abstract: Methods and apparatus for using selective resolution reduction on images to be transmitted and/or used by a playback device are described. Prior to transmission one or more images of an environment are captured. Based on image content, motion detection and/or user input a resolution reduction operation is selected and performed. The reduced resolution image is communicated to a playback device along with information indicating a UV map corresponding to the selected resolution allocation that should be used by the playback device for rendering the communicated image. By changing the resolution allocation used and which UV map is used by the playback device different resolution allocations can be made with respect to different portions of the environment while allowing the number of pixels in transmitted images to remain constant. The playback device renders the individual images with the UV map corresponding to the resolution allocation used to generate the individual images.

公开(公告)号：US20160241838A1

公开(公告)日：2016-08-18

申请号：US15046314

申请日：2016-02-17

Applicant: NextVR Inc.

Inventor： David Cole ,  Alan McKay Moss ,  Hector M. Medina

IPC: H04N13/00 ,  H04N21/2343

CPC classification number: H04N13/189 ,  G06T15/04 ,  G06T17/20 ,  G06T2215/12 ,  H04N5/23238 ,  H04N13/106 ,  H04N13/139 ,  H04N13/161 ,  H04N13/194 ,  H04N13/243 ,  H04N13/275 ,  H04N13/279 ,  H04N19/136 ,  H04N19/172 ,  H04N19/44 ,  H04N19/597 ,  H04N21/234363 ,  H04N21/2387 ,  H04N21/42653 ,  H04N21/435 ,  H04N21/437 ,  H04N21/44016 ,  H04N21/472 ,  H04N21/8146 ,  H04N21/816 ,  H04N2013/0088

Abstract: Methods and apparatus for using selective resolution reduction on images to be transmitted and/or used by a playback device are described. Prior to transmission one or more images of an environment are captured. Based on image content, motion detection and/or user input a resolution reduction operation is selected and performed. The reduced resolution image is communicated to a playback device along with information indicating a UV map corresponding to the selected resolution allocation that should be used by the playback device for rendering the communicated image. By changing the resolution allocation used and which UV map is used by the playback device different resolution allocations can be made with respect to different portions of the environment while allowing the number of pixels in transmitted images to remain constant. The playback device renders the individual images with the UV map corresponding to the resolution allocation used to generate the individual images.

Abstract translation: 描述了用于对由播放装置发送和/或使用的图像进行选择性分辨率降低的方法和装置。 在发送之前，捕获一个或多个环境图像。 基于图像内容，选择并执行运动检测和/或用户输入分辨率降低操作。 还原分辨率图像与再现装置一起被传送到播放装置，以及指示与所选择的分辨率分配相对应的UV映射的信息，该分配分配应由回放装置用于呈现所传送的图像。 通过改变所使用的分辨率分配以及由重放装置使用哪个UV映射，可以相对于环境的不同部分进行不同的分辨率分配，同时允许传输图像中的像素数保持不变。 播放设备使用与用于生成各个图像的分辨率分配相对应的UV映射呈现各个图像。

公开(公告)号：US20200053341A1

公开(公告)日：2020-02-13

申请号：US16520066

申请日：2019-07-23

Applicant: NextVR Inc.

Inventor： David Cole ,  Alan McKay Moss ,  Hector M. Medina

IPC: H04N13/189 ,  H04N13/139 ,  H04N13/239 ,  H04N13/275 ,  H04N13/243 ,  H04N19/59 ,  H04N19/37 ,  G06T3/40 ,  H04N21/845 ,  H04N21/6587 ,  H04N21/4728 ,  H04N21/442 ,  H04N21/2343 ,  H04N19/597 ,  H04N21/81 ,  H04N21/44 ,  G06T17/20 ,  G06T15/04 ,  H04N13/383 ,  H04N13/344 ,  H04N13/194 ,  H04N13/161 ,  H04N13/106 ,  H04N5/232

Abstract: Methods and apparatus for collecting user feedback information from viewers of content are described. Feedback information is received from viewers of content. The feedback indicates, based on head tracking information in some embodiments, where users are looking in a simulated environment during different times of a content presentation, e.g., different frame times. The feedback information is used to prioritize different portions of an environment represented by the captured image content. Resolution allocation is performed based on the feedback information and the content re-encoded based on the resolution allocation. The resolution allocation may and normally does change as the priority of different portions of the environment change.

公开(公告)号：US20190313075A1

公开(公告)日：2019-10-10

申请号：US16013879

申请日：2018-06-20

Applicant: NextVR Inc.

Inventor： Alan McKay Moss ,  Hector M. Medina ,  Ryan Michael Sheridan ,  Matthew Yaeger ,  David Ibbitson ,  David Cole

IPC: H04N13/122 ,  H04N13/239

Abstract: An unobstructed image portion of a captured image from a first camera of a camera pair, e.g., a stereoscopic camera pair including fisheye lenses, is combined with a scaled extracted image portion generated from a captured image from a second camera in the camera pair. An unobstructed image portion of a captured image from the second camera of the camera pair is combined with a scaled extracted image portion generated from a captured image from the first camera in the camera pair. As part of the combining obstructed image portions which were obstructed by part of the adjacent camera are replaced in some embodiments. In some embodiments, the obstructions are due to adjacent fisheye lens. In various embodiments fish eye lenses which have been cut to be flat on one side are used for the left and right cameras with the spacing between the optical axis approximating the spacing between the optical axis of a human person's eyes.

公开(公告)号：US10412382B2

公开(公告)日：2019-09-10

申请号：US15871777

申请日：2018-01-15

Applicant: NextVR Inc.

Inventor： David Cole ,  Alan McKay Moss ,  Hector M. Medina

IPC: H04N17/00 ,  H04N5/232 ,  H04N13/246 ,  H04N13/275 ,  G06T11/00 ,  G06T15/04 ,  G02B27/01 ,  G06T7/80 ,  H04N13/232 ,  H04N21/414 ,  H04N21/4402 ,  H04N21/485 ,  H04N21/81

Abstract: Camera and/or lens calibration information is generated as part of a calibration process in video systems including 3-dimensional (3D) immersive content systems. The calibration information can be used to correct for distortions associated with the source camera and/or lens. A calibration profile can include information sufficient to allow the system to correct for camera and/or lens distortion/variation. This can be accomplished by capturing a calibration image of a physical 3D object corresponding to the simulated 3D environment, and creating the calibration profile by processing the calibration image. The calibration profile can then be used to project the source content directly into the 3D viewing space while also accounting for distortion/variation, and without first translating into an intermediate space (e.g., a rectilinear space) to account for lens distortion.

公开(公告)号：US20180220121A1

公开(公告)日：2018-08-02

申请号：US15806251

申请日：2017-11-07

Applicant: NextVR Inc.

Inventor： David Cole ,  Alan McKay Moss ,  Hector M. Medina

IPC: H04N13/189 ,  H04N21/81 ,  H04N13/279 ,  H04N13/106 ,  H04N21/472 ,  H04N21/44 ,  H04N21/437 ,  H04N21/435 ,  H04N21/426 ,  H04N21/2387 ,  H04N21/2343 ,  H04N5/232 ,  G06T17/20 ,  G06T15/04 ,  H04N19/597 ,  H04N19/44 ,  H04N19/172 ,  H04N19/136 ,  H04N13/275 ,  H04N13/243 ,  H04N13/161 ,  H04N13/194 ,  H04N13/139 ,  H04N13/00

CPC classification number: H04N13/189 ,  G06T15/04 ,  G06T17/20 ,  G06T2215/12 ,  H04N5/23238 ,  H04N13/106 ,  H04N13/139 ,  H04N13/161 ,  H04N13/194 ,  H04N13/243 ,  H04N13/275 ,  H04N13/279 ,  H04N19/136 ,  H04N19/172 ,  H04N19/44 ,  H04N19/597 ,  H04N21/234363 ,  H04N21/2387 ,  H04N21/42653 ,  H04N21/435 ,  H04N21/437 ,  H04N21/44016 ,  H04N21/472 ,  H04N21/8146 ,  H04N21/816 ,  H04N2013/0088

Abstract: Methods and apparatus for using selective resolution reduction on images to be transmitted and/or used by a playback device are described. Prior to transmission one or more images of an environment are captured. Based on image content, motion detection and/or user input a resolution reduction operation is selected and performed. The reduced resolution image is communicated to a playback device along with information indicating a UV map corresponding to the selected resolution allocation that should be used by the playback device for rendering the communicated image. By changing the resolution allocation used and which UV map is used by the playback device different resolution allocations can be made with respect to different portions of the environment while allowing the number of pixels in transmitted images to remain constant. The playback device renders the individual images with the UV map corresponding to the resolution allocation used to generate the individual images.

公开(公告)号：US20160241892A1

公开(公告)日：2016-08-18

申请号：US15046311

申请日：2016-02-17

Applicant: NextVR Inc.

Inventor： David Cole ,  Alan McKay Moss ,  Hector M. Medina

IPC: H04N21/2343 ,  H04N21/2387 ,  H04N21/437 ,  H04N21/472 ,  H04N13/00 ,  H04N5/232

CPC classification number: H04N13/189 ,  G06T15/04 ,  G06T17/20 ,  G06T2215/12 ,  H04N5/23238 ,  H04N13/106 ,  H04N13/139 ,  H04N13/161 ,  H04N13/194 ,  H04N13/243 ,  H04N13/275 ,  H04N13/279 ,  H04N19/136 ,  H04N19/172 ,  H04N19/44 ,  H04N19/597 ,  H04N21/234363 ,  H04N21/2387 ,  H04N21/42653 ,  H04N21/435 ,  H04N21/437 ,  H04N21/44016 ,  H04N21/472 ,  H04N21/8146 ,  H04N21/816 ,  H04N2013/0088

Abstract: Methods and apparatus for using selective resolution reduction on images to be transmitted and/or used by a playback device are described. Prior to transmission one or more images of an environment are captured. Based on image content, motion detection and/or user input a resolution reduction operation is selected and performed. The reduced resolution image is communicated to a playback device along with information indicating a UV map corresponding to the selected resolution allocation that should be used by the playback device for rendering the communicated image. By changing the resolution allocation used and which UV map is used by the playback device different resolution allocations can be made with respect to different portions of the environment while allowing the number of pixels in transmitted images to remain constant. The playback device renders the individual images with the UV map corresponding to the resolution allocation used to generate the individual images.