Layered scene decomposition CODEC with higher order lighting

    公开(公告)号:US10986326B2

    公开(公告)日:2021-04-20

    申请号:US16798230

    申请日:2020-02-21

    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data including information on directions of normals is divided into a plurality of data layers of increasing depths as the distance between a given layer and the display surface increases. Data layers which are sampled using a plenoptic sampling scheme and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.

    High-performance light field display simulator

    公开(公告)号:US10924727B2

    公开(公告)日:2021-02-16

    申请号:US16156421

    申请日:2018-10-10

    Abstract: A simulator for light field displays. A high-performance simulator that can operate in real-time, allowing for VR-based evaluation of display designs. These capabilities allow for rapid exploration of display parameters (e.g. angular and hogel resolution, field of view, etc.), the visualization of how the angular spread of the rays that can affect quality and the evaluation of artifacts from light field processing. Additionally, the high-throughput nature of the simulation makes it amenable for use in the evaluation of light processing procedures such as those involved in light field rendering and compression contexts. The speed and ease with which one can explore light field display parameters makes this simulator the ideal tool for light field content design and evaluation.

    Light field sampling method
    4.
    发明授权

    公开(公告)号:US12261989B2

    公开(公告)日:2025-03-25

    申请号:US18482294

    申请日:2023-10-06

    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the display surface increases. Data layers which are sampled using an effective resolution function to determine a suitable sampling rate and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.

    Layered Scene Decomposition CODEC with Layered Depth Imaging

    公开(公告)号:US20220109817A1

    公开(公告)日:2022-04-07

    申请号:US17551327

    申请日:2021-12-15

    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the display surface increases. Data layers are sampled using a plenoptic sampling scheme and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.

    LAYERED SCENE DECOMPOSITION CODEC SYSTEM AND METHODS

    公开(公告)号:US20210203948A1

    公开(公告)日:2021-07-01

    申请号:US17185556

    申请日:2021-02-25

    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the plane of the display increases. Data layers are sampled using a plenoptic sampling scheme and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.

    Directional pixel array for multiple view display

    公开(公告)号:US11025895B2

    公开(公告)日:2021-06-01

    申请号:US16686677

    申请日:2019-11-18

    Abstract: The present disclosure relates to a directional pixel for a high-angular resolution, wide field of view, multiple view display. The design teaches a directional pixel comprising a substrate, one or more pixel driving circuits, one or more nano- or micro-scale subpixels, and one or more directional optical guiding surfaces, wherein each of said one or more subpixels is comprised of a light emitting device emitting a light beam and an optical microcavity housing said light emitting device. The optical microcavity is comprised of a plurality of reflective surfaces to specifically manipulate and tune said light beam, wherein one or more of said reflective surfaces is a light propagating reflective surface which propagates said light beam out of said microcavity, and said light propagating reflective surface is connected to said one or more directional optical guiding surfaces to direct said light beam at a specific angle. A high-angular resolution, multiple-view light-field display is created by deploying a plurality of directional pixels into a directional pixel array system.

    Layered Scene Decomposition CODEC with Asymptotic Resolution

    公开(公告)号:US20210152807A1

    公开(公告)日:2021-05-20

    申请号:US17128294

    申请日:2020-12-21

    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the display surface increases. Data layers which are sampled using an effective resolution function to determine a suitable sampling rate and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.

    Layered scene decomposition CODEC with asymptotic resolution

    公开(公告)号:US10911735B2

    公开(公告)日:2021-02-02

    申请号:US16798253

    申请日:2020-02-21

    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the display surface increases. Data layers which are sampled using an effective resolution function to determine a suitable sampling rate and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.

Patent Agency Ranking