Layered scene decomposition CODEC with higher order lighting

    公开(公告)号:US10986326B2

    公开(公告)日:2021-04-20

    申请号:US16798230

    申请日:2020-02-21

    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data including information on directions of normals is divided into a plurality of data layers of increasing depths as the distance between a given layer and the display surface increases. Data layers which are sampled using a plenoptic sampling scheme and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.

    High-performance light field display simulator

    公开(公告)号:US10924727B2

    公开(公告)日:2021-02-16

    申请号:US16156421

    申请日:2018-10-10

    Abstract: A simulator for light field displays. A high-performance simulator that can operate in real-time, allowing for VR-based evaluation of display designs. These capabilities allow for rapid exploration of display parameters (e.g. angular and hogel resolution, field of view, etc.), the visualization of how the angular spread of the rays that can affect quality and the evaluation of artifacts from light field processing. Additionally, the high-throughput nature of the simulation makes it amenable for use in the evaluation of light processing procedures such as those involved in light field rendering and compression contexts. The speed and ease with which one can explore light field display parameters makes this simulator the ideal tool for light field content design and evaluation.

    Light field sampling method
    4.
    发明授权

    公开(公告)号:US12261989B2

    公开(公告)日:2025-03-25

    申请号:US18482294

    申请日:2023-10-06

    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the display surface increases. Data layers which are sampled using an effective resolution function to determine a suitable sampling rate and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.

    Layered Scene Decomposition CODEC with Layered Depth Imaging

    公开(公告)号:US20220109817A1

    公开(公告)日:2022-04-07

    申请号:US17551327

    申请日:2021-12-15

    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the display surface increases. Data layers are sampled using a plenoptic sampling scheme and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.

    LAYERED SCENE DECOMPOSITION CODEC SYSTEM AND METHODS

    公开(公告)号:US20210203948A1

    公开(公告)日:2021-07-01

    申请号:US17185556

    申请日:2021-02-25

    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the plane of the display increases. Data layers are sampled using a plenoptic sampling scheme and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.

    Layered Scene Decomposition CODEC with Asymptotic Resolution

    公开(公告)号:US20210152807A1

    公开(公告)日:2021-05-20

    申请号:US17128294

    申请日:2020-12-21

    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the display surface increases. Data layers which are sampled using an effective resolution function to determine a suitable sampling rate and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.

    Layered scene decomposition CODEC with asymptotic resolution

    公开(公告)号:US10911735B2

    公开(公告)日:2021-02-02

    申请号:US16798253

    申请日:2020-02-21

    Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the display surface increases. Data layers which are sampled using an effective resolution function to determine a suitable sampling rate and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.

Patent Agency Ranking