公开(公告)号：US12244823B2

公开(公告)日：2025-03-04

申请号：US17390570

申请日：2021-07-30

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu ,  Gary J. Sullivan

IPC: H04N19/159 ,  H04N19/11 ,  H04N19/172 ,  H04N19/176 ,  H04N19/513 ,  H04N19/57 ,  H04N19/593 ,  H04N19/96

Abstract: Innovations in encoder-side options for intra block copy (“BC”) prediction mode facilitate intra BC prediction that is more effective in terms of rate-distortion performance and/or computational efficiency of encoding. For example, some of the innovations relate to concurrently performing block vector (“BV”) estimation and making block splitting decisions for a block. Other innovations relate to selectively merging blocks into a larger block during BV estimation.

公开(公告)号：US12238324B2

公开(公告)日：2025-02-25

申请号：US18381951

申请日：2023-10-19

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu

IPC: H04N19/513 ,  H04N19/105 ,  H04N19/117 ,  H04N19/142 ,  H04N19/146 ,  H04N19/17 ,  H04N19/179 ,  H04N19/23 ,  H04N19/426 ,  H04N19/46 ,  H04N19/58 ,  H04N19/82

Abstract: Innovations in flexible reference picture management are described. For example, a video encoder and video decoder use a global reference picture set (“GRPS”) of reference pictures that remain in memory, and hence are available for use in video encoding/decoding, longer than conventional reference pictures. In particular, reference pictures of the GRPS remain available across random access boundaries. Or, as another example, a video encoder and video decoder clip a reference picture so that useful regions of the reference picture are retained in memory, while unhelpful or redundant regions of the reference picture are discarded. Reference picture clipping can reduce the amount of memory needed to store reference pictures or improve the utilization of available memory by providing better options for motion compensation. Or, as still another example, a video encoder and video decoder filter a reference picture to remove random noise (e.g., capture noise due to camera imperfections during capture).

公开(公告)号：US20240397089A1

公开(公告)日：2024-11-28

申请号：US18792374

申请日：2024-08-01

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Feng Wu ,  Jizheng Xu

IPC: H04N19/593 ,  H04N19/11 ,  H04N19/126 ,  H04N19/154 ,  H04N19/176 ,  H04N19/61 ,  H04N19/70

Abstract: Innovations in the use of base color index map (“BCIM”) mode during encoding and/or decoding simplify implementation by reducing the number of modifications made to support BCIM mode and/or improve coding efficiency of BCIM mode. For example, some of the innovations involve reuse of a syntax structure that is adapted for transform coefficients to instead signal data for elements of an index map in BCIM mode. Other innovations relate to mapping of index values in BCIM mode or prediction of elements of an index map in BCIM mode. Still other innovations relate to handling of exception values in BCIM mode.

公开(公告)号：US20240380908A1

公开(公告)日：2024-11-14

申请号：US18783241

申请日：2024-07-24

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu

IPC: H04N19/436 ,  H04N19/11 ,  H04N19/129 ,  H04N19/174 ,  H04N19/176 ,  H04N19/186 ,  H04N19/463 ,  H04N19/55 ,  H04N19/593 ,  H04N19/70 ,  H04N19/96

Abstract: Various innovations facilitate the use of intra-picture prediction modes such as palette prediction mode, intra block copy mode, intra line copy mode and intra string copy mode by an encoder or decoder when wavefront parallel processing (“WPP”) is enabled. For example, for a palette coding/decoding mode, an encoder or decoder predicts a palette for an initial unit in a current WPP row of a picture using previous palette data from a previous unit in a previous WPP row of the picture. Or, as another example, for an intra copy mode (e.g., intra block copy mode, intra string copy mode, intra line copy mode), an encoder enforces one or more constraints attributable to the WPP, or a decoder receives and decodes encoded data that satisfies one or more constraints attributable to WPP.

公开(公告)号：US20240275987A1

公开(公告)日：2024-08-15

申请号：US18632052

申请日：2024-04-10

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Ji-Zheng Xu

IPC: H04N19/159 ,  H04N19/174 ,  H04N19/176 ,  H04N19/184 ,  H04N19/513 ,  H04N19/593 ,  H04N19/70

CPC classification number: H04N19/159 ,  H04N19/174 ,  H04N19/176 ,  H04N19/184 ,  H04N19/513 ,  H04N19/70 ,  H04N19/593

Abstract: Innovations in unified intra block copy (“BC”) and inter prediction modes are presented. In some example implementations, bitstream syntax, semantics of syntax elements and many coding/decoding processes for inter prediction mode are reused or slightly modified to enable intra BC prediction for blocks of a frame. For example, to provide intra BC prediction for a current block of a current picture, a motion compensation process applies a motion vector that indicates a displacement within the current picture, with the current picture being used as a reference picture for the motion compensation process. With this unification of syntax, semantics and coding/decoding processes, various coding/decoding tools designed for inter prediction mode, such as advanced motion vector prediction, merge mode and skip mode, can also be applied when intra BC prediction is used, which simplifies implementation of intra BC prediction.

公开(公告)号：US11758162B2

公开(公告)日：2023-09-12

申请号：US17739299

申请日：2022-05-09

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu

IPC: H04N19/436 ,  H04N19/11 ,  H04N19/174 ,  H04N19/176 ,  H04N19/186 ,  H04N19/593 ,  H04N19/96 ,  H04N19/129 ,  H04N19/70 ,  H04N19/463 ,  H04N19/55

CPC classification number: H04N19/436 ,  H04N19/11 ,  H04N19/129 ,  H04N19/174 ,  H04N19/176 ,  H04N19/186 ,  H04N19/463 ,  H04N19/55 ,  H04N19/593 ,  H04N19/70 ,  H04N19/96

Abstract: Various innovations facilitate the use of intra-picture prediction modes such as palette prediction mode, intra block copy mode, intra line copy mode and intra string copy mode by an encoder or decoder when wavefront parallel processing (“WPP”) is enabled. For example, for a palette coding/decoding mode, an encoder or decoder predicts a palette for an initial unit in a current WPP row of a picture using previous palette data from a previous unit in a previous WPP row of the picture. Or, as another example, for an intra copy mode (e.g., intra block copy mode, intra string copy mode, intra line copy mode), an encoder enforces one or more constraints attributable to the WPP, or a decoder receives and decodes encoded data that satisfies one or more constraints attributable to WPP.

公开(公告)号：US20230269396A1

公开(公告)日：2023-08-24

申请号：US18142430

申请日：2023-05-02

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu ,  Feng Wu

IPC: H04N19/59 ,  H04N19/176 ,  H04N19/117 ,  H04N19/132 ,  H04N19/186 ,  H04N19/157 ,  H04N19/587 ,  H04N19/82 ,  H04N19/13 ,  H04N19/88

CPC classification number: H04N19/59 ,  H04N19/176 ,  H04N19/117 ,  H04N19/132 ,  H04N19/186 ,  H04N19/157 ,  H04N19/587 ,  H04N19/82 ,  H04N19/13 ,  H04N19/88 ,  H04N19/172

Abstract: Innovations in adaptive encoding and decoding for units of a video sequence can improve coding efficiency. For example, some of the innovations relate to encoding/decoding that includes adaptive switching of color spaces between units within a video sequence. Other innovations relate encoding/decoding that includes adaptive switching of color sampling rates between units within a video sequence. Still other innovations relate encoding/decoding that includes adaptive switching of bit depths between units within a video sequence.

公开(公告)号：US11716478B2

公开(公告)日：2023-08-01

申请号：US17381061

申请日：2021-07-20

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu ,  Gary J. Sullivan

IPC: H04N19/70 ,  H04N19/186 ,  H04N19/176 ,  H04N19/126 ,  H04N1/64 ,  H04N19/184

CPC classification number: H04N19/186 ,  H04N1/644 ,  H04N19/126 ,  H04N19/176 ,  H04N19/184 ,  H04N19/70

Abstract: Innovations in encoding or decoding when switching color spaces are presented. For example, some of the innovations relate to signaling of control information for adaptive color space transformation (“ACT”). Other innovations relate to ACT operations. These innovations can improve coding efficiency when switching between color spaces during encoding and decoding.

公开(公告)号：US11632569B2

公开(公告)日：2023-04-18

申请号：US17492338

申请日：2021-10-01

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu ,  Feng Wu

IPC: H04N19/59 ,  H04N19/176 ,  H04N19/147 ,  H04N19/117 ,  H04N19/132 ,  H04N19/186 ,  H04N19/587 ,  H04N19/182 ,  H04N19/51 ,  H04N19/593

Abstract: Innovations in adaptive encoding for units of a video sequence can improve coding efficiency. For example, some of the innovations relate to encoding that includes adaptive switching of color spaces between units within a video sequence. Other innovations relate encoding that includes adaptive switching of color sampling rates between units within a video sequence. Still other innovations relate encoding that includes adaptive switching of bit depths between units within a video sequence.

公开(公告)号：US20230091602A1

公开(公告)日：2023-03-23

申请号：US17994804

申请日：2022-11-28

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu

IPC: H04N19/124 ,  H04N19/593 ,  H04N19/157 ,  H04N19/182 ,  H04N19/13 ,  H04N19/91

Abstract: Approaches to robust encoding and decoding of escape-coded pixels in a palette mode are described. For example, sample values of escape-coded pixels in palette mode are encoded/decoded using a binarization process that depends on a constant value of quantization parameter (“QP”) for the sample values. Or, as another example, sample values of escape-coded pixels in palette mode are encoded/decoded using a binarization process that depends on sample depth for the sample values. Or, as still another example, sample values of escape-coded pixels in palette mode are encoded/decoding using a binarization process that depends on some other fixed rule. In example implementations, these approaches avoid dependencies on unit-level QP values when parsing the sample values of escape-coded pixels, which can make encoding/decoding more robust to data loss.