InterDigital VC Holdings, Inc.

Method, apparatus and systems are disclosed. In one embodiment, a method of decoding includes obtaining a sub-block based motion prediction signal for a current block of the video; obtaining one or more spatial gradients of the sub-block based motion prediction signal or one or more motion vector difference values; obtaining a refinement signal for the current block based on the one or more obtained spatial gradients or the one or more obtained motion vector difference values; obtaining a refined motion prediction signal for the current block based on the sub-block based motion prediction signal and the refinement signal; and decoding the current block based on the refined motion prediction signal.

Bi-directional optical flow (BDOF) may be bypassed, for a current coding block, based on whether symmetric motion vector difference (SMVD) is used in motion vector coding for the current coding block. A coding device (e.g., an encoder or a decoder) may determine whether to bypass BDOF for the current coding block based at least in part on an SMVD indication for the current coding block. The coding device may obtain the SMVD indication that indicates whether SMVD is used in motion vector coding for the current coding block. If SMVD indication indicates that SMVD is used in the motion vector coding for the current coding block, the coding device may bypass BDOF for the current coding block. The coding device may reconstruct the current coding block without performing BDOF if it determines to bypass BDOF for the current coding block.

A device may receive information associated with a plurality of cameras where each of the cameras has an associated camera object. The device may associate a first camera object with a first viewer. The first camera object may have associated first extrinsic properties and associated first intrinsic properties. The device may associate a second camera object with a second viewer. The second camera object may have associated second extrinsic properties and associated second intrinsic properties. The device may send a registration request to a Media Access Function (MAF) where the registration request identifies the first camera object and the second camera object. The first viewer and the second viewer may update their preferred views of media content, in response, the device may send an update request to the MAF, where the request comprises updated information associated with the first camera object and updated information associated with the second camera object.

In general, encoding or decoding a picture part can involve a first CABAC probability model associated with a first flag indicating use of an affine mode and a second CABAC probability model associated with a second flag indicating use of either the affine mode or a second mode different from the affine mode, where the first and second CABAC probability models are different and are determined independently.

Methods and apparatus for performing in-loop filtering in an encoder or a decoder provide regions which use a common set of filter parameters An index can be sent from an encoder to a decoder indicating which set of filter parameters is to be used for a particular region. The in-loop filter can be Sample Adaptive Offset, Adaptive Loop Filter, or any other such filter. An encoder classifies regions of a picture according to blocks using a common set of filter parameter. The classification can be in the form of a map. Filtering blocks use the common set of filter parameters for a region. A decoder parses a bitstream for a set of filter parameters and an index indicative of the filter parameter set for a region being decoded.

A video encoder or decoder processes portions of video with less delay when its processes are parallelized and avoids delays caused by dependence on the completion of prior processes. In one embodiment, a motion vector predictor from a neighboring block of video is used in a subsequent later block of video before it is finished being refined for use in the neighboring block. In another embodiment, information from a neighboring block is confined to include blocks in the same coding tree unit. In another embodiment, a motion vector predictor is checked to see whether it is already in a list of candidates before adding it to the list to expedite the process.

A computer-implemented method for encoding a video frame includes selecting a block from a plurality of blocks within the video frame, identifying a reference block within a reference boundary region of the video frame, the reference boundary region being defined by a fixed mask, and the reference boundary region being less than all of the video frame, determining prediction parameters based on a relationship between the selected block and the identified reference block, and encoding, with an encoder, the prediction parameters and an indicator of the fixed mask into a bitstream.

In one implementation, we propose an adaptive point generation mechanism that can control the number of output points, for example, to have it matched exactly to the number of input points. The proposed method can be used in folding-based point cloud compression systems. In one example, using FPS (Farthest Point Sampling), we propose the adaptive grid generator, which provides control over the number of points in the reconstructed point cloud. Given an input point cloud, a pre-defined 2D grid is sampled using FPS procedure with the number of input points controlling the number of samples. On one hand, this enables lossless reconstruction of point clouds which is useful for storage and several real-world applications. On the other hand, having control over the number of output points also opens avenues to machine and vision applications such as hierarchical processing, super-resolution, summarization, of point clouds.

Different implementations are described, particularly implementations for video encoding and decoding based on wherein the partitioning tree structure is partially shared between luma and chroma blocks are presented. According to an implementation, a single partitioning tree structure is shared between luma and chroma blocks from a root node of the partitioning tree down to a switching node and a dual partitioning tree structure is determined for luma and chroma blocks from the switching node down to a leaf node of the partitioning tree. Thus, this implementation optimizes the coding efficiency by allowing separated trees for smaller blocks, while limiting the complexity of decoding pipeline.

A media content processing device may decode visual volumetric content based on one or more messages, which may indicate which attribute sub-bitstream of one or more attribute sub-bitstreams indicated in a parameter set is active. The parameter set may include a visual volumetric video-based parameter set. The message indicating one or more active attribute sub-bitstreams may be received by the decoder. A decoder may perform decoding, such as determining which attribute sub-bitstream to use for decoding visual media content, based on the one or more messages. The one or more messages may be generated and sent to a decoder, for example, to indicate the deactivation of the one or more attribute sub-bitstreams. The decoder may determine an inactive attribute sub-bitstream and skip the inactive attribute sub-bitstream for decoding the visual media content based on the one or more messages.