OP Solutions, LLC

Systems and methods for video coding of visual features that uses picture structures such as subpictures to independently encode individual features or groups of features are disclosed. An encoding method includes extracting a plurality of features from an image, representing each of the image features as a two-dimensional feature unit, grouping the feature units into at least one subpicture of the frame, and encoding the video frame into a bitstream. A compatible decoder for reconstructing the sequence of features is also provided.

A video surveillance system includes a plurality of cameras including an action recognition engine that classifies the video content to at least one of a plurality of predetermined actions in real time. The action recognition engine of a first camera communicates with at least one other action recognition engine, whereby detected actions and tasks related to the detected action can be exchanged. The cameras include a feature encoder operatively coupled to the action recognition engine that generates an encoded feature substream and a video encoder that receives the video content and provides an encoded video substream. A multiplexor receives the encoded feature substream and encoded video substream and generates an encoded camera bitstream including encoded video content and detected action content, which can be decoded at a receiver site for human and machine consumption.

An image transmission system with privacy protection includes a privacy request processor which receives a request to secure at least one object type in an image prior to transmission of the image to a receiving system. An object detector receives the image data from a camera and processes the image data to identify at least one predetermined object type in the image data. An object scrambler receives a set of protected objects from the privacy request processor and receives the image data with identified objects of the predetermined object type and operates to obscure the image data for any identified objects identified as protected objects prior to encoding and transmission to a remote receiver site.

A method includes receiving a bit stream, decoding a first frame using the bit stream, determining a scaled first frame using the first frame and a scaling constant, storing the first frame in a first picture buffer at a first index location, and storing the scaled first frame in a second picture buffer at the first index location. Related apparatus, systems, techniques and articles are also described.

A decoder is configured to receive a bitstream that has a reference picture, a current picture having a resolution different from the reference picture and including a first block and a second block that is an intra-coded block, and information useful for determining a scaling constant. The decoder is further configured to determine a scaling constant using the information in the bitstream, determine a scaled prediction block from the reference picture by determining a location of the scaled prediction block by scaling a motion vector component using the scaling constant, scaling the resolution of a block of the reference picture using the scaling constant and applying a filter determined specifically for the prediction block and not determined for the whole reference picture, reconstruct the first block using the scaled prediction block, and reconstruct the intra-coded second block without using a scaled prediction block.

A method includes receiving a bit stream; determining, using the bit stream, whether an adaptive resolution management mode is enabled; determining, using the bit stream, a scaling factor including a vertical scaling constant component and a horizontal scaling constant component; and reconstructing pixel data of a current block in adaptive resolution management mode and using the determined scaling factor, the reconstructing including scaling the current block horizontally by the horizontal scaling constant component and scaling the current block vertically by the vertical scaling constant component. Related apparatus, systems, techniques and articles are also described.

A decoder is configured to receive a bit stream including a current frame and a picture header associated with the entire current frame, determine, as a function of the picture header, that one global motion mode is enabled for the entire current frame, the enabled global motion mode being selected from a group including translational motion, 4-parameter affine motion, and 6-parameter affine motion, detect, based on the enabled global motion mode, a plurality of parameters applicable to the entire frame, and decode the current frame using the detected parameters.

A system for low complexity and/or energy efficient encoding includes an encoding device, the encoding device configured to select a video application for an input video, set at least a boundary parameter, determine at least a goal parameter, generate a plurality of tool combinations, wherein each tool combination of the plurality of tool combinations has fewer tools than the full encoder toolset, tabulate measurements of each tool combination of the plurality of tool combinations, and select a tool combination of the plurality of tool combinations, wherein the selected tool combination generates optimal measurements as a function of the at least a goal parameter. An energy measurement device may be coupled to the encoding device and the selected tool combination may achieve the goal parameter at the highest energy efficiency.

An encoder for video encoding and decoding with long term reference picture retention. The encoder generates an encoded bitream for a compliant decoder. At the decoder, coded pictures are decoded using a list of references pictures, of which at least one is a long term reference picture. A first picture is decoded using the long term reference picture. A second picture is decoded without using the long term reference picture which is inactive but is retained in a buffer. A subsequent picture is then decoded again using the long term reference picture.

Systems and methods for motion information transfer from visual to feature domain are disclosed which provide for mapping motion information from coding units in video content to corresponding convolution unit(s) in feature content. Systems and methods are also provided for improved decoder-side motion vector refinement of video content based on characteristics of corresponding feature units.