Illuscio, Inc.

A splat generation system and associated methods implement a modified splatting pipeline that quantifies loss at each splat generation iteration without rendering the splats generated at each iteration or comparing the resulting visualization against reference images of a 3D asset. The system receives the 3D asset and generates a splat representation of the 3D asset. The system compares geometric similarity between different sets of generated splats in different regions of the splat representation and different sets of 3D primitives in corresponding regions of the 3D asset. The system adjusts a set of splats in response to the geometric similarity between the set of splats and a set of 3D primitives in corresponding regions not satisfying a threshold, and reconstructs the 3D asset with an acceptable amount of loss based on the adjustments made to the splats on a region-by-region basis.

Systems and associated methods are provided for distributed three-dimensional ( 3 D) content generation whereby different 3 D assets for a 3 D scene are generated by different asset generators at different network tiers according to the latency sensitivity of each 3 D asset. The system retrieves a 3 D asset for the requested 3 D scene, and differentiates a first 3 D asset that is latency sensitive from a second 3 D asset that is latency tolerant. The system generates the first 3 D asset with a first asset generator at a first network tier, and generates the second 3 D asset with a second asset generator at a more distant second network tier. The system distributes the generated primitives for the first 3 D asset to the user device with a first amount of latency and the generated primitives for the second 3 D asset to the user device with a second amount of latency.

A splat generation system and associated methods perform splatting based on a controlled sampling of a three-dimensional (3D) asset. The controlled sampling ensures minimal coverage the 3D asset primitives and provides enhanced coverage for primitives that have greater detail or variation. The system projects rays in different directions from a set of the primitives towards a bounding volume, and detects points at which some of the projected rays intersect the bounding volume. The system defines virtual cameras in the 3D space of the 3D asset based on a set of the intersection points, and obtains the minimal and/or enhanced coverage based on one or more views of the primitives captured in images taken by the virtual cameras. The system generates a set of splats from the one or more views in the captured images with an acceptable amount of loss and with less total data than the 3D asset.

Disclosed is a graphics system and associated methods for generating and animating three-dimensional (“3D”) assets with a dynamic resolution. The graphics system receives a 3D asset at a first resolution, defines procedural surfaces that recreate the overall shape of the 3D asset, and generates the 3D asset at any desired resolution from the defined procedural surfaces. Specifically, the graphics system partitions the overall shape of the 3D object into simpler shapes, defines equations that recreate the simpler shapes, and generates new points amongst the existing points at positions along surfaces that are created by each of the equations. The graphics system generates the 3D asset at a second resolution that is greater than the first resolution by rendering the new points with the existing points.

Disclosed is a graphics system and associated methodologies for selectively increasing the level-of-detail at specific parts of a mesh model based on a point cloud that provides a higher detailed representation of the same or similar three-dimensional (“3D”) object. The graphics system receives the mesh model and the point cloud of the 3D object. The graphics system determines a region-of-interest of the 3D object based in part on differences amongst points that represent part or all of the region-of-interest. The graphics system reconstructs the region-of-interest in the mesh model and generates a modified mesh model by modifying a first set of meshes representing the region-of-interest in the mesh model to a second set of meshes based on the positional elements of the point cloud points. The second set of meshes has more meshes and represents the region-of-interest at a higher level-of-detail than the first set of meshes.

Disclosed is a system that streams true three-dimensional (“3D”) image data over a data network in a manner that preserves the dimensionality and detail of a dynamic and changing 3D scene. The system generates the 3D image data to represent the 3D scene, and streams different set of the 3D image data that are within different viewing frustums requested by different devices. The system generates updates to the 3D image data based on changes occurring at different parts of the 3D scene. The system streams a first update to the first device in response to image data updated by the first update being within the first device's viewing frustum, and streams a second update to the second device in response to image data updated by the second update being within the second device's viewing frustum.

Disclosed is a graphics system and associated methodologies for selectively increasing the level-of-detail at specific parts of a mesh model based on a point cloud that provides a higher detailed representation of the same or similar three-dimensional (“3D”) object. The graphics system receives the mesh model and the point cloud of the 3D object. The graphics system determines a region-of-interest of the 3D object based in part on differences amongst points that represent part or all of the region-of-interest. The graphics system reconstructs the region-of-interest in the mesh model and generates a modified mesh model by modifying a first set of meshes representing the region-of-interest in the mesh model to a second set of meshes based on the positional elements of the point cloud points. The second set of meshes has more meshes and represents the region-of-interest at a higher level-of-detail than the first set of meshes.

Systems and associated methods are provided for distributed three-dimensional (3D) content generation whereby different 3D assets for a 3D scene are generated by different asset generators at different network tiers according to the latency sensitivity of each 3D asset. The system retrieves a 3D asset for the requested 3D scene, and differentiates a first 3D asset that is latency sensitive from a second 3D asset that is latency tolerant. The system generates the first 3D asset with a first asset generator at a first network tier, and generates the second 3D asset with a second asset generator at a more distant second network tier. The system distributes the generated primitives for the first 3D asset to the user device with a first amount of latency and the generated primitives for the second 3D asset to the user device with a second amount of latency.

A three-dimensional (3D) graphics system automatically defines or accurately adjusts normals for primitives of a 3D model. The system receives the 3D model primitives, selects a particular primitive at a specific position relative to other primitives of the 3D model, and defines a normal with a first direction for the particular primitive based on an association of the normal with the first direction to the specific position. The system then selects a set of primitives with positions next to the particular primitives, and defines a normal for each primitive of the set of primitives with a second direction that is perpendicular to a surface spanned between positions of the particular primitive and each primitive of the set of primitives.

Disclosed is a graphics system and associated methods for generating and animating three-dimensional (“3D”) assets with a dynamic resolution. The graphics system receives a 3D asset at a first resolution, defines procedural surfaces that recreate the overall shape of the 3D asset, and generates the 3D asset at any desired resolution from the defined procedural surfaces. Specifically, the graphics system partitions the overall shape of the 3D object into simpler shapes, defines equations that recreate the simpler shapes, and generates new points amongst the existing points at positions along surfaces that are created by each of the equations. The graphics system generates the 3D asset at a second resolution that is greater than the first resolution by rendering the new points with the existing points.