Illuscio, Inc.

A scene generation system provide graphics enhanced content placement in the quality or fidelity of promoted visual assets in a scene are adjusted relative to other or non-promoted visual assets in the same scene. The different quality or fidelity at which the promoted visual assets are presented draw viewer focus to the promoted visual assets without prominently positioning the promoted visual assets in the scene or otherwise altering the creative intent for the scene. The system receives a request to promote a particular visual asset in a scene, determines a first level-of-detail (LoD) at which to render the visual assets of the scene, selects a second LoD that is greater than the first LoD for the particular visual asset, and presents the scene by rendering the non-promoted visual assets at the first LoD and the particular visual asset at the second LoD.

A three-dimensional (3D) content creation system modifies operation of a radiance field, neural network, and/or other generative artificial intelligence in order to generate 3D content based on constraints that modify the 3D content modeling. The system receives constraints for reducing a first size of a first 3D representation of a 3D object, and generates different sets of 3D primitives with values for one or more parameters of the 3D primitives that satisfy the constraints. The system selects a particular set of 3D primitives that produces a visual representation that differs from the first 3D representation by less than a threshold amount, and presents the particular set of 3D primitives as a size-optimized second 3D representation of the 3D object with a second size that is less than the first size of the first 3D representation.

A splat generation system and associated methods implement a modified splatting pipeline that quantifies loss at each splat generation iteration without rendering the splats generated at each iteration or comparing the resulting visualization against reference images of a 3D asset. The system receives the 3D asset and generates a splat representation of the 3D asset. The system compares geometric similarity between different sets of generated splats in different regions of the splat representation and different sets of 3D primitives in corresponding regions of the 3D asset. The system adjusts a set of splats in response to the geometric similarity between the set of splats and a set of 3D primitives in corresponding regions not satisfying a threshold, and reconstructs the 3D asset with an acceptable amount of loss based on the adjustments made to the splats on a region-by-region basis.

Disclosed is a system and associated methods for color correcting three-dimensional (“3D”) objects by leveraging the 3D positional data associated with point cloud data points that form the 3D objects and by adjusting the defined or inherited color values of the data points to account for multiple factors that are derived from the data point 3D positions. The system determines a color variance between the color values of the first set of points and the color values of the second set of points, determines a variance factor based on the positional elements of the second set of points that contributes to the color variance between the points, and adjusts the color variance to a modified color variance based on the variance factor. The system then modifies or color corrects the color values of the second set of points based on the modified color variance.

A three-dimensional (3D) animation system and associated methods generate a musculoskeletal framework for a 3D model, automatically rig virtual muscles and virtual bones of the musculoskeletal framework to the 3D model, and realistically animate the 3D model based on real musculoskeletal movements associated with the virtual muscles and the virtual bones. The 3D animation system receives multiple scans of a subject, generates primitives that form a 3D model of the subject based on a first scan, and rig the 3D model for animation with the virtual muscles and virtual bones of the musculoskeletal framework that are defined from data of other scans. The 3D animation system animates the 3D model by determining an association between a virtual muscle and a set of primitives created from the rigging, and by adjusting the set of primitives according to a movement created from a simulated contraction of the virtual muscle.

A splat generation system and associated methods implement splatting with adaptive density control to generate a splat representation of a three-dimensional (3D) model in which the splat density and quality in regions of the 3D model that are prioritized based on creator intent or that are commonly or consistently in a user’s field-of-view are increased relative to the splat density and quality in other regions of the 3D model. The system receives the different priorities associated with different parts of the 3D model based on the creator intent or tracked view paths. The system generates a first set of splats that represent the 3D model with a first fidelity, and generates a second set of splats at a greater second fidelity for a first subset of parts of the 3D model that have a higher priority than a second subset of parts of the 3D model.

Systems and associated methods are provided for distributed three-dimensional ( 3 D) content generation whereby different 3 D assets for a 3 D scene are generated by different asset generators at different network tiers according to the latency sensitivity of each 3 D asset. The system retrieves a 3 D asset for the requested 3 D scene, and differentiates a first 3 D asset that is latency sensitive from a second 3 D asset that is latency tolerant. The system generates the first 3 D asset with a first asset generator at a first network tier, and generates the second 3 D asset with a second asset generator at a more distant second network tier. The system distributes the generated primitives for the first 3 D asset to the user device with a first amount of latency and the generated primitives for the second 3 D asset to the user device with a second amount of latency.

A distribution system adaptively provides different lossy encodings for different views of a point cloud to a client device based on network or rendering performance of the client device. The distribution system receives a request to access the point cloud, and determines the one or more performance parameters that limit an amount of the point cloud data that the client device is able to receive or process in a given time. The distribution system selects and provides the client device with different sets of optimized splats for different views of the point cloud that satisfy the one or more performance parameters based on a cumulative amount of data encoded within the different sets of optimized splats being equal to or less than the amount of point cloud data that the client device is able to receive or process in the given time.

An optimization system reduces the data encoded within a point cloud for streaming and/or rendering of a lossy representation of the point cloud. The optimization system generates a first optimized splat for a first visual characteristic of the point cloud by replacing a first set of points having a first common value for the first visual characteristic with a first replacement primitive, and generates a second optimized splat for a second visual characteristic of the point cloud by replacing a second set of points having a second common value for the second visual characteristic with a second replacement primitive. The optimization system provides the first optimized splat and the second optimized splat instead of the original points of the point cloud in response to a request to access the point cloud.

A three-dimensional (3D) animation system and associated methods generate a musculoskeletal framework for a 3D model, automatically rig virtual muscles and virtual bones of the musculoskeletal framework to the 3D model, and realistically animate the 3D model based on real musculoskeletal movements associated with the virtual muscles and the virtual bones. The 3D animation system receives multiple scans of a subject, generates primitives that form a 3D model of the subject based on a first scan, and rig the 3D model for animation with the virtual muscles and virtual bones of the musculoskeletal framework that are defined from data of other scans. The 3D animation system animates the 3D model by determining an association between a virtual muscle and a set of primitives created from the rigging, and by adjusting the set of primitives according to a movement created from a simulated contraction of the virtual muscle.