Ocient Holdings LLC

A record processing and storage system is operable to generate data source assignment data by segregating a plurality of data sources into a plurality of data source sets mapped to a corresponding plurality of storage clusters of the record processing and storage system. For each of the plurality of storage clusters, a corresponding subset of a plurality of pages is generated to include only ones of a plurality of records received from data sources included in a corresponding one of the plurality of data source sets, and the corresponding subset of the plurality of pages via storage resources of the each of the plurality of storage clusters. For each of the plurality of storage clusters, deduplication of each page included in the corresponding subset of the plurality of pages is facilitated based on metadata comparisons with other pages included in the corresponding subset of the plurality of pages.

A method executable by a processing module of a database system includes identifying a query that includes a geospatial buffer expression for a geospatial object, obtaining the geospatial object based on the geospatial buffer expression, executing a geospatial object simplification function on the geospatial object to produce a simplified geospatial object, executing an offset curve function on the simplified geospatial object to produce one or more offset curves, executing an offset curve segment loop elimination function on the one or more offset curves to produce one or more simplified offset curves, and executing a depth analysis function on the one or more simplified offset curves to produce a geospatial object buffer geography of the geospatial object, wherein the depth analysis function identifies and eliminates portions of the simplified offset curves that are located inside the geospatial object buffer geography.

A set of processing core resources of a database system is operable to receive a query regarding a dataset. The query includes query operations organized in a tree structure. A section of the tree includes a set of branches having a common connection point. The set is operable to, for the section, set a first execution indicator to a pause mode value. The set is operable to set a second execution indicator to an execution mode value. The set is operable to execute the second set of query operations to produce a second partial query resultant. The set is operable to, when the second branch is substantially completes, send an end of file signal to the third set of query operations. The set is operable to, in response to the end of file signal, change the first execution indicator to the execution mode value and execute the first set of query operations to produce a first partial query resultant.

A database system is operable to generate an initial query operator execution that includes an IO operator for execution serially before an aggregation operator indicating performance of an aggregation. The initial query operator execution flow is converted into an updated query operator execution flow semantically equivalent to the initial query operator execution flow based on updating the IO operator to include the performance of the aggregation and adding a re-aggregation operator serially after the IO operator. A corresponding query is executed by applying the updated query operator execution flow based on executing, via each of a plurality of parallelized resources, the IO operator generate corresponding sub-aggregation output via performance of the aggregation, and executing the re-aggregation operator upon data blocks generated based on execution of the IO operator across the plurality of parallelized resources.

A computing device cluster of a database system generates a query operations for a query regarding data of a dataset. The query operations include a first set of query operations that cause hierarchical computing nodes to execute, in a wide parallelism mode, a first operation to produce a plurality of first outputs. Then, execute, in a narrow parallelism mode, another operation to produce a first output result. The query instructions further include a scatter operation that causes a computing node to divide the first output result into first output scattered data. The query instructions further includes a second set of query operations that cause the hierarchical computing nodes to receive, in the wide parallelism mode, the first scattered data. Then, execute, in the wide parallelism mode, a first operation of the second set to produce second outputs. Then, execute, in the narrow parallelism mode, another operation of the second set to produce a second output result.

A database system is operable to generating a plurality of pages from a plurality of rows, where each page of the plurality of pages is generated to include a corresponding set of rows of the plurality of rows in accordance with a columnar-formatted structuring based on generating a plurality of columns from the corresponding set of rows. A query is executed based on reading a first set of column values for a first plurality of rows based on applying a columnar-formatted structuring-based read process and reading a second set of column values for a second plurality of rows based on applying the columnar-formatted structuring-based read process. At least one page conversion process is performed to generate an additional plurality of segments based on reading all column values for the plurality of rows based on applying the columnar-formatted structuring-based read process.

A database system is operable to generating a plurality of pages from a plurality of rows, where each page of the plurality of pages is generated to include a corresponding set of rows of the plurality of rows in accordance with a columnar-formatted structuring based on generating a plurality of columns from the corresponding set of rows. A query is executed based on reading a first set of column values for a first plurality of rows based on applying a columnar-formatted structuring-based read process and reading a second set of column values for a second plurality of rows based on applying the columnar-formatted structuring-based read process. At least one page conversion process is performed to generate an additional plurality of segments based on reading all column values for the plurality of rows based on applying the columnar-formatted structuring-based read process.

A store and compute sub-system of a database system includes pluralities of computing nodes of a plurality of computing devices of a computing device cluster are operable to obtain a plurality of input/output expressions of a query regarding a dataset, wherein the query includes a plurality of expressions. The pluralities of computing nodes are further operable to, schedule, at an initial row retrieval rate, retrieval of a first set of LTS segments of the plurality of LTS segments from memory as at least some of operand data for a first set of IO expressions and reduce, by the first plurality of computing nodes, the initial row retrieval rate for scheduling retrieval of another LTS segment when the first plurality of computing nodes determines it is executing one or more IO expressions of the plurality of IO expressions on one or more previously retrieved segments at an unfavorable rate.

A parallelized data input sub-system of a database system includes pluralities of processing core resources of pluralities of loader nodes of pluralities of computing devices of a plurality of computing device clusters. A first set of loader nodes of the pluralities of loader nodes is operable to ingest a plurality of datasets, determine a first set of processing core resources of the pluralities of processing core resources for ingesting the first dataset, determine a second set of processing core resources of the pluralities of processing core resources for ingesting the second dataset, direct, via first routing data, the first dataset to the first set of processing core resources, for temporary storage as a first set of pages, and direct, via second routing data, the second dataset to the second set of processing core resources for temporary storage as a second set of pages.

A query and response sub-system of a database system, wherein a set of computing nodes of a set of computing devices of a set of computing device clusters is operable to: identify a memory intensive operation of a query regarding data of a dataset. The query and response sub-system is further operable to, when the memory intensive operation is a reorder operation, modify the reorder operation to enable reorder of a set of columnar data of the plurality of columnar data, wherein the modified reorder operation includes: an instruction to create new metadata regarding the sub-set of the packed column streams based on underlying memory layout of storage of the sub-set of the packed column streams.