data.world, Inc.

Various embodiments relate generally to data science and data analysis, computer software and systems, and wired and wireless network communications to provide an interface between repositories of disparate datasets and computing machine-based entities that seek access to the datasets, and, more specifically, to a computing and data storage platform that facilitates consolidation of one or more datasets, whereby a collaborative data layer and associated logic facilitate, for example, efficient access to, and implementation of, collaborative datasets. In some examples, a system may include an atomized workflow loader configured to receive an atomized dataset to load into a data store, and to determine resource requirements data to describe at least one resource requirement. The atomized workflow loader may be further configured to select a data store type based on a resource requirement, and perform a load operation of the atomized dataset as a function of the data store type.

Various techniques are described, including evaluating ingested data including a dataset to identify one or more links to other datasets stored in a graph, using a similarity determination algorithm to identify a degree of similarity between datasets to determine joinability of ingested datasets with graph-stored datasets, determining a ratio to determine whether to perform an overlap or coverage function, associating a subset of similarity matrices with a subset of graph data joined to the ingested dataset, and forming links in a column of data between the dataset and the another dataset of the ingested data based on the degree of similarity.

Various embodiments relate generally to data science and data analysis, computer software and systems, based on graph-based data arrangements, among other things, and, more specifically, to a computing platform configured to generate configurable automation templates and automation executable programs that automate workflows based on process models to effectuate automated data governance of datasets, including graph-based data stored in one or more graphs, such as a knowledge graph, a data catalog, etc., whereby in at least one example, automated workflows can provide automatic enrichment of datasets, such as multi-layered knowledge graph data that may include data catalog data. In some examples, a method may include receiving data representing activation of an automated workflow template configured to perform a process workflow, receiving configuration data, linking an automated workflow template to executable instructions, and retrieving data representing a type of process flow, which may data including enriched graph data to modify graph data.

Various embodiments relate generally to data science and data analysis, computer software and systems, and network communications to interface among repositories of disparate datasets and computing machine-based entities configured to access datasets, and, more specifically, to a computing and data storage platform configured to provide one or more computerized tools to deploy predictive data models based on in-situ auxiliary query commands implemented in a query, and configured to facilitate development and management of data projects by providing an interactive, project-centric workspace interface coupled to collaborative computing devices and user accounts. For example, a method may include activating a query engine, implementing a subset of auxiliary instructions, at least one auxiliary instruction being configured to access model data, receiving a query that causes the query engine to access the model data, receiving serialized model data, performing a function associated with the serialized model data, and generating resultant data.

Various embodiments relate generally to data science and data analysis, computer software and systems, and wired and wireless network communications to provide an interface between repositories of disparate datasets and computing machine-based entities that seek access to the datasets, and, more specifically, to a computing and data storage platform that facilitates consolidation of one or more datasets, whereby a collaborative data layer and associated logic facilitate, for example, efficient access to, and implementation of, collaborative datasets. In some examples, a system may include data ingestion controller configured to format datasets to form a first and a second atomized dataset, the second atomized dataset including the first atomized dataset and one or more other atomized datasets. The system may include a dataset query engine configured to identify a portion of a dataset relevant to a query, and to retrieve query results from at least one of different data repositories.

Various embodiments relate generally to data science and data analysis, computer software and systems, and wired and wireless network communications to interface among repositories of disparate datasets and computing machine-based entities configured to access datasets, and, more specifically, to a computing and data storage platform to implement computerized tools to identify data classifications and similar subsets of graph-based data arrangements with which to join, according to at least some examples. For example, a method may include determining a classification type for a subset of data based on a graph data arrangement, generating presentation data as a first user input to detect selection of the first user input. The method may include predicting a classification type for data. The method may also include generating other presentation data configured to join datasets, such as a column of tabular-formatted data with one or more portions of a graph data arrangement.

Various embodiments relate generally to data science and data analysis, computer software and systems, and wired and wireless network communications to interface among repositories of disparate datasets and computing machine-based entities configured to access datasets, and, more specifically, to a computing and data storage platform to implement computerized tools to facilitate expedited queries based on query results generated by disparate computing and database architectures, according to at least some examples. For example, a method may include generating multiple results of queries, storing the multiple results of queries in a memory, and linking each of the multiple results of queries to a portion of data stored in a graph. The method can include receiving data representing a query and accessing data representing quiescent data values to form a query result.

Various embodiments relate generally to data science and data analysis, computer software and systems, and wired and wireless network communications to provide an interface between repositories of disparate datasets and computing machine-based entities that seek access to the datasets, and, more specifically, to a computing and data storage platform that facilitates consolidation of one or more datasets, whereby a collaborative data layer and associated logic facilitate, for example, efficient access to, and implementation of, collaborative datasets. In some examples, a system may include an atomized workflow loader configured to receive an atomized dataset to load into a data store, and to determine resource requirements data to describe at least one resource requirement. The atomized workflow loader may be further configured to select a data store type based on a resource requirement, and perform a load operation of the atomized dataset as a function of the data store type.

Various embodiments relate generally to data science and data analysis, computer software and systems, and data-driven control systems and algorithms based on graph-based data arrangements, and, more specifically, to a computing platform configured to receive and analyze datasets to implement a data model with which to identify relevant data catalog data derived from graph-based data arrangements, whereby a processor may be configured to cause implementation of subsets of programmatic executable instructions based on relevant data catalog data, at least one example of which generates a concept interface portion adapted to an associated concept, among other things. In some examples, a method may include identifying attributes associated with data values linked to a conceptual entity, determining criteria data of a targeted application, selecting programmatic executable instructions based on the criteria data, and extracting data from a graph data arrangement as a function of the attributes, among other things.

Various techniques are described for platform management of integrated access of public and privately-accessible datasets utilizing federated query generation and query schema rewriting optimization, including receiving at a dataset access platform a query formatted according to a first data schema, generating a copy of the query, saving the query and the copy to a datastore, parsing the copy of the query in the first schema using an inference engine, determining whether the query comprises data associated with an access control condition associated with accessing the dataset, the access control condition being configured to indicate whether the query is permitted to access the dataset, and rewriting, using a proxy server, the copy of the query in a second schema, and optimizing the rewriting by identifying a database engine to execute the query and including other data converted into another triple associated with an attribute of the query.