Quantum Corporation

Methods and systems for key-value shard creation and management in a key-value store ( 319 ). A method includes the steps of partitioning the key-value store ( 319 ) including a plurality of keyspaces ( 364 A, 364 B) into a plurality of shards including a coordinator shard ( 362 ), receiving a first shard assignment value for a first key-value pair from a key-value store client, the key-value store client having access to the key-value store, creating a first shard ( 321 A) using the first shard assignment value, the first shard including a data structure, assigning the first key-value pair to the first shard ( 321 a ) based on the first shard assignment value, updating the coordinator shard ( 362 ) to reference to the first shard ( 321 A), writing the first shard ( 321 A) to a storage device, and storing modifications to the first shard ( 321 A) in a modified version of the first shard ( 321 A) while the first shard ( 321 A) remains unmodified.

A method for implementing an object store using removable storage media includes the steps of receiving a request to retrieve first data; determining a first data object in which at least a portion of the first data is stored; determining a removable storage medium on which the first data object is stored, the removable storage medium including a value store partition into which one or more data objects including at least the first data object are stored and a key store partition into which one or more keys identifying the one or more data objects are stored; retrieving the first data object from the value store partition; and retrieving the at least a portion of the first data from the first data object. The method can further be performed using a data management system and/or one or more non-transitory computer-readable storage media.

A method for utilizing an object storage system ( 470 ) for storing and retrieving a volume of data, the volume of data including a plurality of data objects, the method includes the steps of accumulating the volume of data to an ingest area ( 474 ) provided within a non-taped-based storage medium; copying a first subset of the plurality of data objects to a first tape medium ( 472 A); and copying a second subset of the plurality of data objects to a second tape medium ( 472 B) that is independent of the first tape medium ( 472 A). The method can further include managing the object storage system ( 470 ) with object storage software ( 476 ) to perform one or more of (i) generating a first extent parity that contains redundant information from the first subset of the plurality of data objects using erasure coding; and writing the first extent parity to the first tape medium ( 472 A); (ii) generating a second extent parity that contains redundant information from the second subset of the plurality of data objects using erasure coding; and writing the second extent parity to the second tape medium ( 472 B); and (iii) generating a volume parity that contains redundant information from the volume of data using erasure coding; and writing the volume parity to a third tape medium ( 472 C) that is independent of the first tape medium ( 472 A) and the second tape medium ( 472 B).

Example apparatus and methods control an error correcting code (ECC) approach for data stored on a solid state device (SSD). The control may be based on a property (e.g., reliability, error state, speed) of an SSD, or on an attribute of the data to be stored. Approaches including a hybrid rateless Reed-Solomon ECC approach or a fountain code ECC approach may be selected. Example apparatus and methods may store padded portions of an ECC at different locations in an SSD. Example apparatus and methods may dynamically generate performance test data about the SSD, and dynamically control the ECC approach based on the performance test data. Different types or numbers of ECC may be produced, stored, and provided for different data sets stored at different SSDs or at different physical locations within an SSD. The SSD may be local, or may be part of a cloud-based storage system.

Nonvolatile data storage systems, methods, and devices are disclosed. In one example, a nonvolatile storage device includes a volatile memory, a controller electrically coupled to the volatile memory, a nonvolatile memory electrically coupled to the controller, and a backup power source electrically coupled to the controller, the volatile memory, and the nonvolatile memory. The controller is configured to read and write primary data from a primary host and mirrored data from a secondary host in the volatile memory. The backup power source is configured to store sufficient energy to power the nonvolatile storage device during a backup operation. The controller is configured to, in response to a backup signal, copy the primary data and the mirrored data stored in the volatile memory to the nonvolatile memory.

Embodiments disclosed herein provide systems, methods, and computer-readable media to implement an object store with removable storage media. In a particular embodiment, a method provides identifying first data for storage on a first removable storage medium and designating at least a portion of the first data to a first data object. The method further provides determining a first location where to store the first data object in a first value store partition of the first removable storage medium and writing the first data object to the first location. Also, the method provides writing a first key that identifies the first data object and indicates the first location to a first key store partition of the first removable storage medium.

A method for utilizing an object storage system ( 470 ) for storing and retrieving a volume of data, the volume of data including a plurality of data objects, the method includes the steps of accumulating the volume of data to an ingest area ( 474 ) provided within a non-taped-based storage medium; copying a first subset of the plurality of data objects to a first tape medium ( 472 A); and copying a second subset of the plurality of data objects to a second tape medium ( 472 B) that is independent of the first tape medium ( 472 A). The method can further include managing the object storage system ( 470 ) with object storage software ( 476 ) to perform one or more of (i) generating a first extent parity that contains redundant information from the first subset of the plurality of data objects using erasure coding; and writing the first extent parity to the first tape medium ( 472 A); (ii) generating a second extent parity that contains redundant information from the second subset of the plurality of data objects using erasure coding; and writing the second extent parity to the second tape medium ( 472 B); and (iii) generating a volume parity that contains redundant information from the volume of data using erasure coding; and writing the volume parity to a third tape medium ( 472 C) that is independent of the first tape medium ( 472 A) and the second tape medium ( 472 B).

A method for ensuring data quality integrity on a magnetic tape includes the steps of writing object data to the magnetic tape; dividing the object data into a plurality of data chunks; generating a hash tree from the plurality of data chunks, the hash tree being formed in a plurality of levels, the hash tree including (i) a plurality of chunk hashes wherein a separate chunk hash is generated for each of the plurality of data chunks, and (ii) at least one second level hash that is generated from concatenation of at least two of the plurality of chunk hashes; and checking integrity of a first data chunk of the plurality of data chunks by evaluating at least one of the plurality of chunk hashes and the at least one second level hash.

A data storage system includes a first storage layer, a second storage layer, an I/O manager, and a data organizer. The first storage layer utilizes a first type of data storage device. The first storage layer includes (i) a first data bucket that includes first data having a first data attribute, the first data bucket including a first data limit, and (ii) a second data bucket. The second storage layer utilizes a second type of data storage device. The I/O manager receives a data write request from the user and directs the data write request to the first storage layer. The data organizer (a) determines whether data in the data write request has the first data attribute; and (b) stores the data in the data write request in at least one of the first data bucket and the second data bucket if the data in the data write request has the first data attribute. When a volume of data in the first data bucket reaches the first data limit, the data organizer moves the volume of data in the first data bucket from the first storage layer to the second storage layer.

The technology described herein enables data storage across storage volumes having fewer features than the storage volumes otherwise would. In one example, a method includes, in a data access system, identifying first data for storage on physical storage volumes. Each of the physical storage volumes corresponds to respective ones of data channels and control channels. The method further includes segmenting the first data into data segments corresponding to respective ones of the data channels and transferring the data segments as respective bit streams over the respective ones of the data channels to the respective ones of the physical storage volumes. The method also includes providing real-time write control to the physical storage volumes over respective ones of the control channels. The real-time write control directs a process for how the physical storage volumes write the data segments.