Q (Cue) Ltd.

Systems, methods, and non-transitory computer readable media including instructions for providing private answers to silent questions are described. Providing private answers to silent questions includes receiving signals indicative of particular facial micromovements in an absence of perceptible vocalization; accessing a data structure correlating facial micromovements with words; using the received signals to perform a lookup in the data structure of particular words associated with the particular facial micromovements; determining a query from the particular words; accessing at least one data structure to perform a look up for an answer to the query; and generating a discreet output that includes the answer to the query.

Systems, methods, and computer program products are disclosed for selectively employing a processing mode based on a continuous gesture. Selectively employing a processing mode may include detecting an existence of a mode-selection gesture by an individual. Upon detecting the existence of the mode-selection gesture, a first mode for processing facial micromovements of the individual may be continuously implemented while continuously detecting the mode-selection gesture. Following the continuous detection of the mode-selection gesture, a cessation of the mode-selection gesture may be detected. In response, implementation of the first mode may cease, and implementation of a second mode different from the first mode may be initiated for processing facial micromovements of the individual.

A method for generating speech includes uploading a reference set of features that were extracted from sensed movements of one or more target regions of skin on faces of one or more reference human subjects in response to words articulated by the subjects and without contacting the one or more target regions. A test set of features is extracted a from the sensed movements of at least one of the target regions of skin on a face of a test subject in response to words articulated silently by the test subject and without contacting the one or more target regions. The extracted test set of features is compared to the reference set of features, and, based on the comparison, a speech output is generated, that includes the articulated words of the test subject.

Systems, methods, and computer program products are disclosed for establishing nonvocalized communications. Establishing nonvocalized communications may include detecting a directional gesture made by a wearer of a first wearable device configured to determine facial skin micromovements of the wearer, wherein the directional gesture identifies a second device in proximity to the first wearable device. Based on the directional gesture, a wireless communication channel for enabling a nonvocalized communication between the first wearable device and the second device is selected. Thereafter, specific facial skin micromovements of the wearer of the first wearable device are determined. The specific facial skin micromovements indicate words to be communicated in an absence of perceptible vocalization by the wearer of the first wearable device. Then, the words are transmitted via the wireless communication channel from the first wearable device to the second device for presentation via the second device.

Systems and methods are disclosed for determining an intent to speak based on minute facial skin movements. In one implementation, a system may include a processor configured to control at least one coherent light source to illuminate a region of a face. The processor may receive from at least one sensor, reflection signals indicative of coherent light reflected from the face. The reflection signals may be analyzed to determine minute facial skin movements associated with silent speech. Then, based on the determined minute facial skin movements associated with the silent speech, the processor may determine a speech intent, and initiate, prior to an audible utterance of the silent speech, an action based on the determined speech intent.

Systems, methods, and computer program products are disclosed for generating a common record based on differing source inputs. Generating a common record based on differing source inputs may include receiving via at least one sensor first non-audible signals indicative of verbalization of an individual; interpreting first words of the individual at least in part using the first non-audible signals received from the at least one sensor; receiving second signals generated by a source other than the individual; performing speech recognition on the second signals to interpret second words from the source; and using the first words and the second words to generate a record.

A system for generating audio feedback to silent speech, the system including a speaker and processing circuitry, the processing circuitry configured to (i) generate speech output including the articulated words of a test subject from sensed movements of skin of a face of the test subject in response to words articulated silently by the test subject and without contacting the skin, (ii) convert the speech output into an audio output, (iii) convey the audio output to the speaker as audio feedback while reducing latency, and (iv) play the audio feedback with reduced latency to the test subject on the speaker.

A sensing device ( 20, 60 ) includes a bracket ( 22 ) configured to fit an ear of a user ( 24 ) of the device. An optical sensing head ( 28 ) is held by the bracket in a location in proximity to a face of the user and senses light reflected from the face and to output a signal in response to the detected light. Processing circuitry ( 70, 75 ) processes the signal to generate a speech output.

Systems, methods, and non-transitory computer-readable media including instructions for detecting and utilizing facial skin micromovements are disclosed. In some non-limiting embodiments, the detection of the facial skin micromovements occurs using a speech detection system that may include a wearable housing, a light source (either a coherent light source or a non-coherent light source), a light detector, and at least one processor. One or more processors may be configured to analyze light reflections received from a facial region to determine the facial skin micromovements, and extract meaning from the determined facial skin micromovements. Examples of meaning that may be extracted from the determined facial skin micromovements may include words spoken by the individual (either silently spoken or vocally spoken), an identification of the individual, an emotional state of the individual, a heart rate of the individual, a respiration rate of the individual, or any other biometric, emotion, or speech-related indicator.

Systems, methods, and non-transitory computer-readable media including instructions for detecting and utilizing facial skin micromovements are disclosed. In some non-limiting embodiments, the detection of the facial skin micromovements occurs using a speech detection system that may include a wearable housing, a light source (either a coherent light source or a non-coherent light source), a light detector, and at least one processor. One or more processors may be configured to analyze light reflections received from a facial region to determine the facial skin micromovements, and extract meaning from the determined facial skin micromovements. Examples of meaning that may be extracted from the determined facial skin micromovements may include words spoken by the individual (either silently spoken or vocally spoken), an identification of the individual, an emotional state of the individual, a heart rate of the individual, a respiration rate of the individual, or any other biometric, emotion, or speech-related indicator.