AUGMEDICS LTD.

A computer-implemented method, consisting of acquiring a first image of reflective elements of an identifying marker positioned in proximity to a region of interest of a subject and calculating a first position of the identifying marker in response to the first image. The method continues with acquiring, subsequent to acquiring the first image, a second image of the reflective elements and calculating a second position of the identifying marker in response to the second image. Subsequent to acquiring the second image, the method continues with acquiring further images of the reflective elements and calculating respective further positions of the identifying marker in response to the further images. The further positions are filtered in response to a difference between the second position and the first position. In response to the filtered further positions, an image of an entity associated with the identifying marker is presented on a display.

A system for image-guided surgery, the system comprising: a head-mounted unit comprising: a see-through augmented reality display; a depth sensor configured to generate depth data with respect to a region of interest (ROI) on a body of a patient viewed through the display by a user wearing the head-mounted unit and with respect to a surgical item when the item is placed within a field of view of the depth sensor, wherein the item comprises a first marker containing a predefined pattern disposed on the item; and a processor configured to: process the depth data to identify a shape of the item; compute, a first spatial transformation between a position of the first marker and a location and orientation of the item; track the position of the first marker as the user manipulates item; and generate an image of the item on the display in registration with the ROI.

A head-mounted display system includes a frame; an adjustable strap assembly that includes a first side strap coupled to the frame; a second side strap coupled to the frame; and an adjustment mechanism configured to adjust a circumferential size defined by the first side strap, the second side strap, and the frame; a see-through display assembly pivotably coupled to the frame; a first temple housing pivotably coupled to the frame and slidably coupled to the first side strap; and a second temple housing pivotably coupled to the frame and slidably coupled to the second side strap.

A display device comprising: a see-through display assembly comprising an at least partially transparent display configured to display to a user an augmented reality (AR) image comprising a virtual reality (VR) image presented over a scene of a patient; and a pantoscopic tilting assembly configured to pivotably adjust a pantoscopic tilt angle of the see-through display assembly.

Disclosed herein are systems, devices, and methods for image-guided surgery. Some systems include a head-mounted unit, having a see-through augmented-reality display and a depth sensor, which is configured to generate depth data with respect to a region of interest (ROI) of a body of a patient that is viewed through the display by a user wearing the head-mounted unit. A processor, which is configured to receive a three-dimensional (3D) tomographic image of the body of the patient, computes a depth map of the ROI based on the depth data generated by the depth sensor, to compute a transformation over the ROI so as to register the tomographic image with the depth map, and to apply the transformation in presenting a part of the tomographic image on the display in registration with the ROI viewed through the display.

An imaging system, including a head-mounted display worn by a system operator. A marker defines a plane when attached to a human subject. Optically reflective elements are disposed on the marker and on opposing sides of the plane in a non-symmetrical arrangement with respect to the plane. A memory stores a graphical representation of a tool used in a procedure performed on the human subject, and an image of anatomy of the human subject. A camera attached to the display acquires an image of the marker and the tool. A processor analyzes the image to identify the plane and to identify a side of the plane wherein the camera is located, and to render to the display the image of the anatomy of the human subject with the graphical representation of the tool superimposed thereon from a point of view in the identified side of the plane.

Apparatus and methods are described including tracking a tool portion and a patient marker from a first line of sight, using a first tracking device disposed upon a first head-mounted device that includes a display. The tool portion and the patient marker are tracked from a second line of sight, using a second tracking device. When a portion of the patient marker and the tool portion are both within the first line of sight, an augmented reality image is generated upon the first display based upon data received from the first tracking device and without using data from the second tracking device. When at least the patient marker portion and the tool portion are not both within the first line of sight, a virtual image of the tool and anatomy of the patient is generated using data received from the second tracking device. Other applications are also described.

Apparatus, including a retaining structure ( 54 ), positioned near a subject's eye that has a pupil with a diameter, an optical combiner ( 52 A) mounted on the structure before the eye, and a pixelated screen ( 60 A) having an array of variably transparent pixels coating the combiner. There is an image capturing device ( 68 A) mounted on the structure to capture an image of a scene viewed by the eye, and a projector ( 64 A) is mounted on the structure to project at least one of a portion of the captured image and a stored image onto a section of the screen at a selected location thereof. A processor ( 26 ) renders the screen section at least partially opaque, selects the section location in response to a region of interest in the scene identified by analysis of the captured image, and determines a dimension of the section in response to the pupil diameter.

Apparatus, including a retaining structure ( 54 ), positioned near a subject's eye that has a pupil with a diameter, an optical combiner ( 52 A) mounted on the structure before the eye, and a pixelated screen ( 60 A) having an array of variably transparent pixels coating the combiner. There is an image capturing device ( 68 A) mounted on the structure to capture an image of a scene viewed by the eye, and a projector ( 64 A) is mounted on the structure to project at least one of a portion of the captured image and a stored image onto a section of the screen at a selected location thereof. A processor ( 26 ) renders the screen section at least partially opaque, selects the section location in response to a region of interest in the scene identified by analysis of the captured image, and determines a dimension of the section in response to the pupil diameter.

Apparatus and methods are described including tracking a tool portion and a patient marker from a first line of sight, using a first tracking device disposed upon a first head-mounted device that includes a display. The tool portion and the patient marker are tracked from a second line of sight, using a second tracking device. When a portion of the patient marker and the tool portion are both within the first line of sight, an augmented reality image is generated upon the first display based upon data received from the first tracking device and without using data from the second tracking device. When at least the patient marker portion and the tool portion are not both within the first line of sight, a virtual image of the tool and anatomy of the patient is generated using data 10 received from the second tracking device. Other applications are also described.