Oct 28, 2025

US12455140 - System and method for video image registration and/or providing supplemental data in a heads up display

Video sources and inertial sensors are attached to a weapon and to goggles. A computer receives video images from the weapon- and goggles-mounted sources and inertial data from the sensors. The computer calculates a location for an image from the weapon-mounted source within an image from the goggles-mounted source using the inertial sensor data. The sensor-based location is checked (and possibly adjusted) based on a comparison of the images. A database contains information about real-world objects in a field of view of the goggles-mounted source, and is used to generate icons or other graphics concerning such objects.

Assignee: Science Applications International Corporation
Inventors: John Richard Scales, Michael Harris Rodgers, Mark D. Hose
Filing date: 2024-03-21

This patent describes a system that integrates video sources and inertial sensors on a weapon and goggles to enhance situational awareness through a heads-up display. It outlines a method for aligning and adjusting images from these sources based on sensor data, allowing for the generation of modified images that include relevant real-world object information.

Claim 1

A method comprising: selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source; determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between: a position, in the first image for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and a position, in the first image for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image; determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source; and generating a modified version of the third image comprising the portion of the fourth image in the determined position. selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source; determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between: a position, in the first image for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and a position, in the first image for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image; a position, in the first image for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and a position, in the first image for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image; determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source; and generating a modified version of the third image comprising the portion of the fourth image in the determined position.

Google Patents

https://patents.google.com/patent/US12455140

USPTO PDF

https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/12455140