Non-contact heartbeats and respiration monitoring
- 0 Collaborators
Non-contact heartbeats and respiration monitoring using artificial light texture technology. ...learn more
Project status: Under Development
Intel Technologies
Other
Overview / Usage
The artificial light texture (ALT) technology is the non-contact video-based heartbeats, respiration, and movements monitoring technology which
• detects vital signs for any pose of a person and when no area of skin is exposed,
• leverages the availability of the low-cost mass-market consumer hardware required for its implementation,
• can turn any consumer structured light -based depth-sensing camera into a non-contact vital signs and sleep monitor; note that the ALT technology does not rely on the depth data to obtain the vital signs information!
The ALT technology currently works with Intel RealSense R200, F200, SR300, and D415 cameras; Microsoft Kinect for Xbox 360; Occipital Structure Sensor.
Methodology / Approach
An ALT system consists of 3 main elements:
• a light source which projects a pattern of light onto the body of a person; the light emitter of any consumer structured light -based depth-sensing camera can be used as such a light source; the patterns the light source projects can be either visible or invisible to a human eye, depending on the needs of a particular application,
• a small video camera which observes the person (e.g. a $22.5 Raspberry Pi NoIR one, or an infrared (IR) camera of the structured light -based depth-sensing camera), and
• a small computer (e.g. a $35 Raspberry Pi single-board one) which runs ALT algorithms to obtain the vital signs information for the person.
The figure below shows ALT data obtained using the light emitter and IR video stream of an Intel RealSense R200 camera. An image of the scene taken from the R200 IR video stream is shown on the left. A person is sitting in an armchair at about 3 feet distance from the R200 camera. The raw ALT data are shown in the figure by the black lines connecting the data points (black dots). The orange and blue lines are the moving averages of the raw data shown to highlight the heartbeat and respiration processes captured in the ALT data, respectively.
The video below demonstrates real-time non-contact heartbeats and respiration monitoring using an ALT system consisting of an Intel RealSense D415 camera and a Microsoft Surface tablet/laptop. The plot shows raw real-time ALT data. The heartbeats signal amplitude during the inhale/exhale is smaller compared to that in between the respiration cycles. Respiration modulates the heartbeats signal amplitude.
Technologies Used
Intel RealSense