Skip to main content

Neonatal non-contact respiratory monitoring based on real-time infrared thermography

Abstract

Background

Monitoring of vital parameters is an important topic in neonatal daily care. Progress in computational intelligence and medical sensors has facilitated the development of smart bedside monitors that can integrate multiple parameters into a single monitoring system. This paper describes non-contact monitoring of neonatal vital signals based on infrared thermography as a new biomedical engineering application. One signal of clinical interest is the spontaneous respiration rate of the neonate. It will be shown that the respiration rate of neonates can be monitored based on analysis of the anterior naris (nostrils) temperature profile associated with the inspiration and expiration phases successively.

Objective

The aim of this study is to develop and investigate a new non-contact respiration monitoring modality for neonatal intensive care unit (NICU) using infrared thermography imaging. This development includes subsequent image processing (region of interest (ROI) detection) and optimization. Moreover, it includes further optimization of this non-contact respiration monitoring to be considered as physiological measurement inside NICU wards.

Results

Continuous wavelet transformation based on Debauches wavelet function was applied to detect the breathing signal within an image stream. Respiration was successfully monitored based on a 0.3°C to 0.5°C temperature difference between the inspiration and expiration phases.

Conclusions

Although this method has been applied to adults before, this is the first time it was used in a newborn infant population inside the neonatal intensive care unit (NICU). The promising results suggest to include this technology into advanced NICU monitors.

Introduction

Basically, vital signals are physical quantities measured from the body and can be used to determine the physiological status and functioning. Examples of these signals include heart rate, breathing rate, body temperature and blood pressure. The normal range of vital signs varies with age, sex, weight, exercise tolerance and body conditions [1, 2]. Nasal inspiration, the way neonates acquire air and hence oxygen, is important for maintaining the internal milieu of the lung, since ambient air is conditioned to nearly alveolar conditions (i.e. body temperature and fully saturated with water vapor) upon reaching the nasopharynx cavity. Essentially, respiration measurement can be performed by using nasal thermocouples, respiratory-effort belt transducer, piezoelectric transducer, optical sensor (pulse oximetry) and electrocardiography ECG. However, all these techniques are inconvenient to take in at home and they may bring discomfort and soreness to the patient [24]. Apnoea (abrupt stopping of respiration) and bradycardia (rapid decrease of heart rate) are common and serious problems in premature infants. One of the methods to quantify respiratory rate in these infants is to use a thermistor that is fixed above the upper lip directly in front of the nares. This by itself can induce apnoeas because of upper respiratory airway obstruction. Therefore, one of important field in such monitoring system is neonatal intensive care unit (NICU), where the patients (neonates) need continuous monitoring of such vital signs (e.g. respiration rate) without creating a discomfort or irritation to them. In principle, optical, electromagnetic, acoustic, and pneumatic techniques can be employed to realize noncontact measurement of physiological quantities. Wang et al. [2] performed a study on non-contact detection of breathing and heart beat based on radar principles. Similarly, Droitcour et al. [5] developed a respiratory rate monitoring system using a non-contact, low power 2.4 GHz Doppler radar system and obtained good results when monitoring breathing activities for hospitalized patients. De Chazal et al. [3] modified a biomotion sensing technique for respiratory activity detection based on 5.8 GHz Doppler radar. Hafner et al. [6] developed non-contact cardiopulmonary sensing with a baby monitor for premature infants inside neonatal intensive care unit (NICU) by using simple Doppler radars operating in continous wave (CW) mode. Moreover, Zito et al. [7] developed a wearable system-on-chip (SoC) ultra wide band (UWB) radar for contactless cardiopulmonary monitoring. Matusi [8] has proposed a novel approach for touchless measurement of heart rate variability (HRV) by using a combination of microwave radar and infrared thermography to analyze the exhaled CO/CO2 gas concentrations. Furthermore, Mathews et al. [4] also prototyped a contactless vital signal monitor which uses very low power, high frequency Doppler radar to detect the respiration and heart rates. Ling et al. [9] introduced the OxyArm module, which is a new minimal contact oxygen delivering system for mouth or nose breathing. Moreover, Hoffmann et al. [10] developed a capacitive textile force sensor for detecting respiration activity rate in the human body. Additionally, Nakajim et al. [11] employed a real-time image sequence analysis of CCD video camera for evaluating posture changes and respiratory rate of a subject in bed. Moreover, Heimann et al. [12] investigate a new non-contact monitoring method of heart and lung activity using magnetic induction measurement. In premature infants, a thermistor was used to quantify respiratory flow during inspiration and expiration with the disadvantage of a possible obstruction of the upper airways.

In contrast to the infrared (IR) detectors, which measure the radiation energy emitted from any object containing solid matter, that may represent an option for passive non-contact measurement of vital signs including respiration activity [13]. Resume to that, the skin is the largest organ of the human body and helps maintain the thermal equilibrium of the body and the environment through a heat transfer process.

Infrared thermographic imaging

Any object whose temperature is above absolute zero Kelvin (-273.15°C) emits radiation at a particular rate and with a distribution of wavelengths. This wavelength (λ) distribution is dependent on the temperature of the object and its spectral emissivity ϵ(λ). The spectral emissivity, which can also be considered as the radiation efficiency at a given wavelength, is in turn characterized by the radiation emission efficiency based on whether the body is a black body, grey body, or a selective radiator. Around room temperature, the typical emissions for a solid matter are maximal in the long wave infrared (LWIR) region of the electromagnetic spectrum (7 μ m to 14 μ m) (see Figure 1). In principle, the hotter the object, the higher its maximal frequency of radiation, that moves towards the visible region. While IR radiation is invisible to the human eye, it can be detected and visualized by special IR cameras. These cameras detect the invisible IR radiation emitted by an object and convert it to a monochrome or multicolored image on a monitor screen, in which the various shades or colors represent the thermal patterns across the object's surface [1, 14]. In one specific medical application the thermal imagers may be coupled with proper computer software to detect febrile temperatures on the skin of passengers (epidemic screening). Temperature readings over time may also be registered. Although thermal imagers offer an excellent means of making a qualitative determination of surface temperature, there are difficulties in obtaining absolute measurements.

Figure 1
figure 1

The electromagnetic spectrum. The electromagnetic spectrum showing the infrared radiation classification and corresponding wavelengths, (© MedIT, 2011).

Target's surface radiation heat exchange

The measurement of IR thermal radiation is the basis for non-contact temperature measurement and thermography. Fundamentally, thermal IR radiation (W) leaving a surface (A) is called 'exitance' or 'radiosity'. This energy W can either be emitted from the surface, reflected off the surface, or transmitted through the surface (see Figure 2) [14, 15]. Note that the total radiosity is equal to the sum of the emitted component (W e ), the reflected component (W r ) and the transmitted component (W t ). Thus, the surface temperature is related to W e , only on the emitted component [15, 16]. Generally, the infrared radiation impinging on the surface can be absorbed, reflected or transmitted, as shown in Figure 2(b). Basically, Kirchhoff's law of thermal radiation states that the sum of the three components is always equal to the received radiation. Hence, the sum of the three components, if the percentages are expressed as fractions, equals unity

Figure 2
figure 2

Heat radiation mechanism. Heat radiation mechanism (a) The radiative heat flow mechanism, where total exitance or radiosity equal to the sum of reflected radiation W r = ε . σ . T r 4 , transmitted radiation W t = ε . σ . T t 4 and emitted radiation W e = ε . σ . T e 4 , (b) The concept of impinging the process of radiation on a target surface, where (1) is the total radiant energy, (2) heat source,(3) absorbed energy, (4) reflected energy, (5) transmitted energy, (6) total detected energy and (7) total surface properties (© MedIT, 2011).

α ( a b s o r p t i v i t y ) + ρ ( R e f l e c t i v i t y ) + τ ( t r a n s m i t t a n c e ) = 1
(1)

Therefore, each part of these physical quantities has a value equal to less than one, as can be seen in the three radiation components in Figure 2(a). For further simplification, if the IR thermal energy detector is positioned in front of the target surface, then the net radiation (W net ) which will be detected is equal to the transmitted component of the IR thermal radiation (see Figure 2(b)) [1, 13, 17].

W n e t = W τ = τ W t o t
(2)

This means that the other two physical quantities (absorbed and reflected radiation) will not be considered in IR thermal imaging.

Material and Methods

Clinical Acquisition of IR Thermograms

The real-time IR thermograms were collected using a VarioCAM® hr head IR camera (InfraTec GmbH, Germany) with a thermal sensitivity of 0.05°C at 30°C. This device allows IR image transfers via the IEEE-1394 Firewire data interface at 30 frame per second (fps) frame rate. The scaling temperature sensitivity scheme in the infrared radiation range of 1 μ m to 14 μ m was set to a range of 0°C to 40°C. Preprocessing steps (such as filtering, color scale conversion and image scaling) were done using IRBIS® professional software. Figure 3 shows the imaging setup for neonatal thermal respiration (IRTR) measurement. The acquisition protocol for the IRTR measurement consists of three distinct phases with 2 minute duration for each phase, and between these phases intervals, there is a recalibration time to correct any non-uniformity with IR themrography (IRT) (see Figure 4). Note that, the observation phases from the bedside monitor have the same phases. Furthermore, at the initial measurement time, a localizing of neonate's nostrils region to make sure that full coverage of IRTR signature is performed.

Figure 3
figure 3

IRTR clinical imaging setup. Schematic of the experimental setup used for the neonatal infrared respiration monitoring technique. The IR camera is located 70 - 80 cm from the neonate and is connected to the IR acquisition/analysis workstation. The infant's nostrils have to be in direct optical contact and visible, the overall setting consist of (1) radiant warmer bed,(2) bedside monitor,(3) camera field of view (FOV),(4) IR thermal camera, (5) analysis workstation and (6) infant under NIRT imaging (© MedIT, 2011).

Figure 4
figure 4

IRTR measurement protocol. The IRTR signal measurement protocol which include three phases and in between a recalibration phase to compensate any non-uniformities within infrared thermography imaging.

Patient population

All measurements were conducted at the Department of Neonatology (RWTH Aachen University Hospital). This has been approved by the Medical Ethics committee of the RWTH Aachen University Hospital, issued on 19 August 2009 (EK032/09). We examined seven premature infants with a median gestational age of 29 weeks. They were all consecutively admitted directly after birth to our Department of Neonatology. We excluded infants with additional risk factors apart from prematurity, e.g. chromosomal abnormalities or brain haemorrhage. Study design and protocol were approved by the Ethics Committee of Aachen University Hospital and parental consent was obtained prior to enrollment. None of the infants was mechanically ventilated. They all had respiratory support via CPAP (Continuous Positive Airway Pressure) directly after birth because of respiratory distress syndrome, a very common disease in these infants. One of them still had a CPAP during the study. While five infants were handled in an incubator, two infants were positioned in an IR radiant warmer bed. Cardiorespiratory stability was a precondition to be included into the study to get a reliable signal over the whole time period of the IRT. During IRT, vital parameters including oxygen saturation were continuously monitored to make sure that there were no negative side effects. The authors are aware that this setup and this heterogenous patient population can not be a basis for a rigid clinical validation study. Instead, with this paper we are presenting a method for automated data analysis which may eventually lead to a valid ventilation monitoring technique.

IR thermography post-processing

The acquired thermographic images were exported to MATLAB® for post-processing and pre-filtering. The mean value was removed by a moving average filter. Motion compensation was applied using the trend-remove function of the MATLAB System Identification toolbox. The distance between the camera and the subject was kept at less than 150 cm in order to attenuate background IR radiation from the surrounding objects, and to eliminate geometrically induced disturbances. Initially, raw thermal data was used to construct time-varying signals for each thermographic pixel in the area of interest in order to build temperature time profile. However, this approach makes the signal extremely noisy due to variation in the ambient temperature of the surrounding region of interest (ROI) [1821]. In our work, the thermal images were examined at different points in time. All frames that carry information relevant to respiration in the ROI were selected. Following these steps, the time-varying signals from each point in the ROI were averaged and continuous wavelet transform (CWT) was applied. The resulting waveforms yield excellent results to identify infrared thermography respiration (IRTR) signals [22, 23]. The preliminary tests were conducted in our neonatal intensive care unit (NICU) to identify IRTR signals in neonates; stability over the measurement time intervals has been proven.

Respiration thermal signature

Many physiological phenomena occur in the spectral band of long wave infrared (LWIR, 7 μ m to 14 μ m); however, in some bioheat transfer processes, these phenomena also take place in the range 3 μ m to 8 μ m mid-wave IR (MWIR) [13, 14] or in the range of 0.7 μ m to 2 μ m short-wave infrared (SWIR) [15]. For example, Pavlidis et al. [1, 20, 24] used MWIR sensors for distant measurement of cardiac and breathing rates in adults. In this work, the breathing measurements were based on heat transfer of the moisturized air during expiration, which is directly related to the respiration waveform. Although the exact shape is smoothed, it was shifted and noisy with respect to the actual respiration rate. Most probably, this is mainly due to the diffusion-convection heat transfer processes and air flow in the nasal cavity [7, 13, 17]. Note that the anatomical section of a nasal cavity (shown in Figure 5) also consists of vascular mesh, which contributes to the temperature conditioning of the inhaled air. As indicated, for breathing measurements, Palvidis et al. [1, 18, 20, 23, 24] used the expired and moisturized air flow to measure the respiration rate. As a result, the subject must have a sideview technique to the camera in order to visualize breathing-jet dynamics. Beside this side view orientation, Pavlidis also introduced the concept of nostrils tracking in adults [18, 20, 23]. Our method presented here is related to this concept, but differs in the spectral range. Also, signal processing was enhanced. While other groups [20, 23] used MWIR, our group used LWIR thermography, which is more stable in detection of temperature variance within the thermographic scenario [13, 15, 22]. In general, LWIR cameras are typically preferred for imaging applications that require absolute or relative measurements of object irradiance or radiance because emitted energy dominates the total signal in the LWIR. In the MWIR, extreme care is required to ensure the radiometric accuracy of data. Thermal references may be used in the scene to provide a known temperature reference point or points to compensate for detector-to-detector variations in response and improve measurement accuracy. This temperature reference measurement in our case is not possible, because this will include invasive nasal thermocouple and may interfere with our thermography image reading. Moreover, besides a characterization of the respiratorial behaviour, we focused on temperature changes in the nasal region (nostrils) within the thermal image to get possibly information about the impact on thermoregulation of the infants. Additionally, the thermal imaging was performed using both frontal and lateral views, in order to follow the defined region over the nostrils.

Figure 5
figure 5

Physiology of heat transfer processes inside nasal cavity. (a) Anatomical section through the nasal cavity, showing the mechanism of heat exchange between the internal tissue lining and the flowing air inside the nasal cavity (inspiration-expiration phase) which consist of the following: (1) convective air flow inside nasal cavity, (2) perfusion heat transfer inside nasal blood vessels, (3) convective heat loss over mucosal film, (4) conductive heat loss of mucosal film on nostrils inner lining and (5) radiative heat loss from nostrils tissue, (b) schematic representation of heat transfer processes inside the nasal cavity, (© MedIT, 2011).

Infrared Thermography Respiration (IRTR) signature detection

Basically, this type of thermographic imaging may be called "pulsed thermography", which implies that the process is repetitive in nature, which is true for the respiration rate. Therefore, it is essential to develop a method to detect a biphasic thermal breathing signal, which consists of two phases (active and passive states) [15, 20, 25]. Initially, during the application of infrared thermal imaging on newborn infants for mapping skin temperature, we were expecting to detect very small temperature changes in the nostrils region comparing to the magnitude in adults [20, 23, 26]. Therefore, we expected difficulties to detect the respiration thermal signature in infants, and were supposed to find this temperature difference between inspiration and expiration phase in the range between 0.3°C to 0.7°C. The physics of this phenomenon are based on the radiative and convective heat transfer component during the breathing cycle (see Figure 5). In fact, including all these influences in one model is a complex task, but should include the simulation of the airflow pathway, temperature gradient distribution throughout the nasal cavity, and the blood perfusion in the nasal cavity and nostril regions [18, 25]. Hence, the mathematical approximation for the IRTR signature depends on the five main parameters shown in Figure 6, and the total heat flow rate ( Q ˙ R R ( t ) ) contributing to the thermal signature of one respiration cycle can be expressed as follows:

Figure 6
figure 6

Physical parameter interaction in respiration thermal signature. Interaction of the physical parameters that contribute to the detection of the respiration thermal signature (©MedIT, 2011).

Q ˙ R R ( t ) = Q ˙ r a d ( t ) + Q ˙ c o n v ( t ) + Q ˙ e v a p ( t ) + Q ˙ p e r f ( t ) + Q ˙ l a t e n t ( t )
(3)

The overall equation for heat transfer inside the nasal cavity at the nostril level will be equal to the summation of the following heat flow components:

  • Q ˙ r a d : rate of heat dissipated by radiation between the air flow and the nasal surface

  • Q ˙ c o n v : rate of heat dissipated by convection between the nasal inner lining (skin and mucosa) and air flow

  • Q ˙ e v a p : rate of heat dissipated by evaporation at the nasal surface (mucosal thin film)

  • Q ˙ p e r f : rate of heat dissipated by blood perfusion

  • Q ˙ l a t e n t : rate of heat dissipated by latent heat loss through the respiration air flow, where the convective component is negligible in the inspiration thermal signal, due to outflow air with a temperature equal to the tissue temperature [20, 27].

The convective heat transfer Q ˙ c o n v of air flow over the inner lining of the nasal cavity and mucosal patches, where this convection is described by Newton's law of cooling, means that the rate of heat loss of a body (nasal cavity) is proportional to the difference in temperature between the body and its surroundings. Therefore, the rate of convective heat transfer is given by

Q ˙ c o n v ( t ) = k A ( T e n v ( t ) - T n a s a l - m u c ( t ) ) = - k A Δ T ( t )
(4)

where Q is the thermal energy in joules, k is the heat transfer coefficient, A is the surface area of the heat being transferred (internal surface area of the nasal cavity), T nasal-muc is the temperature of the nasal cavity tissue (≈32°C) and T env is the temperature of the environment; i.e. the temperature that is a suitable distance from the surface (inflow air) and ΔT(t) = T nasal-muc (t)-T env (t) is the time-dependent thermal gradient between the environment and the object [19, 28]. The radiation heat transfer Q ˙ r a d at the nostrils region is equal to

Q ˙ r a d ( t ) = ε σ A c ( T n a s a l 4 - T c 4 )
(5)

where ϵ is the emissivity of the nasal tissue, T nasal is the nasal tissue temperature, T c is the surrounding's temperature and A c is the nasal tissue area. Consequently, the change in overall heat transfer energy leads to a dynamic change of air temperature and blood perfusion throughout the respiration cycle; therefore, the thermal signature develops within this cycle [18, 28]. For the blood perfusion heat transfer, the blood acts as a local distributed, scalar source (or sink) of energy with a magnitude equal to:

Q ˙ p e r f ( t ) = ς ρ b l C b l ( 1 - k ) ( T a r t ( t ) - T t i s s u e ( t ) )
(6)

where ζ, ρ bl and C bl are the blood perfusion rate, density and specific heat, respectively; k < 1 is a factor accounting for the incomplete thermal equilibrium between blood and tissue; and T art and T tissue are the arterial blood and tissue temperatures, respectively. The variable IR signature approximation which applies calculation of the maximal thermal contrast index (MTCI), which is denoted as C(t), is expressed as the principal parameter in pulsed thermography [17, 21, 22]. Therefore, this contrast index C(t) can be defined as follows:

C ( t ) = α c a l ( T d ( t ) - T 0 ( t ) )
(7)

where T 0 is the temperature at initial time, where temperature is minimal and T d is the temperature at final time, when temperature is maximal and α cal is the thermal camera calibration coefficient, which is adjusted according to the clinical thermographic setting.

IRTR signal wavelet analysis

Continous wavelet transform (CWT) as introduced in [26, 27] was applied to the IRTR signals. Essentially, the Debauchies (Db-wavelet) function was used with three decomposition levels [29]. The Db-wavelet was chosen instead of other functions (such as Haar, Biorthogonal and Morlet wavelets) because the Db-transformation is known to provide stable and accurate decomposition results for biomedical signals [26, 29]. Thus, the thermal variation function f(t) is transformed as follows:

C W T ( a , b ) = 1 C Ψ 1 a - Ψ * t - b b f ( t ) d t
(8)

where

C Ψ = - Ψ ( ω ) ω d ω <
(9)

Furthermore, the Fourier transform of the wavelet function Ψ(t) is given by:

Ψ ( ω ) = - Ψ ( t ) e x p ( - i ω t ) d t
(10)

Eq. (10) implies that Ψ(ω) = 0 provided that ω = 0 and the dot symmetry condition is met, otherwise it is equal to 1 [30]. The function Ψ(t) is called the "mother wavelet". By shifting in time and dilating or compressing this function in frequency domain, one obtains a set of self-similar functions

Ψ ( a , b ) ( t ) = Ψ ( t - b a )
(11)

where a ≈ ω-1 is the scale that provides dilating or compressing, (b) is a time shift, and (t) is time. In contrast to discrete wavelet transform (DWT), large scales in CWT relate to the coarse representation of a signal, whereas small scales constitute its fine details [26, 28, 29]. Therefore, the definition of CWT entropy (WE) for an IRTR signal is:

W E = - a p ( a ) l o g 2 p ( a )
(12)

where p(a) is the probability distribution of IRTR signal at level (a). Therefore, the distribution can be approximated as:

p ( a ) = E ( a ) E t o t a l
(13)

where E(a) is wavelet energy at level (a) calculated by

E ( a ) = b | W T | 2 ( a , b )
(14)

where WT represents an orthonormal basis for wavelet transformation. Therefore, the total signal energy (E total ) is

E t o t a l = a E ( a )
(15)

Figure 7 illustrates the continous wavelet analysis of the IRTR signal extracted from ROI defined over the neonate nostrils, where the analysis performed over one minute interval.

Figure 7
figure 7

IRTR signal wavelet analysis. Wavelet analysis of the IRTR signal extracted from the region of the nostrils of a neonate during a one-minute interval.

Neonatal respiration monitoring in the NICU

To the authors' knowledge, this is the first time that IRTR signal analysis has been applied to monitor neonates. Note that special clinical challenges are present because measurements take place in the NICU while patients may be highly vulnerable and physiologically unstable. Therefore, the configuration of the measurement setup should be such that it interferes in no way with any routine care procedures for the neonate. In some of the measurements, the ROI was taken over the baby's mouth, in order to quantify and detect the heat transfer pattern through the respiration phases [31]. This occurs mainly in CPAP or mechanical ventilation, or due to the inability to directly image the nostrils. However, in most spontaneously breathing neonates we focused on the nasal region (Figure 8 and Figure 9). As a reference, we recorded other vital signs such as ECG, heart rate and respiration rate, derived from the bedside intensive care monitoring module [31, 32]. The temperature time course detected from neonate's nostril region is shown in Figure 10 (b), for a female neonate wearing a face mask and an ROI defined around her mouth cared inside a convective incubator (note the superposed temperature drifts due to changes in the internal temperature of the incubator). In the temperature signal derived from IR thermography, a temperature change of 0.5°C to 0.85°C related to the respiration rate thermal signature was visible (see Figure 10). In addition, actions of the nurse (e.g. opening the incubator door, handling of the baby) also influenced the temperature profile. Another important result is the reflection pattern of the air-jet stream on the reflective IR material (made of cotton) around the baby's face; when the baby exhaled air, the IR reflection signature can be clearly seen with this domain (although this is not quantitative but qualitative by nature). Figure 9 (top) illustrates a neonate placed under an IR radiant warmer with ROI defined over his nostrils with a good detected IRTR signature. In our study, most measurements were performed with newborn infants being subject to IR radiant warming therapy (see Figure 11). We noted that the process of IRTR signal detection in the neonate is more complex than in adults due to the following problems:

Figure 8
figure 8

IRTR camera setting with field of view (FOV) and region of interest (ROI) over neonate's nostrils. Infrared camera setting for detection of neonatal respiration activity, showing the region of interest around the neonate's nostrils.

Figure 9
figure 9

IRTR image over neonate's nostrils. Top: Neonatal infrared thermographic image with (a) IRTR signal with δ T = 0.27°C between inspiration and expiration (b) ROI located over the nostrils from which signal in (a) derived. Bottom: Thermal contour plot of the thermography clearly showing the thermal signature over this region at (c) inspiration phase starting and (d) at the expiration phase starting.

Figure 10
figure 10

IRTR signal of defined ROI temperature trend over neonate's mouth. (a) Neonatal infrared thermographic imaging inside a neonatal incubator with the ROI around the mouth opening, (b) Fluctuating temperature trend of the neonate during normal activities of daily care.

Figure 11
figure 11

Series of IRTR image during open care procedure. Images of the IRTR signal detection process in the neonate. The sequence indicates tracking of one respiration cycle for 1100 ms; this interval is not fixed over the measurement period of time, but varies according to the physiological and clinical status of the neonate.

  1. 1.

    small air-flow jet in the neonatal respiration cycle and small lung volume

  2. 2.

    the possibility that part of neonatal IRTR signature located at other infrared spectral band, in which the current camera system is unable to detect the full variation in thermal energy

  3. 3.

    the geometry of the nasal aperture, i.e. the inner surface area of the nasal aperture (nostrils), is small (about 0.08 cm2 as compared with about 1.07 cm2 in the average adult).

  4. 4.

    the small amount of mucous secretion from the nasal cavity compared to adults

  5. 5.

    low humidity level in the nostrils region of the neonate

In fact, all factors mentioned above may reduce the amplitude of the IRTR signal. Therefore, some remaining problems need to be addressed in future investigations and further improvements should be performed taking into account the following: a) extending patient population (number of neonates considered in the study) to make more quantitative analysis, b) using more precise IR detector with high temperature resolution.

Results and Discussion

In summary, the results presented here indicate that the IRTR thermal signature detection may be included into the future neonatal monitoring modalities. At present, the results acquired during IRTR measurement are not fully categorized and need more reliable measurement protocols. Additionally, the neonatal IRTR measurement are not correlated with a classical reference respiration sensing method, i.e. a thermistor that is fixed above the upper lip directly in front of the nares with the danger of inducing apnoeas because of upper airway obstruction. To overcome this problem, the neonate's respiration rate was manually registered from the bedside monitor. The disadvantage is that there is no information about the quality of breathing. The results from this experiment have shown clear changes in temperature over the nasal region and also a difference during inspiration and expiration. In addition, in some subjects averaging IRTR signals did not improve the signal quality and required further pre-procesing. By examining Figure 9, we notice that, for clinically stable infants (i.e. under IR radiant warmer), the IRTR signal magnitude is relatively higher than that of neonates cared inside convective incubator units (see Additional file 1: Neonatal IRTR video sample 1). Moreover, while changes in convective heat transfer due to respiration in adults are easily observed using an IR camera, respiration monitoring in the preterm infant remains a challenge due to a much smaller breathing temperature variation (see Figure 10 and Figure 12), and to other complex interactions (e.g. CPAP with face masks or prongs, mechanical ventilation, head rotation, motion artifacts, etc.) (see Figure 9) [26]. In addition, the detected IRTR signature depend also on the viewing angle set for the IR camera (see additional file 2: Neonatal IRTR video sample 2). Therefore, an optimal viewing angle will result in better quality of IRTR signature (see Figure 11). Regarding the standard reference measurement with IRTR signal, it seems there is also slight delay between the respiration signals derived from bedside ECG monitoring and the IRTR measurement (see Table 1). Therefore, by considering a lot of variation between each method, we state that the quality of the IRTR method approaches the established respiration activity recording using standard clinical measurement (e.g. ECG). Additionally, our finding regarding the small temperature difference over nostril region is already shown in Table. 1, were the maximum difference in temperature was about 0.66°C.

Figure 12
figure 12

IRTR signal of neonate under open therapy (IR radiant warmer). (Left) Neonatal respiration monitoring acquired from a newborn infant under the intensive open-care system, indicating that the respiration thermal signature is difficult to detect unless there is a good calibration and image zooming functions to identify temperature variation during the inspiration-expiration phases. (Right) Time graph of the ROI temperature profile over the nasal region, extracted and recorded for about 60 seconds.

Additional file 1: Neonatal IRTR video sample 1 - Neonatal respiration detection with IR thermography-Video 1. This file is an audivisual file which illustrates the infrared thermography frame-sequence for detecting respiration thermal siganture from the nostrils region. This video file is taken through the preliminary clinical study on neonates cared in radiant warmer (open therapy). (WMV 5 MB)

Additional file 2: Neonatal IRTR video sample 2 -- Neonatal respoiration detection with IR thermography-Video 2. This file is an audivisual file which illustrates the infrared thermography frame-sequence for detecting respiration thermal siganture from the nostrils region. This video file is taken through the preliminary clinical study on neonates cared inside convective incubator system (closed therapy). (WMV 5 MB)

Table 1 Comparison of mean respiratory rate during 5-minute measurements derived from the IRTR method and from conventional ECG measurement

In conclusion, whereas respiration jet and nostril temperature monitoring has been applied to adult volunteers, in this work IR thermography was shown to allow non-contact respiratory monitoring in neonates inside the NICU. Physically, the work is based on changes of convective heat transfer at the infra-nasal region, induced by breathing in dedicated ROIs. Until now the method seems more effective in adults than in newborns, due to the larger lung volumes in adults. Both the IR imaging device and the method itself still face drift problems due to variation in background temperatures. This requires improvements in image processing and boundary detection of the nasal region separated from the rest of the imaging scenario (e.g. incubator internal wall, mattress, and other facial regions). Moreover, the presented results are preliminary and need further studies in a larger number of neonates and under different care setups. The mathematical method needs further improvement, such as automatic ROI definition and automatic calibration. Furthermore, the IRTR monitoring may assist in the estimation of a possible temperature loss as a part of thermoregulation, and may be also considered as a first step to evaluate non-invasive respiratory behaviour of premature infants [33]. In comparison to the ECG derived respiration rate, the IRTR signal is correlated to this acquired signal from bedside monitor, while there is a slight difference in respiration rate estimated from each method (see Table 1). The main impediments to high resolution IRTR signature detection are the IR camera physical coverage and the thermal detector's resolution. In spite of the calibration mechanism in modern thermal cameras, most of medical IR imaging setups face calibration drift; and this needs enhancement in order to avoid erroneous measurement. To deal with this problem, the proposed solution is based on a virtual sensing mechanism to track the ROI over a defined anatomical part. Moreover, the information on intensity was extracted and transformed into a corresponding color-coded space of IR thermographic images.

Conclusions

However, despite the limited number of measurements, these preliminary results provide a good basis for further investigation of the neonatal thermal respiration signature. More studies performed under standardized clinical conditions are needed, so that the method can be applied to examine the symmetrical pattern of the IRTR signature. Moreover, clinical investigations should explore a range of upper respiratory tract diseases. Furthermore, this method may be an effective quantitative technique to measure the nasal symmetrical air-flow pattern in preterm infants. This possibly can give information about the depth and the frequency of each breath cycle to get an early sign of changes in the infant's behavior. Also, the temperature difference up to 0.66°C can be interpreted as a part of the infant's thermoregulation and gives an interference of heat loss through expiration. Despite the remaining problems, the authors feel that the presented technique is a promising and effective step toward establishing cable-free monitoring of infants under intensive care conditions.

Statement of consent

An oral consent was gained from the parents of the patient for publication of images and related files.

References

  1. Murthy JN, van Jaarsveld J, Fei J, Pavlidis I, Harrykissoon R, Lucke : Thermal infrared imaging: A novel method to monitor airflow during polysomnography. SLEEP 2009, 32: 15211527.

    Google Scholar 

  2. Wang JQ, Wang HB, Jin XJ, Yang GS, Yang B, Dong XZ, Qiu LJ: The study on non-contact detection of breathing and heartbeat based on radar principles. Fourth Medical Military conference 2001, 25: 132–135.

    Google Scholar 

  3. de Chazal P, O'Hare E, Fox N, Heneghan C: Assessment of sleep/wake patterns using a non-contact biomotion sensor. In Conf Proc IEEE Eng Med Biol Soc 2008, 33: 514–517. IEEE

    Google Scholar 

  4. Matthews G, Sudduth B, Burrow M: A non-contact vital signs monitor. Crit Rev Biomed Eng 2000, 28(1–2):173–178.

    Article  Google Scholar 

  5. Droitcour AD, Seto TB, Park BK, Yamada S, Vergara A, Hourani CE, Shing T, Yuen A, Lubecke VM, Boric-Lubecke O: Non-contact respiratory rate measurement validation for hospitalized patients. Conf Proc IEEE Eng Med Biol Soc 2009 2009, 24: 4812–4815.

    Article  Google Scholar 

  6. Hafner N, Mostafanezhad I, Lubecke VM, Boric-Lubecke O, Host-Madsen A: Non-contact cardiopulmonary sensing with a baby monitor. Conf Proc IEEE Eng Med Biol Soc 2007, 12: 2300–2302.

    Google Scholar 

  7. Zito D, Pepe D, Mincica M, Zito F, Rossi DD, Lanata A, Scilingo EP, Tognetti A: Wearable system-on-a-chip UWB radar for contact-less cardiopulmonary monitoring: present status. Conf Proc IEEE Eng Med Biol Soc 2008, 14: 5274–5277. IEEE

    Google Scholar 

  8. Matsui T, Hattori H, Takase B, Ishihara M: Non-invasive estimation of arterial blood pH using exhaled CO/CO2 analyzer, microwave radar and infrared thermography for patients after massive hemorrhage. J Med Eng Technol 2006, 30: 97–101. 10.1080/03091900500062158

    Article  Google Scholar 

  9. Ling E, McDonald L, Dinesen TJR, DuVall D: The OxyArm - a new minimal contact oxygen delivery system for mouth or nose breathing. Can J Anaesth 2002, 49(3):297–301. 10.1007/BF03020531

    Article  Google Scholar 

  10. Hoffmann T, Eilbrecht B, Leonhardt S: Respiratory monitoring system on the basis of capacitive textile force sensor. IEEE transaction of sensors 2010, 27.

    Google Scholar 

  11. Nakajim K, Matsumoto Y, Tamura T: Development of real-time image sequence analysis for evaluating posture change and respiratory rate of a subject in bed. Physiological Measurement 2001, 22(2):N21-N28.

    Article  Google Scholar 

  12. Heimann K, Steffen M, Bernstein N, Heerich N, Stanzel S, Cordes A, Leonhardt S, Wenzl TG, Orlikowsky T: Non-contact monitoring of heart and lung activity using magnetic induction measurement in a neonatal animal model. Biomed Tech (Berl) 2009, 6(54):337–345.

    Article  Google Scholar 

  13. Holst G: Common Sense Approach to Thermal Imaging. SPIE Press, JCD Publishing; 2000.

    Google Scholar 

  14. Maldague X: Theory and practice of infrared technology for nondestructive testing. Volume 2. Wiley; 2001.

    Google Scholar 

  15. Kaplan H: Practical applications of infrared thermal sensing and imaging equipment. Tutorial texts in optical engineering, SPIE Press; 2007.

    Book  Google Scholar 

  16. Hudson R: Infrared Systems Engineering. John Wiley & Sons, Inc, New York; 1969.

    Google Scholar 

  17. F K: The CRC Handbook of Thermal Engineering. CRC Press, Boca Raton, FL; 2000.

    Google Scholar 

  18. Pavilidis I, Levine J: Thermal image analysis for polygraph testing. IEEE Engineering in Medicine and Biology Magazine 2002, 21(6):56–64. 10.1109/MEMB.2002.1175139

    Article  Google Scholar 

  19. Tarkov MS, Vainer BG: Evaluation of a Thermogram Heterogeneity Based on the Wavelet Haar Transform. Proc Siberian Conference on Control and Communications SIBCON '07 2007, 145–152.

    Google Scholar 

  20. Murthy R, Pavlidis I: Non-contact monitoring of breathing function using infrared imaging. Technical report in Biomedical engineering Number UH-CS-05–09, University of Houston; 2005.

    Google Scholar 

  21. Fei J, Pavlidis I, Murthy J: Thermal vision for sleep apnea monitoring. Med Image Comput Comput Assist Interv 2009, 12(Pt 2):1084–1091.

    Google Scholar 

  22. Caniou J: Passive infrared detection: theory and applications. Volume 2. Kluwer Academic Publishers; 1999.

    Book  Google Scholar 

  23. Fei J, Pavlidis I: Virtual thermistor. Conf Proc IEEE Eng Med Biol Soc 2007, 250–253.

    Google Scholar 

  24. Fei J, Pavlidis I: Thermistor at a distance: unobtrusive measurement of breathing. IEEE Trans Biomed Eng 2010, 57(4):988–998.

    Article  Google Scholar 

  25. Naftali S, Schroter RC, Shiner RJ, Elad D: Transport Phenomena In The Human Nasal Cavity: A Computational Model. Annals of Biomedical Engineering 1998, 26(5):831–839.

    Article  Google Scholar 

  26. Abbas AK, Heimann K, Orlikowsky T, Leonhardt S: Non-Contact Respiratory Monitoring Based on Real-Time IR-Thermography. In World Congress on Medical Physics and Biomedical Engineering,, IFMBE Proceedings Edited by: IFMBE. 2010., 25:

    Google Scholar 

  27. Fei J, Pavlidis I: Thermistor at a distance: unobtrusive measurement of breathing. IEEE Trans Biomed Eng 2010, 57(4):988–998. [http://dx.doi.org/10.1109/TBME.2009.2032415]

    Article  Google Scholar 

  28. Danjoux R: The evolution in spatial resolution. InfraMation Magazine 2001, 2(12):1–3.

    Google Scholar 

  29. Akay M, Mello C: Wavelets for biomedical signal Processing. In Proceedings of the 19th annual international conference of the IEEE Edited by: engineering in medicine, biology society. 1997., 6:

    Google Scholar 

  30. Stark H: Wavelets and signal processing: an application-based introduction. Springer; 2005. [http://books.google.com/books?id=IYUMyVRdJjkC]

    Google Scholar 

  31. Bohnhorst B, Heyne T, Peter C, Poet sC: Skin-to-skin (kangaroo) care, respiratory control, and thermoregulation. J Pediatr 2001, 138: 193–197. 10.1067/mpd.2001.110978

    Article  Google Scholar 

  32. Bohnhorst B, Gill D, Drdelmann M, Peter C, Poets C: Bradycardia and desaturation during skin-to-skin care: no relationship to hyperthermia. J Pediatrics 2004, 145: 499–502. 10.1016/j.jpeds.2004.06.019

    Article  Google Scholar 

  33. Heimann K, Vaen P, Peschgens T, Stanzel S, Wenzl T, Orlikowsky T: Impact of skin-to-skin care, prone and supine positioning on cardio respiratory parameters and thermoregulation in premature infants. Neonatology 2010 2010, 97: 311–317.

    Google Scholar 

Download references

Acknowledgements

We hereby express our thanks to Prof. V. Blazek and Prof. V. J. Kumar for their valuable recommendation and reviewing of this paper. All experimental device (IR camera and temperature sensors were provided by MedIT, RWTH Aachen University. In addition, we thank all the medical staff in the Departement of Neonatology at University Hospital, RWTH Aachen University, for their tolerance and support during the study and clinical measurements.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abbas K Abbas.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

AK conducted the experimental work and analysis of the thermography data, in addition he wrote the article (technical part) together with KH (clinical part). KJ and KH performed the clinical study at the Neonatal Intensive Care Unit (NICU). Prof. TO and Prof. SL supervised and coordinated the whole clinical and analytic work of this paper and carefully revised the paper. All authors read and approved the final manuscript.

Abbas K Abbas, Konrad Heimann contributed equally to this work.

Electronic supplementary material

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Abbas, A.K., Heimann, K., Jergus, K. et al. Neonatal non-contact respiratory monitoring based on real-time infrared thermography. BioMed Eng OnLine 10, 93 (2011). https://doi.org/10.1186/1475-925X-10-93

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1475-925X-10-93

Keywords