A Timeresolved Nir Lockin Pixel Cmos Image Sensor With Background Cancelling Capability For Remote Heart Rate Detection

• doi: 10.1109/JSSC.2018.2885528
• title: A Time-Resolved NIR Lock-In Pixel CMOS Image Sensor With Background Cancelling Capability for Remote Heart Rate Detection
• publisher: IEEE
• isbn:
• issn: 1558-173X
• rank: 967
• access_type: LOCKED
• content_type: Journals
• abstract: This paper presents a time-resolved (TR) CMOS image sensor (CIS) using two-tap near-infrared (NIR) lock-in pixels with background light (BGL) cancelling capability for remote heart rate (HR) detection. Aimed to the application, the sensor features a 1024 (V) x 1280 (H) spatial resolution with 412 (V)x 1280 (H) region-of-interest-readout (ROI-readout) at 30 fps, a high sensitivity of 134.8 ke-/lux · s, and an ultralow temporal random noise of 1.13 erms- at analog gain of 64. A maximum charge modulation ratio of 90.1% is obtained for realizing lock-in operation by means of in-pixel lateral electric field charge modulator (LEFM). The remote HR detection is achieved by capturing the heart-beat-induced temporal variation of the oxy-hemoglobin (HbO2) concentration by the developed TR CIS with NIR lock-in technique, and larger than 98% detection accuracies are attained under both non-visible-light condition and fluctuant brightness ambient-light environments. This remarkable feature demonstrates the superiority of the proposed method for driver monitoring applications in particular.
• article_number: 8585083
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8585083
• html_url: https://ieeexplore.ieee.org/document/8585083/
• abstract_url: https://ieeexplore.ieee.org/document/8585083/
• publication_title: IEEE Journal of Solid-State Circuits
• conference_location:
• conference_dates:
• publication_number: 4
• is_number: 8674728
• publication_year: 2019
• publication_date: April 2019
• start_page: 978
• end_page: 991
• citing_paper_count: 8
• citing_patent_count: 0
• download_count: 1462
• insert_date: 20181221
• index_terms:
  • ieee_terms:
    • Logic gates
    • Electric potential
    • Heart rate variability
    • Sensors
    • Sensitivity
    • Modulation
  • author_terms:
    • Automotive application
    • background light (BGL) cancelling
    • correlated multiple sampling (CMS)
    • heat rate variability spectrogram (HRVS)
    • image signal processing (ISP)
    • lock-in operation
    • remote heat rate (HR) detection
    • time-resolved (TR) CMOS image sensor (CIS)
  • dynamic_index_terms:
    • Image Sensor
    • Camera Sensor
    • Remote Detection
    • Heart Rate Detection
    • Remote Heart Rate
    • Spatial Resolution
    • Background Light
    • Charge Transition
    • Charge Modulation
    • Temporal Noise
    • Illumination
    • Lighting
    • Time Window
    • High Spatial Resolution
    • Frame Rate
    • Heart Rate Variability
    • Analog-to-digital Converter
    • Analog-to-digital
    • Digital-to-analog Converter
    • Ambient Light
    • Heart Rate Measurements
    • Potential Well
    • Least Significant Bit
    • Low Bit
    • PIN Photodiode
    • Region Of Interest Size
    • Pixel Array
    • Mental Arithmetic
    • Mental Calculation
    • Most Significant Bit
    • High Bit
    • Highest Bit
    • Arbitrary Waveform Generator
    • Arbitrary Function Generator
    • Ultra-low Levels
    • Remote Measurement
    • Device Simulation
    • Serial Peripheral Interface
• authors:
  • Author Name: Chen Cao
    Affiliation: Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
    Author URL: https://ieeexplore.ieee.org/author/37086490163
    ID: 37086490163
    Order: 1
    Author Affiliations:
    • Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
  • Author Name: Yuya Shirakawa
    Affiliation: Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
    Author URL: https://ieeexplore.ieee.org/author/37085993272
    ID: 37085993272
    Order: 2
    Author Affiliations:
    • Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
  • Author Name: Leyi Tan
    Affiliation: Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
    Author URL: https://ieeexplore.ieee.org/author/37086491487
    ID: 37086491487
    Order: 3
    Author Affiliations:
    • Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
  • Author Name: Min-Woong Seo
    Affiliation: Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
    Author URL: https://ieeexplore.ieee.org/author/38063173500
    ID: 38063173500
    Order: 4
    Author Affiliations:
    • Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
  • Author Name: Keiichiro Kagawa
    Affiliation: Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
    Author URL: https://ieeexplore.ieee.org/author/37278023200
    ID: 37278023200
    Order: 5
    Author Affiliations:
    • Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
  • Author Name: Keita Yasutomi
    Affiliation: Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
    Author URL: https://ieeexplore.ieee.org/author/37680557800
    ID: 37680557800
    Order: 6
    Author Affiliations:
    • Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
  • Author Name: Sung-Wook Jun
    Affiliation: Brookman Technology, Inc., Hwaseong, Japan
    Author URL: https://ieeexplore.ieee.org/author/37085640405
    ID: 37085640405
    Order: 7
    Author Affiliations:
    • Brookman Technology, Inc., Hwaseong, Japan
  • Author Name: Tomohiko Kosugi
    Affiliation: Brookman Technology, Inc., Hwaseong, Japan
    Author URL: https://ieeexplore.ieee.org/author/38236166000
    ID: 38236166000
    Order: 8
    Author Affiliations:
    • Brookman Technology, Inc., Hwaseong, Japan
  • Author Name: Satoshi Aoyama
    Affiliation: Brookman Technology, Inc., Hwaseong, Japan
    Author URL: https://ieeexplore.ieee.org/author/37408090900
    ID: 37408090900
    Order: 9
    Author Affiliations:
    • Brookman Technology, Inc., Hwaseong, Japan
  • Author Name: Nobukazu Teranishi
    Affiliation: Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
    Author URL: https://ieeexplore.ieee.org/author/37351891200
    ID: 37351891200
    Order: 10
    Author Affiliations:
    • Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
  • Author Name: Norimichi Tsumura
    Affiliation: Chiba University, Chiba, Japan
    Author URL: https://ieeexplore.ieee.org/author/37530784000
    ID: 37530784000
    Order: 11
    Author Affiliations:
    • Chiba University, Chiba, Japan
  • Author Name: Shoji Kawahito
    Affiliation: Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan
    Author URL: https://ieeexplore.ieee.org/author/37300195700
    ID: 37300195700
    Order: 12
    Author Affiliations:
    • Research Institute of Electronics, Shizuoka University, Hamamatsu, Japan

Image Sensor

• sensor_type: CMOS
• resolution: 1024 (V) ×1280 (H)
• dynamic_range: Not explicitly stated
• pixel_size: 7.1 μm (H) × 7.1 μm (V)
• dark_current: Not explicitly stated

Optical Data

• focal_length: Not explicitly stated
• aperture: Not explicitly stated
• field_of_view: Not explicitly stated
• distortion: Not explicitly stated

Performance Metrics

• frame_rate: 30 fps
• signal_to_noise_ratio: 1.13 e− rms at analog gain of 64
• sensitivity: 134.8 ke−/lux·s
• shutter_speed: Not explicitly stated
• power_consumption: Not explicitly stated
• noise: 1.13 e− rms

Applications & Benefits

• cell_imaging: The sensor is used for detecting heart rates remotely by analyzing oxy-hemoglobin concentration variations in human skin.
• benefits: Non-invasive, real-time heart rate detection even under diverse ambient light conditions, compatible with automotive applications.

Supporting Organizations

• supported_by: Ministry of Education, Culture, Sports, Science and Technology, MEXT/JST COI-STREAM Program, Regional-Innovation Ecosystem Program.

Manuscript Details

• publication_date: April 2019

Relevancy Score

• score: 10
• missing_fields:
  • fill factor
  • quantum efficiency
  • readout speed
  • noise sources
  • analog-to-digital conversion techniques
  • on-chip colour filters
  • global or rolling shutters
  • backside illumination

Processed JSON Filename

request_135f81d4-9aea-4574-9b7f-6131b5431ae2-a_timeresolved_nir_lockin_pixel_cmos_image_sensor_with_background_cancelling_capability_for_remote_heart_rate_detection.json