Nsmd Nearsensor Motion Detection With Energy Harvesting Image Sensor For Alwayson Visual Perception

• doi: 10.1109/TCSII.2021.3087840
• title: NS-MD: Near-Sensor Motion Detection With Energy Harvesting Image Sensor for Always-On Visual Perception
• publisher: IEEE
• isbn:
• issn: 1558-3791
• rank: 3081
• access_type: LOCKED
• content_type: Journals
• abstract: With the rapid development of Internet-of-Things (IoT), self-powered visual perception systems attract lots of attention. This brief presents a near-sensor motion detection architecture for the energy harvesting image sensor targeting always-on monitoring applications. Reconfigurable pixel structures are designed to harvest solar energy from the focal plane and conduct motion detection simultaneously. The near-sensor motion detection architecture combining analog-domain edge detection and digital-domain frame differencing technique is proposed to reduce the power consumption on data conversion significantly. A prototype chip of $32\times 32$ array size is fabricated with the standard $0.18~\mu \text{m}$ CMOS process. The measurement results show that the chip prototype achieves motion detection at a frame rate of 1894 fps consuming $16.43~\mu \text{W}$ power. Furthermore, the chip harvests $1.263~\mu \text{W}$ power under 100kLux illumination, and the analytical computation result shows that self-powered motion detection can be achieved at a frame rate of 58 fps.
• article_number: 9449866
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9449866
• html_url: https://ieeexplore.ieee.org/document/9449866/
• abstract_url: https://ieeexplore.ieee.org/document/9449866/
• publication_title: IEEE Transactions on Circuits and Systems II: Express Briefs
• conference_location:
• conference_dates:
• publication_number: 8920
• is_number: 9524868
• publication_year: 2021
• publication_date: Sept. 2021
• start_page: 3078
• end_page: 3082
• citing_paper_count: 12
• citing_patent_count: 0
• download_count: 1212
• insert_date: 20210609
• index_terms:
  • ieee_terms:
    • Motion detection
    • Phasor measurement units
    • Monitoring
    • Image edge detection
    • Energy harvesting
    • Transistors
    • Photodiodes
  • author_terms:
    • Always-on image sensor
    • energy harvesting
    • motion detection
    • near-sensor computing
    • near-zero power intelligent perception
  • dynamic_index_terms:
    • Visual Perception
    • Energy Harvesting
    • Image Sensor
    • Camera Sensor
    • Motion Detection
    • Motion Sensors
    • Illumination
    • Lighting
    • Power Consumption
    • Detection Techniques
    • Frame Rate
    • Focal Plane
    • Back Focal Plane
    • Edge Detection
    • Monitoring Applications
    • Solar Energy Harvesting
    • Structural Reconfiguration
    • Image Pixels
    • Solar Cells
    • Photodiode
    • Threshold Voltage
    • Supply Voltage
    • System In Mode
    • Maximum Output Power
    • Maximum Power Point Tracking
    • MPPT
    • Pixel Array
    • Pixel Data
    • Data For Each Pixel
    • Sensor Working
    • Types Of Pixels
    • Maximum Power Point
    • Image Gradient
    • Circuit Implementation
    • Successive Frames
    • Motion Energy
• authors:
  • Author Name: Maimaiti Nazhamaiti
    Affiliation: Department of Electronic Engineering and BNRist, Tsinghua University, Beijing, China
    Author URL: https://ieeexplore.ieee.org/author/37088525986
    ID: 37088525986
    Order: 1
    Author Affiliations:
    • Department of Electronic Engineering and BNRist, Tsinghua University, Beijing, China
    • Sense Lab, MakeSens IC Design Inc., Beijing, China
  • Author Name: Han Xu
    Affiliation: Department of Electronic Engineering and BNRist, Tsinghua University, Beijing, China
    Author URL: https://ieeexplore.ieee.org/author/37086593786
    ID: 37086593786
    Order: 2
    Author Affiliations:
    • Department of Electronic Engineering and BNRist, Tsinghua University, Beijing, China
    • Sense Lab, MakeSens IC Design Inc., Beijing, China
  • Author Name: Zheyu Liu
    Affiliation: Department of Electronic Engineering and BNRist, Tsinghua University, Beijing, China
    Author URL: https://ieeexplore.ieee.org/author/37085778930
    ID: 37085778930
    Order: 3
    Author Affiliations:
    • Department of Electronic Engineering and BNRist, Tsinghua University, Beijing, China
    • Sense Lab, MakeSens IC Design Inc., Beijing, China
  • Author Name: Yixuan Chen
    Affiliation: School of Communication and Electronic Engineering, East China Normal University, Shanghai, China
    Author URL: https://ieeexplore.ieee.org/author/37089178220
    ID: 37089178220
    Order: 4
    Author Affiliations:
    • School of Communication and Electronic Engineering, East China Normal University, Shanghai, China
  • Author Name: Qi Wei
    Affiliation: Department of Precision Instrument, Tsinghua University, Beijing, China
    Author URL: https://ieeexplore.ieee.org/author/37582779500
    ID: 37582779500
    Order: 5
    Author Affiliations:
    • Department of Precision Instrument, Tsinghua University, Beijing, China
  • Author Name: Xing Wu
    Affiliation: School of Communication and Electronic Engineering, East China Normal University, Shanghai, China
    Author URL: https://ieeexplore.ieee.org/author/37085466018
    ID: 37085466018
    Order: 6
    Author Affiliations:
    • School of Communication and Electronic Engineering, East China Normal University, Shanghai, China
  • Author Name: Fei Qiao
    Affiliation: Department of Electronic Engineering and BNRist, Tsinghua University, Beijing, China
    Author URL: https://ieeexplore.ieee.org/author/37272195200
    ID: 37272195200
    Order: 7
    Author Affiliations:
    • Department of Electronic Engineering and BNRist, Tsinghua University, Beijing, China
    • Sense Lab, MakeSens IC Design Inc., Beijing, China

Image Sensor

• sensor_type: CMOS
• resolution: 32x32 pixels
• dynamic_range: Not specified
• pixel_size: Not specified
• dark_current: Not specified

Optical Data

• focal_length: Not specified
• aperture: Not specified
• field_of_view: Not specified
• distortion: Not specified

Performance Metrics

• frame_rate: 1894 fps
• power_consumption: 16.43 µW

Applications & Benefits

• cell_imaging: Always-on motion detection and energy harvesting
• benefits: Extended lifetime of visual perception systems through solar energy harvesting

Supporting Organizations

• supported_by: National Natural Science Foundation of China, Beijing Innovation Center for Future Chips, Tsinghua University

Manuscript Details

• publication_date: Sept. 2021

Relevancy Score

• score: 10
• missing_fields:
  • fill factor
  • quantum efficiency
  • readout speed
  • temporal noise
  • fixed-pattern noise
  • analog-to-digital conversion techniques
  • microlenses
  • on-chip colour filters
  • global or rolling shutters
  • backside illumination

Processed JSON Filename

request_69c5b2c2-c242-4419-b106-cf1868e3dc17-nsmd_nearsensor_motion_detection_with_energy_harvesting_image_sensor_for_alwayson_visual_perception.json