Highspeed Imaging Using Cmos Image Sensor With Quasi Pixelwise Exposure

• doi: 10.1109/ICCPHOT.2016.7492875
• title: High-speed imaging using CMOS image sensor with quasi pixel-wise exposure
• publisher: IEEE
• isbn: 978-1-4673-8623-4
• issn:
• rank: 2650
• access_type: LOCKED
• content_type: Conferences
• abstract: Several recent studies in compressive video sensing have realized scene capture beyond the fundamental trade-off limit between spatial resolution and temporal resolution using random space-time sampling. However, most of these studies showed results for higher frame rate video that were produced by simulation experiments or using an optically simulated random sampling camera, because there are currently no commercially available image sensors with random exposure or sampling capabilities. We fabricated a prototype complementary metal oxide semiconductor (CMOS) image sensor with quasi pixel-wise exposure timing that can realize nonuniform space-time sampling. The prototype sensor can reset exposures independently by columns and fix these amount of exposure by rows for each 8×8 pixel block. This CMOS sensor is not fully controllable via the pixels, and has line-dependent controls, but it offers flexibility when compared with regular CMOS or charge-coupled device sensors with global or rolling shutters. We propose a method to realize pseudo-random sampling for high-speed video acquisition that uses the flexibility of the CMOS sensor. We reconstruct the high-speed video sequence from the images produced by pseudo-random sampling using an over-complete dictionary. The proposed method also removes the rolling shutter effect from the reconstructed video.
• article_number: 7492875
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7492875
• html_url: https://ieeexplore.ieee.org/document/7492875/
• abstract_url: https://ieeexplore.ieee.org/document/7492875/
• publication_title: 2016 IEEE International Conference on Computational Photography (ICCP)
• conference_location: Evanston, IL, USA
• conference_dates: 13-15 May 2016
• publication_number: 7486620
• is_number: 7492855
• publication_year: 2016
• publication_date: 13-15 May 2016
• start_page: 1
• end_page: 11
• citing_paper_count: 20
• citing_patent_count: 0
• download_count: 941
• insert_date: 20160616
• index_terms:
  • ieee_terms:
    • CMOS integrated circuits
    • CMOS image sensors
    • Image reconstruction
    • Standards
    • Spatial resolution
    • Prototypes
    • Analog-digital conversion
  • dynamic_index_terms:
    • Image Sensor
    • Camera Sensor
    • High-speed Imaging
    • Spatial Resolution
    • Exposure Time
    • Random Sampling
    • Simulation Experiments
    • Frame Rate
    • High-speed Video
    • Pixel Block
    • Sensor Prototype
    • Rolling Shutter
    • Temporal Dimension
    • Time Dimension
    • Temporal Properties
    • Photodiode
    • Prior Information
    • Image Reconstruction
    • Iterative Reconstruction
    • Tomographic Reconstruction
    • Electron Charge
    • Elementary Charge
    • Temporal Information
    • Focal Plane
    • Back Focal Plane
    • Standard Imaging
    • Exposure Patterns
    • Standard Sensor
    • Sensor Design
    • Conditional Transfer
    • Transfer Status
    • Control Lines
    • State Machine
    • Finite-state
    • Finite State Machine
    • Sensor Pixel
    • Single Frame
    • Orthogonal Matching Pursuit
    • Video Capture
• isbn_formats:
  • format: Electronic ISBN, value: 978-1-4673-8623-4, isbnType: New-2005
• authors:
  • Author Name: Toshiki Sonoda
    Affiliation: Kyushu University
    Author URL: https://ieeexplore.ieee.org/author/37085807240
    ID: 37085807240
    Order: 1
    Author Affiliations:
    • Kyushu University
  • Author Name: Hajime Nagahara
    Affiliation: Kyushu University
    Author URL: https://ieeexplore.ieee.org/author/37272327500
    ID: 37272327500
    Order: 2
    Author Affiliations:
    • Kyushu University
  • Author Name: Kenta Endo
    Affiliation: Hamamatsu Photonics K. K.
    Author URL: https://ieeexplore.ieee.org/author/37085805189
    ID: 37085805189
    Order: 3
    Author Affiliations:
    • Hamamatsu Photonics K. K.
  • Author Name: Yukinobu Sugiyama
    Affiliation: Hamamatsu Photonics K. K.
    Author URL: https://ieeexplore.ieee.org/author/37555051400
    ID: 37555051400
    Order: 4
    Author Affiliations:
    • Hamamatsu Photonics K. K.
  • Author Name: Rin-ichiro Taniguchi
    Affiliation: Kyushu University
    Author URL: https://ieeexplore.ieee.org/author/37270675900
    ID: 37270675900
    Order: 5
    Author Affiliations:
    • Kyushu University

Image Sensor

• sensor_type: CMOS
• resolution: 656x496 pixels
• dynamic_range: not specified
• pixel_size: 7.4×7.4µm
• dark_current: not specified

Optical Data

• focal_length: not specified
• aperture: not specified
• field_of_view: not specified
• distortion: not specified

Performance Metrics

• frame_rate: 15 fps (up to 240 fps reconstruction)
• shutter_speed: 1/15 s (for 15 fps) and 1/240 s (for high-speed imaging)

Applications & Benefits

• cell_imaging: Not specified but implies applications in fast imaging scenarios like high-speed video capture.
• benefits: High-speed imaging capability, removal of rolling shutter effects, high spatial and temporal resolution.

Supporting Organizations

• supported_by: JSPS KAKENHI Grant Number 27 ·5055, Hamamatsu Photonics K.K.

Manuscript Details

• publication_date: 13-15 May 2016

Relevancy Score

• score: 9
• missing_fields:
  • dynamic_range
  • dark_current
  • focal_length
  • aperture
  • field_of_view
  • distortion
  • signal_to_noise_ratio
  • sensitivity
  • power_consumption
  • noise

Processed JSON Filename

request_23cd3c52-7ba6-4790-8728-0071101a1705-highspeed_imaging_using_cmos_image_sensor_with_quasi_pixelwise_exposure.json