Coded Rolling Shutter Photography Flexible Spacetime Sampling

• doi: 10.1109/ICCPHOT.2010.5585094
• title: Coded rolling shutter photography: Flexible space-time sampling
• publisher: IEEE
• isbn: 978-1-4244-7021-1
• issn:
• partnum: 10EX4395
• rank: 1943
• access_type: LOCKED
• content_type: Conferences
• abstract: We propose a novel readout architecture called coded rolling shutter for complementary metal-oxide semiconductor (CMOS) image sensors. Rolling shutter has traditionally been considered as a disadvantage to image quality since it often introduces skew artifact. In this paper, we show that by controlling the readout timing and the exposure length for each row, the row-wise exposure discrepancy in rolling shutter can be exploited to flexibly sample the 3D space-time volume of scene appearance, and can thus be advantageous for computational photography. The required controls can be readily implemented in standard CMOS sensors by altering the logic of the control unit. We propose several coding schemes and applications: (1) coded readout allows us to better sample time dimension for high-speed photography and optical flow based applications; and (2) row-wise control enables capturing motion-blur free high dynamic range images from a single shot. While a prototype chip is currently in development, we demonstrate the benefits of coded rolling shutter via simulation using images of real scenes.
• article_number: 5585094
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5585094
• html_url: https://ieeexplore.ieee.org/document/5585094/
• abstract_url: https://ieeexplore.ieee.org/document/5585094/
• publication_title: 2010 IEEE International Conference on Computational Photography (ICCP)
• conference_location: Cambridge, MA, USA
• conference_dates: 29-30 March 2010
• publication_number: 5551847
• is_number: 5585087
• publication_year: 2010
• publication_date: 29-30 March 2010
• start_page: 1
• end_page: 8
• citing_paper_count: 92
• citing_patent_count: 21
• download_count: 1660
• insert_date: 20100923
• index_terms:
  • ieee_terms:
    • Cameras
    • Timing
    • CMOS image sensors
    • High speed optical techniques
    • Photography
    • Optical imaging
  • dynamic_index_terms:
    • Rolling Shutter
    • Dynamic Range
    • Image Sensor
    • Camera Sensor
    • Optical Flow
    • Single Shot
    • High Dynamic Range
    • Readout Time
    • Standard Sensor
    • High Dynamic Range Image
    • Horizontal Plane
    • Horizontal Direction
    • Horizontal Distance
    • Time Lag
    • Gaussian Noise
    • Single Image
    • Membership Function
    • Image Noise
    • High-speed Camera
    • Simulated Images
    • Vertical Resolution
    • Motion Blur
    • Hand-held Camera
    • Set Of Experimental Results
    • Motion Vector
    • Cubic Interpolation
    • Intermediate Image
    • Camera Motion
    • Noise Amplification
    • Saturation Region
    • Blur Kernel
• isbn_formats:
  • format: CD, value: 978-1-4244-7021-1, isbnType: New-2005
  • format: Print ISBN, value: 978-1-4244-7022-8, isbnType: New-2005
  • format: Electronic ISBN, value: 978-1-4244-7023-5, isbnType: New-2005
• authors:
  • Author Name: Jinwei Gu
    Affiliation: Columbia University, USA
    Author URL: https://ieeexplore.ieee.org/author/38194854500
    ID: 38194854500
    Order: 1
    Author Affiliations:
    • Columbia University, USA
  • Author Name: Yasunobu Hitomi
    Affiliation: Sony Corporation, Japan
    Author URL: https://ieeexplore.ieee.org/author/38196155500
    ID: 38196155500
    Order: 2
    Author Affiliations:
    • Sony Corporation, Japan
  • Author Name: Tomoo Mitsunaga
    Affiliation: Sony Corporation, Japan
    Author URL: https://ieeexplore.ieee.org/author/37355695600
    ID: 37355695600
    Order: 3
    Author Affiliations:
    • Sony Corporation, Japan
  • Author Name: Shree Nayar
    Affiliation: Columbia University, USA
    Author URL: https://ieeexplore.ieee.org/author/37278100400
    ID: 37278100400
    Order: 4
    Author Affiliations:
    • Columbia University, USA

Image Sensor

• sensor_type: CMOS
• resolution: Not specified
• dynamic_range: High (exact value not specified)
• pixel_size: Not specified
• dark_current: Not specified

Optical Data

• focal_length: Not specified
• aperture: Not specified
• field_of_view: Not specified
• distortion: Not specified

Performance Metrics

• frame_rate: High-speed photography applications indicated (exact fps not specified)
• noise: Includes temporal noise and fixed-pattern noise mentioned but not quantified.

Applications & Benefits

• cell_imaging: Applications in smartphones, medical devices, automotive systems, and computational photography are suggested.
• benefits: Flexible space-time sampling, motion-blur free HDR imaging, improved performance in high-speed photography.

Supporting Organizations

• supported_by: Sony Corporation, National Science Foundation.

Manuscript Details

• publication_date: 29-30 March 2010

Relevancy Score

• score: 9
• missing_fields:
  • resolution
  • dynamic_range
  • pixel_size
  • dark_current
  • focal_length
  • aperture
  • field_of_view
  • distortion
  • signal_to_noise_ratio
  • sensitivity
  • shutter_speed
  • power_consumption
  • noise

Processed JSON Filename

request_815b5b54-d077-4f7e-906d-3a15dc555671-coded_rolling_shutter_photography_flexible_spacetime_sampling.json