Rolling Shutter Superresolution

• doi: 10.1109/ICCV.2015.71
• title: Rolling Shutter Super-Resolution
• publisher: IEEE
• isbn: 978-1-4673-8390-5
• issn: 2380-7504
• rank: 3476
• access_type: LOCKED
• content_type: Conferences
• abstract: Classical multi-image super-resolution (SR) algorithms, designed for CCD cameras, assume that the motion among the images is global. But CMOS sensors that have increasingly started to replace their more expensive CCD counterparts in many applications do not respect this assumption if there is a motion of the camera relative to the scene during the exposure duration of an image because of the row-wise acquisition mechanism. In this paper, we study the hitherto unexplored topic of multi-image SR in CMOS cameras. We initially develop an SR observation model that accounts for the row-wise distortions called the "rolling shutter" (RS) effect observed in images captured using non-stationary CMOS cameras. We then propose a unified RS-SR framework to obtain an RS-free high-resolution image (and the row-wise motion) from distorted low-resolution images. We demonstrate the efficacy of the proposed scheme using synthetic data as well as real images captured using a hand-held CMOS camera. Quantitative and qualitative assessments reveal that our method significantly advances the state-of-the-art.
• article_number: 7410428
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7410428
• html_url: https://ieeexplore.ieee.org/document/7410428/
• abstract_url: https://ieeexplore.ieee.org/document/7410428/
• publication_title: 2015 IEEE International Conference on Computer Vision (ICCV)
• conference_location: Santiago, Chile
• conference_dates: 7-13 Dec. 2015
• publication_number: 7407725
• is_number: 7410356
• publication_year: 2015
• publication_date: 7-13 Dec. 2015
• start_page: 558
• end_page: 566
• citing_paper_count: 7
• citing_patent_count: 0
• download_count: 266
• insert_date: 20160218
• index_terms:
  • ieee_terms:
    • Cameras
    • Image resolution
    • CMOS integrated circuits
    • Signal resolution
    • Charge coupled devices
    • Sensor arrays
  • dynamic_index_terms:
    • Rolling Shutter
    • High-resolution Images
    • CCD Camera
    • Charge-coupled Device
    • Image Capture
    • Low-resolution Images
    • Hand-held Camera
    • Super-resolution Algorithms
    • Super-resolution Model
    • Image Pixels
    • Single Image
    • Search Space
    • Weight Vector
    • Regular Grid
    • Cartesian Grid
    • Grid Structure
    • Rectangular Grid
    • Reference Image
    • Thick Line
    • Sensor Array
    • Discrete Space
    • Real Examples
    • Motion Estimation
    • Global Motion
    • Camera Motion
    • Camera Pose
    • Row Block
    • Sensor Plane
    • Mobile Camera
    • Mobile Phone Camera
    • Cell Phone Camera
    • Motion Blur
    • Virtual Sensors
    • 3D Rotation
    • Homography
    • Projectivity
    • Single Camera
• isbn_formats:
  • format: USB ISBN, value: 978-1-4673-8390-5, isbnType: New-2005
  • format: Electronic ISBN, value: 978-1-4673-8391-2, isbnType: New-2005
• authors:
  • Author Name: Abhijith Punnappurath
    Affiliation: Department of Electrical Engineering, Indian Institute of Technology Madras, Chennai, India
    Author URL: https://ieeexplore.ieee.org/author/37085349222
    ID: 37085349222
    Order: 1
    Author Affiliations:
    • Department of Electrical Engineering, Indian Institute of Technology Madras, Chennai, India
  • Author Name: Vijay Rengarajan
    Affiliation: Department of Electrical Engineering, Indian Institute of Technology Madras, Chennai, India
    Author URL: https://ieeexplore.ieee.org/author/37085527582
    ID: 37085527582
    Order: 2
    Author Affiliations:
    • Department of Electrical Engineering, Indian Institute of Technology Madras, Chennai, India
  • Author Name: A. N. Rajagopalan
    Affiliation: Department of Electrical Engineering, Indian Institute of Technology Madras, Chennai, India
    Author URL: https://ieeexplore.ieee.org/author/37274528800
    ID: 37274528800
    Order: 3
    Author Affiliations:
    • Department of Electrical Engineering, Indian Institute of Technology Madras, Chennai, India

Image Sensor

• sensor_type: CMOS
• resolution: Not specified
• dynamic_range: Not specified
• pixel_size: Not specified
• dark_current: Not specified

Optical Data

• focal_length: Not specified
• aperture: Not specified
• field_of_view: Not specified
• distortion: Not specified

Performance Metrics

Applications & Benefits

• cell_imaging: Applications include smartphones, medical devices, and automotive systems.
• benefits: Enables digital imaging.

Supporting Organizations

• supported_by: Department of Electrical Engineering, Indian Institute of Technology Madras, Chennai, India.

Manuscript Details

• publication_date: 7-13 Dec. 2015

Relevancy Score

• score: 8
• missing_fields:
  • resolution
  • dynamic_range
  • pixel_size
  • dark_current
  • focal_length
  • aperture
  • field_of_view
  • distortion
  • frame_rate
  • signal_to_noise_ratio
  • sensitivity
  • shutter_speed
  • power_consumption
  • noise

Processed JSON Filename

request_85020f7b-2af6-49b5-b3b6-a372f90ac0d0-rolling_shutter_superresolution.json