Structure And Motion Estimation From Rolling Shutter Video

• doi: 10.1109/ICCVW.2011.6130217
• title: Structure and motion estimation from rolling shutter video
• publisher: IEEE
• isbn: 978-1-4673-0061-2
• issn:
• partnum: 11EX5948
• rank: 3640
• access_type: LOCKED
• content_type: Conferences
• abstract: The majority of consumer quality cameras sold today have CMOS sensors with rolling shutters. In a rolling-shutter camera, images are read out row by row, and thus each row is exposed during a different time interval. A rolling-shutter exposure causes geometric image distortions when either the camera or the scene is moving, and this causes state-of-the-art structure and motion algorithms to fail. We demonstrate a novel method for solving the structure and motion problem for rolling-shutter video. The method relies on exploiting the continuity of the camera motion, both between frames, and across a frame. We demonstrate the effectiveness of our method by controlled experiments on real video sequences. We show, both visually and quantitatively, that our method outperforms standard structure and motion, and is more accurate and efficient than a two-step approach, doing image rectification and structure and motion.
• article_number: 6130217
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6130217
• html_url: https://ieeexplore.ieee.org/document/6130217/
• abstract_url: https://ieeexplore.ieee.org/document/6130217/
• publication_title: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops)
• conference_location: Barcelona, Spain
• conference_dates: 6-13 Nov. 2011
• publication_number: 6114268
• is_number: 6130192
• publication_year: 2011
• publication_date: 6-13 Nov. 2011
• start_page: 17
• end_page: 23
• citing_paper_count: 28
• citing_patent_count: 9
• download_count: 650
• insert_date: 20120116
• index_terms:
  • ieee_terms:
    • Cameras
    • Three dimensional displays
    • Lenses
    • Sensors
    • Optimization
    • Image reconstruction
    • Robustness
  • dynamic_index_terms:
    • Motion Estimation
    • Rolling Shutter
    • Image Distortion
    • Lens Distortion
    • Radial Distortion
    • Image Deformation
    • Image Correction
    • Image Rectification
    • Geometric Distortion
    • Camera Motion
    • 3D Structure
    • Corresponding Points
    • Corresponding Features
    • Image Point
    • 3D Point
    • Camera View
    • Intrinsic Parameters
    • Correction Step
    • Camera Pose
    • Motion Components
    • Relative Pose
    • Images In Row
    • Large Baseline
    • Reprojection Error
    • Bundle Adjustment
    • Readout Time
    • Camera Rotation
    • Set Of Views
    • Outlier Rejection
• isbn_formats:
  • format: CD, value: 978-1-4673-0061-2, isbnType: New-2005
  • format: Print ISBN, value: 978-1-4673-0062-9, isbnType: New-2005
  • format: Electronic ISBN, value: 978-1-4673-0063-6, isbnType: New-2005
• authors:
  • Author Name: Johan Hedborg
    Affiliation: Computer Vision Laboratory, Department of Electrical Engineering, Linköping University, Sweden
    Author URL: https://ieeexplore.ieee.org/author/38232851200
    ID: 38232851200
    Order: 1
    Author Affiliations:
    • Computer Vision Laboratory, Department of Electrical Engineering, Linköping University, Sweden
  • Author Name: Erik Ringaby
    Affiliation: Computer Vision Laboratory, Department of Electrical Engineering, Linköping University, Sweden
    Author URL: https://ieeexplore.ieee.org/author/37547125100
    ID: 37547125100
    Order: 2
    Author Affiliations:
    • Computer Vision Laboratory, Department of Electrical Engineering, Linköping University, Sweden
  • Author Name: Per-Erik Forssén
    Affiliation: Computer Vision Laboratory, Department of Electrical Engineering, Linköping University, Sweden
    Author URL: https://ieeexplore.ieee.org/author/37424813500
    ID: 37424813500
    Order: 3
    Author Affiliations:
    • Computer Vision Laboratory, Department of Electrical Engineering, Linköping University, Sweden
  • Author Name: Michael Felsberg
    Affiliation: Computer Vision Laboratory, Department of Electrical Engineering, Linköping University, Sweden
    Author URL: https://ieeexplore.ieee.org/author/37398283600
    ID: 37398283600
    Order: 4
    Author Affiliations:
    • Computer Vision Laboratory, Department of Electrical Engineering, Linköping University, Sweden

Image Sensor

• sensor_type: CMOS
• resolution: 1280x720
• dynamic_range: not specified
• pixel_size: not specified
• dark_current: not specified

Optical Data

• focal_length: not specified
• aperture: not specified
• field_of_view: not specified
• distortion: not specified

Performance Metrics

• frame_rate: 30 fps

Applications & Benefits

• cell_imaging: not specified
• benefits: Enables digital imaging in smartphones, medical devices, and automotive systems.

Supporting Organizations

• supported_by: not specified

Manuscript Details

• publication_date: 6-13 Nov. 2011

Relevancy Score

• score: 8
• missing_fields:
  • dynamic_range
  • pixel_size
  • dark_current
  • focal_length
  • aperture
  • field_of_view
  • distortion
  • signal_to_noise_ratio
  • sensitivity
  • shutter_speed
  • power_consumption
  • noise

Processed JSON Filename

request_e7da32f5-4a32-4640-a67f-248fd401da15-structure_and_motion_estimation_from_rolling_shutter_video.json