Highspeed Videography Using A Dense Camera Array

• doi: 10.1109/CVPR.2004.1315176
• title: High-speed videography using a dense camera array
• publisher: IEEE
• isbn: 0-7695-2158-4
• issn: 1063-6919
• rank: 2654
• access_type: LOCKED
• content_type: Conferences
• abstract: We demonstrate a system for capturing multi-thousand frame-per-second (fps) video using a dense array of cheap 30 fps CMOS image sensors. A benefit of using a camera array to capture high-speed video is that we can scale to higher speeds by simply adding more cameras. Even at extremely high frame rates, our array architecture supports continuous streaming to disk from all of the cameras. This allows us to record unpredictable events, in which nothing occurs before the event of interest that could be used to trigger the beginning of recording. Synthesizing one high-speed video sequence using images from an array of cameras requires methods to calibrate and correct those cameras' varying radiometric and geometric properties. We assume that our scene is either relatively planar or is very far away from the camera and that the images can therefore be aligned using projective transforms. We analyze the errors from this assumption and present methods to make them less visually objectionable. We also present a new method to automatically color match our sensors. Finally, we demonstrate how to compensate for spatial and temporal distortions caused by the electronic rolling shutter, a common feature of low-end CMOS sensors.
• article_number: 1315176
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=1315176
• html_url: https://ieeexplore.ieee.org/document/1315176/
• abstract_url: https://ieeexplore.ieee.org/document/1315176/
• publication_title: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004.
• conference_location: Washington, DC, USA
• conference_dates: 27 June-2 July 2004
• publication_number: 9183
• is_number: 29134
• publication_year: 2004
• publication_date: 27 June-2 July 2004
• start_page: II
• end_page: II
• citing_paper_count: 73
• citing_patent_count: 173
• download_count: 1256
• insert_date: 20040719
• index_terms:
  • ieee_terms:
    • Cameras
    • Sensor arrays
    • CMOS image sensors
    • Streaming media
    • Disk recording
    • Video recording
    • Video sequences
    • Radiometry
    • Layout
    • Error analysis
  • dynamic_index_terms:
    • Camera Array
    • Plenoptic Camera
    • Light Field Camera
    • High-speed Videography
    • Event Of Interest
    • Effect Of Interest
    • Frame Rate
    • Geometric Properties
    • Geometric Dimensions
    • Image Sensor
    • Camera Sensor
    • High-speed Video
    • Rolling Shutter
    • Exposure Time
    • Sample Holder
    • Focal Plane
    • Back Focal Plane
    • Focal Length
    • Focal Distance
    • Line Scan
    • High-speed Camera
    • Light Field
    • Depth Of Field
    • Video Capture
    • Trigger Signal
    • Single Camera
    • Alignment Errors
    • Object Plane
    • Exposure Window
    • Multiple Cameras
    • Triggering Time
    • Homography
    • Projectivity
    • Color Response
    • Camera Exposure
    • Tight Packing
    • Dynamic Range
• isbn_formats:
  • format: Print ISBN, value: 0-7695-2158-4, isbnType: Historical
• authors:
  • Author Name: B. Wilburn
    Affiliation: Department of Electrical Engineering, University of Stanford, Stanford, CA, USA
    Author URL: https://ieeexplore.ieee.org/author/37282932500
    ID: 37282932500
    Order: 1
    Author Affiliations:
    • Department of Electrical Engineering, University of Stanford, Stanford, CA, USA
  • Author Name: N. Joshi
    Affiliation: Department of Computer Science, University of Stanford, Stanford, CA, USA
    Author URL: https://ieeexplore.ieee.org/author/37270908500
    ID: 37270908500
    Order: 2
    Author Affiliations:
    • Department of Computer Science, University of Stanford, Stanford, CA, USA
  • Author Name: V. Vaish
    Affiliation: Department of Computer Science, University of Stanford, Stanford, CA, USA
    Author URL: https://ieeexplore.ieee.org/author/37272722200
    ID: 37272722200
    Order: 3
    Author Affiliations:
    • Department of Computer Science, University of Stanford, Stanford, CA, USA
  • Author Name: M. Levoy
    Affiliation: Department of Computer Science, University of Stanford, Stanford, CA, USA
    Author URL: https://ieeexplore.ieee.org/author/37282931600
    ID: 37282931600
    Order: 4
    Author Affiliations:
    • Department of Computer Science, University of Stanford, Stanford, CA, USA
  • Author Name: M. Horowitz
    Affiliation: Department of Electrical Engineering, University of Stanford, Stanford, CA, USA
    Author URL: https://ieeexplore.ieee.org/author/37270364000
    ID: 37270364000
    Order: 5
    Author Affiliations:
    • Department of Electrical Engineering, University of Stanford, Stanford, CA, USA

Image Sensor

• sensor_type: CMOS
• resolution: 640x480
• dynamic_range: not specified
• pixel_size: 6.2µm
• dark_current: not specified

Optical Data

• focal_length: 6mm
• aperture: not specified
• field_of_view: not specified
• distortion: not specified

Performance Metrics

• frame_rate: 1560fps
• shutter_speed: 1/1560s or less

Applications & Benefits

• cell_imaging: not specified
• benefits: Enable high-speed video capture, allows continuous streaming of data, supports various imaging applications.

Supporting Organizations

• supported_by: DARPA, NSF

Manuscript Details

• publication_date: 27 June-2 July 2004

Relevancy Score

• score: 9
• missing_fields:
  • dynamic_range
  • dark_current
  • fill_factor
  • quantum_efficiency
  • power_consumption
  • shutter_speed
  • sensitivity
  • noise

Processed JSON Filename

request_c0bb52d3-bced-4831-adb3-94591cacf8ed-highspeed_videography_using_a_dense_camera_array.json