Hardware Implementation Of Microlens Array Calibration For Light Field Video Processing

• doi: 10.1109/SPIN.2018.8474270
• title: Hardware implementation of microlens array calibration for light field video processing
• publisher: IEEE
• isbn: 978-1-5386-3046-4
• issn:
• rank: 2568
• access_type: LOCKED
• content_type: Conferences
• abstract: Modern microlens-array based light field cameras are capable of capturing both angular and spatial information of light, thus delivering a 2D image together with the depth information of the whole scene (4D light field). This is accomplished by placing a microlens array in front of the camera sensor, i.e. a standard CMOS sensor. A sophisticated optical design and complex post-processing algorithms are required to reconstruct the scene and to generate multiple new images with different focus depth and perspective. The calibration of the microlenses is one decisive step in the post-processing of the captured image. In this paper we present a new calibration approach suitable for efficient FPGA implementation. State-of-the-art algorithms and implementations focus on offline non-realtime processing - mainly in software - for still images. The approach presented herein substantially underlines and improves the real-time performance of a hardware implementation of 4D video content.
• article_number: 8474270
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8474270
• html_url: https://ieeexplore.ieee.org/document/8474270/
• abstract_url: https://ieeexplore.ieee.org/document/8474270/
• publication_title: 2018 5th International Conference on Signal Processing and Integrated Networks (SPIN)
• conference_location: Noida, India
• conference_dates: 22-23 Feb. 2018
• publication_number: 8447178
• is_number: 8474030
• publication_year: 2018
• publication_date: 22-23 Feb. 2018
• start_page: 380
• end_page: 384
• citing_paper_count: 1
• citing_patent_count: 0
• download_count: 94
• insert_date: 20180927
• index_terms:
  • ieee_terms:
    • Lenses
    • Microoptics
    • Calibration
    • Cameras
    • Arrays
    • Two dimensional displays
    • Field programmable gate arrays
  • dynamic_index_terms:
    • Light Field
    • Hardware Implementation
    • Microlens Array
    • Micro Lens Arrays
    • Light Field Video
    • Image Sensor
    • Camera Sensor
    • Image Capture
    • Efficient Implementation
    • Video Content
    • Still Images
    • Scene Information
    • Calibration Approach
    • Microlenses
    • Micro Lens
    • Micro-lens
    • Camera Array
    • Plenoptic Camera
    • Light Field Camera
    • Single Image
    • Local Maxima
    • Light Beam
    • Optical Beam
    • Infrared Beam
    • Coordinating Center
    • Video Frames
    • Fitting Line
    • Root Mean Square Error Of Cross-validation
    • Rotation Estimation
    • Out-of-sample Test
    • Quadratic Interpolation
    • Calibration Matrix
    • Calibration Matrices
    • Maximum Intensity Value
    • Image Calibration
    • Neighboring Values
    • Values In The Neighborhood
    • Neighbouring Values
    • Light Data
    • Rotation Correction
    • Depth Of Field
    • Depth-of-field
    • Output Image
• isbn_formats:
  • format: Print on Demand(PoD) ISBN, value: 978-1-5386-3046-4, isbnType: New-2005
  • format: CD, value: 978-1-5386-3044-0, isbnType: New-2005
  • format: Electronic ISBN, value: 978-1-5386-3045-7, isbnType: New-2005
• authors:
  • Author Name: Sven-Hendrik Voss
    Affiliation: Beuth University of Applied Sciences, Berlin
    Author URL: https://ieeexplore.ieee.org/author/37089042852
    ID: 37089042852
    Order: 1
    Author Affiliations:
    • Beuth University of Applied Sciences, Berlin
  • Author Name: Erwin Prizkau
    Affiliation: Beuth University of Applied Sciences, Berlin
    Author URL: https://ieeexplore.ieee.org/author/37086464417
    ID: 37086464417
    Order: 2
    Author Affiliations:
    • Beuth University of Applied Sciences, Berlin
  • Author Name: Marc Geh
    Affiliation: Beuth University of Applied Sciences, Berlin
    Author URL: https://ieeexplore.ieee.org/author/37086463603
    ID: 37086463603
    Order: 3
    Author Affiliations:
    • Beuth University of Applied Sciences, Berlin

Image Sensor

• sensor_type: CMOS
• resolution: 3280 x 3280 pixels
• dynamic_range: Not specified
• pixel_size: Not specified
• dark_current: Not specified

Optical Data

• focal_length: Not specified
• aperture: Not specified
• field_of_view: Not specified
• distortion: Not specified

Performance Metrics

Applications & Benefits

• cell_imaging: Not specified
• benefits: Real-time processing of light field data, supports various imaging applications including depth perception and perspective shifts.

Supporting Organizations

• supported_by: Beuth University of Applied Sciences, Lytro camera used for testing.

Manuscript Details

• publication_date: 22-23 Feb. 2018

Relevancy Score

• score: 8
• missing_fields:
  • dynamic_range
  • pixel_size
  • dark_current
  • focal_length
  • aperture
  • field_of_view
  • distortion
  • frame_rate
  • signal_to_noise_ratio
  • sensitivity
  • shutter_speed
  • power_consumption
  • noise

Processed JSON Filename

request_597fd4dc-94a8-4fac-b6e8-4a79c397f99d-hardware_implementation_of_microlens_array_calibration_for_light_field_video_processing.json