Synthesis Of Lightfield Raw Data From Rgbd Images

• doi: 10.1109/ICIP.2015.7351040
• title: Synthesis of light-field raw data from RGB-D images
• publisher: IEEE
• isbn: 978-1-4799-8338-4
• issn:
• rank: 3692
• access_type: LOCKED
• content_type: Conferences
• abstract: Image raw data captured by light-field cameras such as Lytro and Raytrix have been strictly protected by the manufacturers, which results in a serious hurdle to most academic researchers working in this area. In this paper, we make an attempt of developing an algorithm that can generate light-field raw data from a single input picture captured by a conventional camera together with its depth map. Our algorithm follows closely the imaging procedure of the light-field camera with micro lens, with certain simplification. Specifically, an input image (of size W × H) will be projected to a light-field data of size (M × P) × (N × P), assuming that the micro-lens array has size M × N micro lens and each micro lens is supported by P × P sensors. In our work, the main lens is partitioned into K × K cells, each pixel of the input picture is assumed to locate at certain distance from the main lens and regarded as a lighting source. The directional light emitted from each pixel goes through the main lens and the corresponding micro-lens to be recorded at a particular sensor in the CMOS array. We will derive the geometry of this imaging process as well as the intensity recorded at each sensor. We choose to run the refocusing algorithm to verify whether the light-field data generated by our algorithm is meaningful or not. Comparing the refocused images against the original input picture shows that our synthesis algorithm seems quite successful.
• article_number: 7351040
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7351040
• html_url: https://ieeexplore.ieee.org/document/7351040/
• abstract_url: https://ieeexplore.ieee.org/document/7351040/
• publication_title: 2015 IEEE International Conference on Image Processing (ICIP)
• conference_location: Quebec City, QC, Canada
• conference_dates: 27-30 Sept. 2015
• publication_number: 7328364
• is_number: 7350743
• publication_year: 2015
• publication_date: 27-30 Sept. 2015
• start_page: 1448
• end_page: 1452
• citing_paper_count: 3
• citing_patent_count: 0
• download_count: 382
• insert_date: 20151210
• index_terms:
  • ieee_terms:
    • Lenses
    • Cameras
    • Sensor arrays
    • Light sources
  • author_terms:
    • light-field data
    • micro lens
    • RGB-D
    • refocusing
  • dynamic_index_terms:
    • Light Field
    • RGB-D Images
    • Light Source
    • Input Image
    • Depth Map
    • Function Of Depth
    • Direct Light
    • Microlenses
    • Micro Lens
    • Conventional Camera
    • Camera Array
    • Plenoptic Camera
    • Light Field Camera
    • Microlens Array
    • Micro Lens Arrays
    • Synthesis Algorithm
    • Area Of Research
    • Image Pixels
    • Inner Layer
    • Projection Matrix
    • Matrix Operations
    • Projection Matrices
    • Light Images
    • Depth Values
    • Spherical Surface
    • Focal Length Of Lens
    • Lens Thickness
    • Light Data
    • Sensor Plane
    • Light Rays
    • Ray Optics
    • Real Field
    • Array Size
• isbn_formats:
  • format: USB ISBN, value: 978-1-4799-8338-4, isbnType: New-2005
  • format: Electronic ISBN, value: 978-1-4799-8339-1, isbnType: New-2005
• authors:
  • Author Name: Chao Sun
    Affiliation: University of Electronic Science and Technology of China, School of Electronic Engineering, Chengdu, China
    Author URL: https://ieeexplore.ieee.org/author/38489752000
    ID: 38489752000
    Order: 1
    Author Affiliations:
    • University of Electronic Science and Technology of China, School of Electronic Engineering, Chengdu, China
  • Author Name: Yiqun Wu
    Affiliation: Hongkong University of Science and Technology, Department of Electronic and Computer Engineering, Hongkong, China
    Author URL: https://ieeexplore.ieee.org/author/37086070338
    ID: 37086070338
    Order: 2
    Author Affiliations:
    • Hongkong University of Science and Technology, Department of Electronic and Computer Engineering, Hongkong, China
  • Author Name: Bing Zeng
    Affiliation: University of Electronic Science and Technology of China, School of Electronic Engineering, Chengdu, China
    Author URL: https://ieeexplore.ieee.org/author/37270871000
    ID: 37270871000
    Order: 3
    Author Affiliations:
    • University of Electronic Science and Technology of China, School of Electronic Engineering, Chengdu, China
    • Department of Electronic and Computer Engineering, Hongkong University of Science and Technology, Hongkong, China

Image Sensor

• sensor_type: CMOS
• resolution: Variable (not specified)
• dynamic_range: Not specified
• pixel_size: Not specified
• dark_current: Not specified

Optical Data

• focal_length: Not specified
• aperture: Not specified
• field_of_view: Not specified
• distortion: Not specified

Performance Metrics

Applications & Benefits

• cell_imaging: Not specified
• benefits: Not specified

Supporting Organizations

• supported_by: Not specified

Manuscript Details

• publication_date: 27-30 Sept. 2015

Relevancy Score

• score: 7
• missing_fields:
  • resolution
  • dynamic_range
  • pixel_size
  • dark_current
  • focal_length
  • aperture
  • field_of_view
  • distortion
  • frame_rate
  • signal_to_noise_ratio
  • sensitivity
  • shutter_speed
  • power_consumption
  • noise
  • cell_imaging
  • benefits
  • supported_by

Processed JSON Filename

request_b36d1df5-3c66-430a-b6b1-02523b420d06-synthesis_of_lightfield_raw_data_from_rgbd_images.json