Singlephoton Camera Guided Extreme Dynamic Range Imaging

• doi: 10.1109/WACV51458.2022.00012
• title: Single-Photon Camera Guided Extreme Dynamic Range Imaging
• publisher: IEEE
• isbn: 978-1-6654-0916-2
• issn: 2472-6737
• rank: 3574
• access_type: LOCKED
• content_type: Conferences
• abstract: Reconstruction of high-resolution extreme dynamic range images from a small number of low dynamic range (LDR) images is crucial for many computer vision applications. Current high dynamic range (HDR) cameras based on CMOS image sensor technology rely on multi-exposure bracketing which suffers from motion artifacts and signal-to-noise (SNR) dip artifacts in extreme dynamic range scenes. Recently, single-photon cameras (SPCs) have been shown to achieve orders of magnitude higher dynamic range for passive imaging than conventional CMOS sensors. SPCs are becoming increasingly available commercially, even in some consumer devices. Unfortunately, current SPCs suffer from low spatial resolution. To overcome the limitations of CMOS and SPC sensors, we propose a learning-based CMOS-SPC fusion method to recover high-resolution extreme dynamic range images. We compare the performance of our method against various traditional and state-of-the-art baselines using both synthetic and experimental data. Our method outperforms these baselines, both in terms of visual quality and quantitative metrics.
• article_number: 9706657
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9706657
• html_url: https://ieeexplore.ieee.org/document/9706657/
• abstract_url: https://ieeexplore.ieee.org/document/9706657/
• publication_title: 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
• conference_location: Waikoloa, HI, USA
• conference_dates: 3-8 Jan. 2022
• publication_number: 9706406
• is_number: 9706408
• publication_year: 2022
• publication_date: 3-8 Jan. 2022
• start_page: 41
• end_page: 51
• citing_paper_count: 13
• citing_patent_count: 0
• download_count: 410
• insert_date: 20220215
• index_terms:
  • ieee_terms:
    • Performance evaluation
    • Computer vision
    • Visualization
    • Dynamic range
    • CMOS image sensors
    • Sensor fusion
    • Cameras
  • author_terms:
    • Computational Photography
    • Image and Video Synthesis Image Processing
    • Image Processing -> Image Restoration
  • dynamic_index_terms:
    • Dynamic Range
    • Dynamic Imaging
    • Extreme Dynamic Range
    • Single-photon Cameras
    • Single Photon Camera
    • Spatial Resolution
    • Image Sensor
    • Camera Sensor
    • Fusion Method
    • Fusion Methods
    • Fusion Technology
    • Low Spatial Resolution
    • High Dynamic Range
    • High-dynamic-range
    • Low Dynamic Range
    • Exposure Time
    • Validation Set
    • Single Image
    • Real-world Data
    • Hallucinations
    • Visual Comparison
    • Photon Flux
    • Photon Flux Density
    • Photon Counting
    • Gaussian Approximation
    • Gaussian Estimation
    • Perceptual Loss
    • High Dynamic Range Image
    • Single-photon Avalanche Diode
    • Single Photon Avalanche Diode
    • Saturation Region
    • Incident Photon Flux
    • Incident Photon Flux Density
    • Green Crops
    • Safety-critical Applications
    • Safety Critical Applications
    • Output Pixel
    • Brightness Levels
    • Single Image Super-resolution
    • Single-image Super-resolution
    • Conventional Camera
• isbn_formats:
  • format: Print on Demand(PoD) ISBN, value: 978-1-6654-0916-2, isbnType: New-2005
  • format: Electronic ISBN, value: 978-1-6654-0915-5, isbnType: New-2005
• authors:
  • Author Name: Yuhao Liu
    Affiliation: University of Wisconsin-Madison
    Author URL: https://ieeexplore.ieee.org/author/37089302089
    ID: 37089302089
    Order: 1
    Author Affiliations:
    • University of Wisconsin-Madison
  • Author Name: Felipe Gutierrez-Barragan
    Affiliation: University of Wisconsin-Madison
    Author URL: https://ieeexplore.ieee.org/author/37087234998
    ID: 37087234998
    Order: 2
    Author Affiliations:
    • University of Wisconsin-Madison
  • Author Name: Atul Ingle
    Affiliation: University of Wisconsin-Madison
    Author URL: https://ieeexplore.ieee.org/author/37070188700
    ID: 37070188700
    Order: 3
    Author Affiliations:
    • University of Wisconsin-Madison
  • Author Name: Mohit Gupta
    Affiliation: University of Wisconsin-Madison
    Author URL: https://ieeexplore.ieee.org/author/37416652700
    ID: 37416652700
    Order: 4
    Author Affiliations:
    • University of Wisconsin-Madison
  • Author Name: Andreas Velten
    Affiliation: University of Wisconsin-Madison
    Author URL: https://ieeexplore.ieee.org/author/37545555800
    ID: 37545555800
    Order: 5
    Author Affiliations:
    • University of Wisconsin-Madison

Image Sensor

• sensor_type: CMOS
• resolution: High-resolution, exact resolution not specified
• dynamic_range: Limited compared to Single-Photon Cameras
• pixel_size: Not specified
• dark_current: Sub-electron levels in normal illumination not specified, but improved to reduce noise in modern sensors (exact measure not provided)

Optical Data

• focal_length: Not specified
• aperture: Not specified
• field_of_view: Not specified
• distortion: Not specified

Performance Metrics

• signal_to_noise_ratio: Improving due to advancements, but exact value not specified
• noise: Poisson noise is mentioned; the variance is given in context but specific values not provided.

Applications & Benefits

• cell_imaging: Used for various applications in imaging, including medical devices, although specific details not provided
• benefits: High spatial resolution, suitable for extreme dynamic range applications.

Supporting Organizations

• supported_by: Acknowledged support from U.S. Department of Energy, National Science Foundation, and UW-Madison’s Draper Technology Innovation Fund.

Manuscript Details

• publication_date: 3-8 Jan. 2022

Relevancy Score

• score: 9
• missing_fields:
  • focal_length
  • aperture
  • field_of_view
  • distortion
  • frame_rate
  • sensitivity
  • shutter_speed
  • power_consumption

Processed JSON Filename

request_7458dfe9-d7f5-4203-ab91-f1930141365b-singlephoton_camera_guided_extreme_dynamic_range_imaging.json