Physicsguided Isodependent Sensor Noise Modeling For Extreme Lowlight Photography

• doi: 10.1109/CVPR52729.2023.00556
• title: Physics-Guided ISO-Dependent Sensor Noise Modeling for Extreme Low-Light Photography
• publisher: IEEE
• isbn: 979-8-3503-0130-4
• issn: 1063-6919
• rank: 3256
• access_type: LOCKED
• content_type: Conferences
• abstract: Although deep neural networks have achieved astonishing performance in many vision tasks, existing learningbased methods are far inferior to the physical model-based solutions in extreme low-light sensor noise modeling. To tap the potential of learning-based sensor noise modeling, we investigate the noise formation in a typical imaging process and propose a novel physics-guided ISO-dependent sensor noise modeling approach. Specifically, we build a normalizing flow-based framework to represent the complex noise characteristics of CMOS camera sensors. Each component of the noise model is dedicated to a particular kind of noise under the guidance of physical models. Moreover, we take into consideration of the ISO dependence in the noise model, which is not completely considered by the existing learning-based methods. For training the proposed noise model, a new dataset is further collected with paired noisy-clean images, as well as flat-field and bias frames covering a wide range of ISO settings. Compared to existing methods, the proposed noise model is equipped with a flexible structure and accurate modeling capabilities, which is beneficial for better denoising performance in extreme low-light scenes. The dataset and code are available at https://github.com/happycaoyue/LLD.
• article_number: 10203126
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10203126
• html_url: https://ieeexplore.ieee.org/document/10203126/
• abstract_url: https://ieeexplore.ieee.org/document/10203126/
• publication_title: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
• conference_location: Vancouver, BC, Canada
• conference_dates: 17-24 June 2023
• publication_number: 10203037
• is_number: 10203050
• publication_year: 2023
• publication_date: 17-24 June 2023
• start_page: 5744
• end_page: 5753
• citing_paper_count: 9
• citing_patent_count: 0
• download_count: 215
• insert_date: 20230822
• index_terms:
  • ieee_terms:
    • Semiconductor device modeling
    • Training
    • Photography
    • ISO
    • Computational modeling
    • Noise reduction
    • Data models
  • author_terms:
    • Low-level vision
  • dynamic_index_terms:
    • Noise Model
    • Deep Neural Network
    • Learning-based Methods
    • Learning-based Models
    • Wide Range Of Settings
    • Gaussian Noise
    • Random Noise
    • Channel Noise
    • Paired Data
    • Training Strategy
    • Training Scheme
    • Multilayer Perceptron
    • Thermal Noise
    • Current Noise
    • Clear Image
    • Shot Noise
    • Poisson Noise
    • Normal Flow
    • Ground Truth Image
    • Dark Current
    • Noisy Images
    • Zero-mean Noise
    • Noise Parameters
    • Real Noise
    • Physics-based Methods
    • Dark Noise
    • Quantization Noise
    • Starlight
    • Starlit
    • Manual Calibration
    • Noise Sources
    • Standard Normal Distribution
    • Standard Gaussian Distribution
    • Statistical Models
    • Model In Eq
    • Model Eqs
    • Noise Components
• isbn_formats:
  • format: Print on Demand(PoD) ISBN, value: 979-8-3503-0130-4, isbnType: New-2005
  • format: Electronic ISBN, value: 979-8-3503-0129-8, isbnType: New-2005
• authors:
  • Author Name: Yue Cao
    Affiliation: School of Computer Science and Technology, Harbin Institute of Technology, China
    Author URL: https://ieeexplore.ieee.org/author/37089537023
    ID: 37089537023
    Order: 1
    Author Affiliations:
    • School of Computer Science and Technology, Harbin Institute of Technology, China
  • Author Name: Ming Liu
    Affiliation: School of Computer Science and Technology, Harbin Institute of Technology, China
    Author URL: https://ieeexplore.ieee.org/author/37089316663
    ID: 37089316663
    Order: 2
    Author Affiliations:
    • School of Computer Science and Technology, Harbin Institute of Technology, China
  • Author Name: Shuai Liu
    Affiliation: School of Computer Science and Technology, Harbin Institute of Technology, China
    Author URL: https://ieeexplore.ieee.org/author/37088370786
    ID: 37088370786
    Order: 3
    Author Affiliations:
    • School of Computer Science and Technology, Harbin Institute of Technology, China
  • Author Name: Xiaotao Wang
    Affiliation: School of Computer Science and Technology, Harbin Institute of Technology, China
    Author URL: https://ieeexplore.ieee.org/author/37089496982
    ID: 37089496982
    Order: 4
    Author Affiliations:
    • School of Computer Science and Technology, Harbin Institute of Technology, China
  • Author Name: Lei Lei
    Affiliation: School of Computer Science and Technology, Harbin Institute of Technology, China
    Author URL: https://ieeexplore.ieee.org/author/37088951190
    ID: 37088951190
    Order: 5
    Author Affiliations:
    • School of Computer Science and Technology, Harbin Institute of Technology, China
  • Author Name: Wangmeng Zuo
    Affiliation: School of Computer Science and Technology, Harbin Institute of Technology, China
    Author URL: https://ieeexplore.ieee.org/author/37299957400
    ID: 37299957400
    Order: 6
    Author Affiliations:
    • School of Computer Science and Technology, Harbin Institute of Technology, China
    • Peng Cheng Laboratory, China

Image Sensor

• sensor_type: CMOS
• resolution: Not specified
• dynamic_range: Not specified
• pixel_size: Not specified
• dark_current: Not specified

Optical Data

• focal_length: Not specified
• aperture: Not specified
• field_of_view: Not specified
• distortion: Not specified

Performance Metrics

Applications & Benefits

• cell_imaging: Not specified
• benefits: Not specified

Supporting Organizations

• supported_by: Not specified

Manuscript Details

• publication_date: 17-24 June 2023

Relevancy Score

• score: 8
• missing_fields:
  • resolution
  • dynamic_range
  • power_consumption
  • focal_length
  • aperture
  • field_of_view
  • distortion
  • frame_rate
  • sensitivity
  • shutter_speed
  • dark_current
  • noise
  • cell_imaging
  • benefits
  • supported_by
  • publication_date

Processed JSON Filename

request_2f0f4a8e-66a4-450e-8919-f28ae590540e-physicsguided_isodependent_sensor_noise_modeling_for_extreme_lowlight_photography.json