Dynamic Photometric Stereo Method Using Multitap Cmos Image Sensor

• doi: 10.1109/ICPR.2016.7899988
• title: Dynamic photometric stereo method using multi-tap CMOS image sensor
• publisher: IEEE
• isbn: 978-1-5090-4848-9
• issn:
• rank: 2329
• access_type: LOCKED
• content_type: Conferences
• abstract: Photometric stereo enables the estimation of surface normals from images that were captured using different known lighting directions. The classical photometric stereo method requires at least three images to determine the normals of a given scene. This method therefore cannot be applied to a dynamic scene, because it is assumed that the scene should remain static while the required images are captured. We present a dynamic photometric stereo method to estimate the surface normals in a dynamic scene. We use a multi-tap complementary metal-oxide-semiconductor (CMOS) image sensor to capture the input images for the photometric stereo method. The image sensor can divide the electrons from the photodiode of a single pixel into different taps of exposures, and can therefore capture multiple images under different lighting conditions with almost the same timing. We implemented a prototype camera that was synchronized with a lighting system, and subsequently realized photometric stereo of a dynamic scene.
• article_number: 7899988
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7899988
• html_url: https://ieeexplore.ieee.org/document/7899988/
• abstract_url: https://ieeexplore.ieee.org/document/7899988/
• publication_title: 2016 23rd International Conference on Pattern Recognition (ICPR)
• conference_location: Cancun, Mexico
• conference_dates: 4-8 Dec. 2016
• publication_number: 7893644
• is_number: 7899596
• publication_year: 2016
• publication_date: 4-8 Dec. 2016
• start_page: 2356
• end_page: 2361
• citing_paper_count: 1
• citing_patent_count: 2
• download_count: 200
• insert_date: 20170424
• index_terms:
  • ieee_terms:
    • Cameras
    • Lighting
    • Light sources
    • CMOS image sensors
    • Timing
    • Standards
  • dynamic_index_terms:
    • Image Sensor
    • Camera Sensor
    • Photometric Method
    • Photometric Stereo
    • Shape From Shading
    • Photometric Stereo Methods
    • Synchronization
    • Light Conditions
    • Input Image
    • Light System
    • Direct Light
    • Dynamic Scenes
    • Surface Normals
    • Root Mean Square Error
    • Root-mean-square Deviation
    • RMSD
    • RMSE
    • Exposure Time
    • Light Source
    • Color Images
    • Focal Length
    • Focal Distance
    • Light Beam
    • Optical Beam
    • Infrared Beam
    • High-speed Camera
    • Point Light Source
    • Normal Map
    • Standard Camera
    • Focal Length Of Lens
    • Light Sensitivity
    • Photophobic
    • Image Capture
• isbn_formats:
  • format: Print on Demand(PoD) ISBN, value: 978-1-5090-4848-9, isbnType: New-2005
  • format: Electronic ISBN, value: 978-1-5090-4847-2, isbnType: New-2005
• authors:
  • Author Name: Takuya Yoda
    Affiliation: Graduate School of Information Science and Electrical Engineering, Kyushu University, Fukuoka, Japan
    Author URL: https://ieeexplore.ieee.org/author/37086057445
    ID: 37086057445
    Order: 1
    Author Affiliations:
    • Graduate School of Information Science and Electrical Engineering, Kyushu University, Fukuoka, Japan
  • Author Name: Hajime Nagahara
    Affiliation: Graduate School of Information Science and Electrical Engineering, Kyushu University, Fukuoka, Japan
    Author URL: https://ieeexplore.ieee.org/author/37272327500
    ID: 37272327500
    Order: 2
    Author Affiliations:
    • Graduate School of Information Science and Electrical Engineering, Kyushu University, Fukuoka, Japan
  • Author Name: Rin-ichiro Taniguchi
    Affiliation: Graduate School of Information Science and Electrical Engineering, Kyushu University, Fukuoka, Japan
    Author URL: https://ieeexplore.ieee.org/author/37270675900
    ID: 37270675900
    Order: 3
    Author Affiliations:
    • Graduate School of Information Science and Electrical Engineering, Kyushu University, Fukuoka, Japan
  • Author Name: Keiichiro Kagawa
    Affiliation: Research Institute of Electronics, Shizuoka University, Shizuoka, Japan
    Author URL: https://ieeexplore.ieee.org/author/37278023200
    ID: 37278023200
    Order: 4
    Author Affiliations:
    • Research Institute of Electronics, Shizuoka University, Shizuoka, Japan
  • Author Name: Keita Yasutomi
    Affiliation: Research Institute of Electronics, Shizuoka University, Shizuoka, Japan
    Author URL: https://ieeexplore.ieee.org/author/37680557800
    ID: 37680557800
    Order: 5
    Author Affiliations:
    • Research Institute of Electronics, Shizuoka University, Shizuoka, Japan
  • Author Name: Shoji Kawahito
    Affiliation: Research Institute of Electronics, Shizuoka University, Shizuoka, Japan
    Author URL: https://ieeexplore.ieee.org/author/37300195700
    ID: 37300195700
    Order: 6
    Author Affiliations:
    • Research Institute of Electronics, Shizuoka University, Shizuoka, Japan

Image Sensor

• sensor_type: CMOS
• resolution: 413(H)×240(V)
• dynamic_range: N/A
• pixel_size: 16.8 µm×16.8 µm
• dark_current: N/A

Optical Data

• focal_length: 12.5 mm
• aperture: N/A
• field_of_view: N/A
• distortion: N/A

Performance Metrics

• frame_rate: 20 fps
• signal_to_noise_ratio: N/A
• sensitivity: N/A
• shutter_speed: 0.2 ms×40 iterations = 8 ms for each image
• power_consumption: N/A
• noise: N/A

Applications & Benefits

• cell_imaging: N/A
• benefits: High frequency details for applications like factory inspection and digital archiving.

Supporting Organizations

• supported_by: Microsoft Research CORE 11 program.

Manuscript Details

• publication_date: 4-8 Dec. 2016

Relevancy Score

• score: 10

Processed JSON Filename

request_0339015b-d6e5-4819-986e-57cb3e2629d6-dynamic_photometric_stereo_method_using_multitap_cmos_image_sensor.json