A Cmos Image Sensorbased Stereo Matching Accelerator With Focalplane Sparse Rectification And Analog Census Transform

• doi: 10.1109/TCSI.2016.2619718
• title: A CMOS Image Sensor-Based Stereo Matching Accelerator With Focal-Plane Sparse Rectification and Analog Census Transform
• publisher: IEEE
• isbn:
• issn: 1558-0806
• rank: 563
• access_type: LOCKED
• content_type: Journals
• abstract: A low-latency and low-power stereo matching accelerator is monolithically integrated with a CMOS image sensor (CIS) for mobile applications. To reduce the overall latency, focal-plane processing is adopted by using the proposed analog census transform circuit (ACTC), and the image readout is pipelined with the following stereo matching process. In addition, a novel focal-plane rectification pixel array (FRPA) merges the rectification with the image readout without any additional processing latency. For area-efficient pixel design, sparse rectification is proposed, and the image rectification is implemented with only two additional switches in each pixel. A stereo matching digital processor (SMDP) is integrated with the CIS for cost aggregation. We present the full design including the layout with a 65 nm CMOS process, and the FRPA, the ACTC, and the SMDP achieve 11.0 ms latency with complete stereo matching stages, which is suitable for a smooth user interface. As a result, the 2-chip stereo matching system dissipates 573.9 μJ/frame and achieves 17% energy reduction compared to a previous stereo matching SoC.
• article_number: 7745972
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7745972
• html_url: https://ieeexplore.ieee.org/document/7745972/
• abstract_url: https://ieeexplore.ieee.org/document/7745972/
• publication_title: IEEE Transactions on Circuits and Systems I: Regular Papers
• conference_location:
• conference_dates:
• publication_number: 8919
• is_number: 7755810
• publication_year: 2016
• publication_date: Dec. 2016
• start_page: 2180
• end_page: 2188
• citing_paper_count: 6
• citing_patent_count: 0
• download_count: 1014
• insert_date: 20161116
• index_terms:
  • ieee_terms:
    • Transforms
    • Estimation
    • Voltage measurement
    • Distortion
    • MOSFET
    • Layout
    • Glass
  • author_terms:
    • CMOS image sensor
    • rectification
    • stereo vision
  • dynamic_index_terms:
    • Rank Transformation
    • Census Transform
    • Stereo Matching
    • Image Sensor
    • Camera Sensor
    • Image Correction
    • Image Rectification
    • CMOS Process
    • Pixel Array
    • Cost Aggregation
    • Processing Latency
    • Ms Latency
    • Imaging Readout
    • Control Signal
    • Image Pairs
    • Depth Map
    • Function Of Depth
    • Peak Signal-to-noise Ratio
    • PSNR
    • Ion Selectivity
    • Depth Estimation
    • Central Pixel
    • Head-mounted Display
    • Lower Row
    • Pixel Of Interest
    • Stereo Images
    • Matching Cost
    • Depth Error
    • Focal Length Of Lens
    • Maximum Frame Rate
    • Maximal Frame
    • Readout Circuit
    • Single Readout
    • Pipelining
    • Cured-in-place Pipe
    • Pipe Line
    • Stereo Camera
• authors:
  • Author Name: Changhyeon Kim
    Affiliation: School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
    Author URL: https://ieeexplore.ieee.org/author/37085538224
    ID: 37085538224
    Order: 1
    Author Affiliations:
    • School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
  • Author Name: Kyeongryeol Bong
    Affiliation: School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
    Author URL: https://ieeexplore.ieee.org/author/37085520085
    ID: 37085520085
    Order: 2
    Author Affiliations:
    • School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
  • Author Name: Sungpill Choi
    Affiliation: School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
    Author URL: https://ieeexplore.ieee.org/author/37085345650
    ID: 37085345650
    Order: 3
    Author Affiliations:
    • School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
  • Author Name: Kyuho Jason Lee
    Affiliation: School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
    Author URL: https://ieeexplore.ieee.org/author/37085494449
    ID: 37085494449
    Order: 4
    Author Affiliations:
    • School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
  • Author Name: Hoi-Jun Yoo
    Affiliation: School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
    Author URL: https://ieeexplore.ieee.org/author/37274307200
    ID: 37274307200
    Order: 5
    Author Affiliations:
    • School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea

Image Sensor

• sensor_type: CMOS
• resolution: 320x240
• dynamic_range: Not specified
• pixel_size: 7µm x 7µm
• dark_current: Not specified

Optical Data

• focal_length: 14 mm
• aperture: Not specified
• field_of_view: Not specified
• distortion: Not specified

Performance Metrics

• frame_rate: 60 fps
• power_consumption: 34.4 mW

Applications & Benefits

• cell_imaging: Depth estimation for hand gesture recognition in mobile applications.
• benefits: Low latency and low power consumption suitable for mobile devices.

Supporting Organizations

• supported_by: Ministry of Science, ICT and Future Planning, Korea.

Manuscript Details

• publication_date: Dec. 2016

Relevancy Score

• score: 9
• missing_fields:
  • dynamic_range
  • dark_current
  • signal_to_noise_ratio
  • noise

Processed JSON Filename

request_36834657-28ce-4b0f-81c7-c96c3e7a1457-a_cmos_image_sensorbased_stereo_matching_accelerator_with_focalplane_sparse_rectification_and_analog_census_transform.json