A 49Mpixel Programmableresolution Multipurpose Cmos Image Sensor For Computer Vision

• doi: 10.1109/ISSCC42614.2022.9731607
• title: A 4.9Mpixel Programmable-Resolution Multi-Purpose CMOS Image Sensor for Computer Vision
• publisher: IEEE
• isbn: 978-1-6654-2801-9
• issn: 0193-6530
• rank: 446
• access_type: LOCKED
• content_type: Conferences
• abstract: Today's mobile devices are capable of multiple tasks, including viewing and computer vision. However, these tasks are often implemented using multiple cameras due to divergent requirements, resulting in increases in form factor. Higher resolutions and frame rates are required to take pictures and video, while lower resolutions and frame rates are preferred especially for always-on computer vision to save power. To reduce the form factor, this paper presents a single-chip solution where both high-resolution viewing images and lower-resolution computer vision images are generated from one CMOS Image sensor (CIS). Full field-of-view programmable image resolutions are made possible with floating-diffusion (FD) binning through serial switches. In-frame dynamic voltage and frequency scaling (DVFS) is applied to minimize power at lower pixel resolutions and frame rates. 1/2, 1/4, 1/8, 1/16 and 1/192 binning modes are demonstrated using a $2560(\mathsf{H})\times 1920(\mathsf{V})$ pixel array that, at 1fps, consumes $790\mu\mathsf{W}$ for full-color VGA and 120µW for motion-detection (MD) mode.
• article_number: 9731607
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9731607
• html_url: https://ieeexplore.ieee.org/document/9731607/
• abstract_url: https://ieeexplore.ieee.org/document/9731607/
• publication_title: 2022 IEEE International Solid-State Circuits Conference (ISSCC)
• conference_location: San Francisco, CA, USA
• conference_dates: 20-26 Feb. 2022
• publication_number: 9731529
• is_number: 9731102
• publication_year: 2022
• publication_date: 20-26 Feb. 2022
• start_page: 104
• end_page: 106
• citing_paper_count: 6
• citing_patent_count: 0
• download_count: 1996
• insert_date: 20220317
• index_terms:
  • ieee_terms:
    • Computer vision
    • Image resolution
    • Conferences
    • Dynamics
    • Voltage
    • CMOS image sensors
    • Cameras
  • dynamic_index_terms:
    • Computer Vision
    • Low Resolution
    • Mobile Devices
    • Portable Devices
    • Deep Neural Network
    • Image Resolution
    • Dynamic Range
    • Power Consumption
    • Form Factor
    • Random Noise
    • Channel Noise
    • Frame Rate
    • Motion Detection
    • Motion Sensors
    • Supply Voltage
    • Frequency Scale
    • Period In Order
    • Periods In Order
    • High Dynamic Range
    • High-dynamic-range
    • Adjacent Nodes
    • Dynamic Scaling
    • High Frame Rate
    • Dynamic Frequency
    • Clock Frequency
• isbn_formats:
  • format: Print on Demand(PoD) ISBN, value: 978-1-6654-2801-9, isbnType: New-2005
  • format: Electronic ISBN, value: 978-1-6654-2800-2, isbnType: New-2005
• authors:
  • Author Name: Hirotaka Murakami
    Affiliation: Sony Electronics, San Jose, CA
    Author URL: https://ieeexplore.ieee.org/author/37088682062
    ID: 37088682062
    Order: 1
    Author Affiliations:
    • Sony Electronics, San Jose, CA
  • Author Name: Eric Bohannon
    Affiliation: Sony Electronics, San Jose, CA
    Author URL: https://ieeexplore.ieee.org/author/37597708900
    ID: 37597708900
    Order: 2
    Author Affiliations:
    • Sony Electronics, San Jose, CA
  • Author Name: John Childs
    Affiliation: Sony Electronics, San Jose, CA
    Author URL: https://ieeexplore.ieee.org/author/37089336705
    ID: 37089336705
    Order: 3
    Author Affiliations:
    • Sony Electronics, San Jose, CA
  • Author Name: Grace Gui
    Affiliation: Sony Electronics, San Jose, CA
    Author URL: https://ieeexplore.ieee.org/author/37089337122
    ID: 37089337122
    Order: 4
    Author Affiliations:
    • Sony Electronics, San Jose, CA
  • Author Name: Eric Moule
    Affiliation: Sony Electronics, San Jose, CA
    Author URL: https://ieeexplore.ieee.org/author/37089336584
    ID: 37089336584
    Order: 5
    Author Affiliations:
    • Sony Electronics, San Jose, CA
  • Author Name: Katsuhiko Hanzawa
    Affiliation: Sony Semiconductor Solutions, Atsugi, Japan
    Author URL: https://ieeexplore.ieee.org/author/38232173400
    ID: 38232173400
    Order: 6
    Author Affiliations:
    • Sony Semiconductor Solutions, Atsugi, Japan
  • Author Name: Tomofumi Koda
    Affiliation: Sony Electronics, San Jose, CA
    Author URL: https://ieeexplore.ieee.org/author/37089336370
    ID: 37089336370
    Order: 7
    Author Affiliations:
    • Sony Electronics, San Jose, CA
  • Author Name: Chiaki Takano
    Affiliation: Sony Semiconductor Solutions, Atsugi, Japan
    Author URL: https://ieeexplore.ieee.org/author/37089336708
    ID: 37089336708
    Order: 8
    Author Affiliations:
    • Sony Semiconductor Solutions, Atsugi, Japan
  • Author Name: Toshimasa Shimizu
    Affiliation: Sony LSI Design, Atsugi, Japan
    Author URL: https://ieeexplore.ieee.org/author/37089337057
    ID: 37089337057
    Order: 9
    Author Affiliations:
    • Sony LSI Design, Atsugi, Japan
  • Author Name: Yuki Takizawa
    Affiliation: Sony LSI Design, Atsugi, Japan
    Author URL: https://ieeexplore.ieee.org/author/37089337262
    ID: 37089337262
    Order: 10
    Author Affiliations:
    • Sony LSI Design, Atsugi, Japan
  • Author Name: Adarsh Basavalingappa
    Affiliation: Sony Electronics, San Jose, CA
    Author URL: https://ieeexplore.ieee.org/author/38244759100
    ID: 38244759100
    Order: 11
    Author Affiliations:
    • Sony Electronics, San Jose, CA
  • Author Name: Robert Childs
    Affiliation: Sony Electronics, San Jose, CA
    Author URL: https://ieeexplore.ieee.org/author/37089336308
    ID: 37089336308
    Order: 12
    Author Affiliations:
    • Sony Electronics, San Jose, CA
  • Author Name: Cody Cziesler
    Affiliation: Sony Electronics, San Jose, CA
    Author URL: https://ieeexplore.ieee.org/author/37089336576
    ID: 37089336576
    Order: 13
    Author Affiliations:
    • Sony Electronics, San Jose, CA
  • Author Name: Robert Jarnot
    Affiliation: Sony Electronics, San Jose, CA
    Author URL: https://ieeexplore.ieee.org/author/37354921800
    ID: 37354921800
    Order: 14
    Author Affiliations:
    • Sony Electronics, San Jose, CA
  • Author Name: Kazumasa Nishimura
    Affiliation: Sony LSI Design, Atsugi, Japan
    Author URL: https://ieeexplore.ieee.org/author/37089336633
    ID: 37089336633
    Order: 15
    Author Affiliations:
    • Sony LSI Design, Atsugi, Japan
  • Author Name: Scott Rogerson
    Affiliation: Sony Electronics, San Jose, CA
    Author URL: https://ieeexplore.ieee.org/author/37089337613
    ID: 37089337613
    Order: 16
    Author Affiliations:
    • Sony Electronics, San Jose, CA
  • Author Name: Yoshikazu Nitta
    Affiliation: Sony Electronics, San Jose, CA
    Author URL: https://ieeexplore.ieee.org/author/37089133076
    ID: 37089133076
    Order: 17
    Author Affiliations:
    • Sony Electronics, San Jose, CA

Image Sensor

• sensor_type: CMOS
• resolution: 2560(H)x1920(V)
• dynamic_range: 77dB
• pixel_size: not specified
• dark_current: not specified

Optical Data

• focal_length: not specified
• aperture: not specified
• field_of_view: not specified
• distortion: not specified

Performance Metrics

• frame_rate: 1fps
• power_consumption: 790μW for VGA mode at 1fps; 120μW for motion-detection mode at 1fps
• noise: 1.8e-

Applications & Benefits

• cell_imaging: not specified
• benefits: Reduces the form factor of mobile devices by enabling multiple modes: low-resolution motion detection, medium-resolution computer vision, and high-resolution viewing.

Supporting Organizations

• supported_by: Sony Semiconductor Manufacturing, Sony Semiconductor Solutions Corp., Sony LSI Design Inc., Sony Electronics Inc.

Manuscript Details

• publication_date: 20-26 Feb. 2022

Relevancy Score

• score: 9
• missing_fields:
  • pixel_size
  • dark_current
  • focal_length
  • aperture
  • field_of_view
  • distortion
  • signal_to_noise_ratio
  • sensitivity
  • shutter_speed

Processed JSON Filename

request_12b32f90-b2fe-44b9-a402-dbf07c13611f-a_49mpixel_programmableresolution_multipurpose_cmos_image_sensor_for_computer_vision.json