Live Demonstration Low Power And Realtime Obstacle Avoidance System With Cmos Image Sensor And Spiking Neural Network

• doi: 10.1109/APCCAS62602.2024.10808551
• title: Live Demonstration: Low Power and Real-Time Obstacle Avoidance System with CMOS Image Sensor and Spiking Neural Network
• publisher: IEEE
• isbn: 979-8-3503-7878-8
• issn: 2837-4576
• rank: 2890
• access_type: LOCKED
• content_type: Conferences
• abstract: This demo showcases a system that can detect obstacles and control a character in the simulator to avoid collisions in real-time. This system consists of the following components: a low-power CMOS image sensor that provides high-resolution images, a lightweight spiking neural network that uses monocular inertial-visual input to sense the depth of obstacles, and a spiking neural network accelerator that speeds up the heavy computation of the neural network. The entire system can run at 25 FPS and demonstrates the capability to avoid obstacles quickly and accurately.
• article_number: 10808551
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10808551
• html_url: https://ieeexplore.ieee.org/document/10808551/
• abstract_url: https://ieeexplore.ieee.org/document/10808551/
• publication_title: 2024 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS)
• conference_location: Taipei, Taiwan
• conference_dates: 7-9 Nov. 2024
• publication_number: 10808178
• is_number: 10808208
• publication_year: 2024
• publication_date: 7-9 Nov. 2024
• start_page: 1
• end_page: 1
• citing_paper_count: 0
• citing_patent_count: 0
• download_count: 37
• insert_date: 20241227
• index_terms:
  • ieee_terms:
    • Circuits and systems
    • Neural networks
    • Asia
    • Spiking neural networks
    • CMOS image sensors
    • Real-time systems
    • Collision avoidance
  • author_terms:
    • CMOS Image Sensor
    • Spiking Neural Network
    • Obstacle Avoidance
  • dynamic_index_terms:
    • Spiking Neural Networks
    • Spiking Neurons
    • Obstacle Avoidance
    • Obstacle Detection
    • Real-time Obstacle Avoidance
    • Raw Images
    • Optical Flow
• isbn_formats:
  • format: Print on Demand(PoD) ISBN, value: 979-8-3503-7878-8, isbnType: New-2005
  • format: Electronic ISBN, value: 979-8-3503-7877-1, isbnType: New-2005
• authors:
  • Author Name: Wei-Chi Huang
    Affiliation: College of Semiconductor Research, National Tsing Hua University, Hsinchu, Taiwan
    Author URL: https://ieeexplore.ieee.org/author/802670925647809
    ID: 802670925647809
    Order: 1
    Author Affiliations:
    • College of Semiconductor Research, National Tsing Hua University, Hsinchu, Taiwan
  • Author Name: Chen-Fu Yeh
    Affiliation: Institute of Systems Neuroscience National Tsing Hua University Hsinchu, Taiwan
    Author URL: https://ieeexplore.ieee.org/author/37088367446
    ID: 37088367446
    Order: 2
    Author Affiliations:
    • Institute of Systems Neuroscience National Tsing Hua University Hsinchu, Taiwan
  • Author Name: Po-An Chen
    Affiliation: Department of Electrical Engineering, National Tsing Hua University, Hsinchu, Taiwan
    Author URL: https://ieeexplore.ieee.org/author/522246537960461
    ID: 522246537960461
    Order: 3
    Author Affiliations:
    • Department of Electrical Engineering, National Tsing Hua University, Hsinchu, Taiwan
  • Author Name: Yu-Chih Tsai
    Affiliation: Department of Electrical Engineering, National Tsing Hua University, Hsinchu, Taiwan
    Author URL: https://ieeexplore.ieee.org/author/37089764006
    ID: 37089764006
    Order: 4
    Author Affiliations:
    • Department of Electrical Engineering, National Tsing Hua University, Hsinchu, Taiwan
  • Author Name: Kea-Tiong Tang
    Affiliation: Department of Electrical Engineering, National Tsing Hua University, Hsinchu, Taiwan
    Author URL: https://ieeexplore.ieee.org/author/37290163100
    ID: 37290163100
    Order: 5
    Author Affiliations:
    • Department of Electrical Engineering, National Tsing Hua University, Hsinchu, Taiwan

Image Sensor

• sensor_type: CMOS
• resolution: Not specified
• dynamic_range: Not specified
• pixel_size: Not specified
• dark_current: Not specified

Optical Data

• focal_length: Not specified
• aperture: Not specified
• field_of_view: Not specified
• distortion: Not specified

Performance Metrics

• frame_rate: 25 fps

Applications & Benefits

• cell_imaging: Not specified
• benefits: Low power consumption and real-time obstacle avoidance.

Supporting Organizations

• supported_by: National Tsing Hua University

Manuscript Details

• publication_date: 7-9 Nov. 2024

Relevancy Score

• score: 9
• missing_fields:
  • resolution
  • dynamic_range
  • pixel_size
  • dark_current
  • focal_length
  • aperture
  • field_of_view
  • distortion
  • signal_to_noise_ratio
  • sensitivity
  • shutter_speed
  • noise

Processed JSON Filename

request_1c0c1e67-2d71-4bfb-b950-a640ff989b90-live_demonstration_low_power_and_realtime_obstacle_avoidance_system_with_cmos_image_sensor_and_spiking_neural_network.json