Developing A Smart Camera For Gesture Recognition In Hci Applications

• doi: 10.1109/ISCE.2009.5156984
• title: Developing a smart camera for gesture recognition in HCI applications
• publisher: IEEE
• isbn: 978-1-4244-2976-9
• issn: 2159-1423
• partnum: 09TH9055
• rank: 2215
• access_type: LOCKED
• content_type: Conferences
• abstract: Smart cameras are becoming more popular in human computer interaction (HCI). One of HCI research areas, multimodal user interface (MMUI) allows user to interact with a computer by using his or her natural communication modalities, such as speech, pen, touch, gestures, eye gaze, and facial expression. This paper presents the hardware and software co-design and implementation of KLT (Kanade Lucas Tomasi) tracking algorithm in a FPGA-based smart camera prototype for recognize simple hand gestures consisting of a CMOS image sensor capture unit and FPGA main video processor. This tracking system uses face and hand detections as a tool to detect and track gesture (face and hand motion). This gesture tracking system that are based on Harris Keypoint Detection algorithm and KLT tracking algorithm has been successfully implemented in FPGA and shows promising result in real time performance.
• article_number: 5156984
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5156984
• html_url: https://ieeexplore.ieee.org/document/5156984/
• abstract_url: https://ieeexplore.ieee.org/document/5156984/
• publication_title: 2009 IEEE 13th International Symposium on Consumer Electronics
• conference_location: Kyoto, Japan
• conference_dates: 25-28 May 2009
• publication_number: 5109426
• is_number: 5156791
• publication_year: 2009
• publication_date: 25-28 May 2009
• start_page: 994
• end_page: 998
• citing_paper_count: 3
• citing_patent_count: 0
• download_count: 922
• insert_date: 20090706
• index_terms:
  • ieee_terms:
    • Smart cameras
    • Human computer interaction
    • Face detection
    • Karhunen-Loeve transforms
    • Field programmable gate arrays
    • Tracking
    • Motion detection
    • Application software
    • User interfaces
    • Computer interfaces
  • author_terms:
    • Smart camera
    • human computer interactions
    • gesture recognition
    • FPGA
    • embedded systems
  • dynamic_index_terms:
    • Human-computer Interaction
    • User Interaction
    • Gesture Recognition
    • Smart Cameras
    • Human-computer Interaction Applications
    • Facial Expressions
    • Tracking System
    • Tracking Devices
    • Real-time Performance
    • Real-time Processing
    • Real-time Operation
    • Eye Contact
    • Eye Gaze
    • Image Sensor
    • Camera Sensor
    • Tracking Algorithm
    • Hardware Implementation
    • Keypoint Detection
    • Multimodal Interaction
    • Multimodal Interface
    • Mean Square Error
    • Mean Square Deviation
    • Image Processing
    • Object Detection
    • Color Images
    • Complex Design
    • Development Of Platforms
    • Object Classification
    • Object Tracking
    • Previous Frame
    • Sum Of Absolute Differences
    • Current Pixel
    • Memory Resources
    • Tracking Module
    • Current Frame
    • Embedded System
    • Submodule
    • High Frame Rate
• isbn_formats:
  • format: CD, value: 978-1-4244-2976-9, isbnType: New-2005
  • format: Print ISBN, value: 978-1-4244-2975-2, isbnType: New-2005
• authors:
  • Author Name: Yean Choon Ham
    Affiliation: School of Electrical Engineering and Telecommunications, University of New South Wales, Sydney, Australia
    Author URL: https://ieeexplore.ieee.org/author/37087559260
    ID: 37087559260
    Order: 1
    Author Affiliations:
    • School of Electrical Engineering and Telecommunications, University of New South Wales, Sydney, Australia
  • Author Name: Yu Shi
    Affiliation: NICTA, Sydney, Australia
    Author URL: https://ieeexplore.ieee.org/author/37290533300
    ID: 37290533300
    Order: 2
    Author Affiliations:
    • NICTA, Sydney, Australia

Image Sensor

• sensor_type: CMOS
• resolution: 1280x1024, 640x480
• dynamic_range: not specified
• pixel_size: not specified
• dark_current: not specified

Optical Data

• focal_length: not specified
• aperture: not specified
• field_of_view: not specified
• distortion: not specified

Performance Metrics

• frame_rate: 15 fps at 1280x1024, 30 fps at 640x480
• power_consumption: low power consumption

Applications & Benefits

• cell_imaging: medical applications potentially mentioned
• benefits: lower bandwidth requirements compared to PC-based systems, simplifying application design.

Supporting Organizations

• supported_by: University of New South Wales, National ICT Australia

Manuscript Details

• publication_date: 25-28 May 2009

Relevancy Score

• score: 8
• missing_fields:
  • dynamic_range
  • dark_current
  • focal_length
  • aperture
  • field_of_view
  • distortion
  • signal_to_noise_ratio
  • sensitivity
  • shutter_speed
  • noise

Processed JSON Filename

request_159353f5-9261-4675-8050-60e988e94069-developing_a_smart_camera_for_gesture_recognition_in_hci_applications.json