Firefly Mosaic A Visionenabled Wireless Sensor Networking System

• doi: 10.1109/RTSS.2007.50
• title: FireFly Mosaic: A Vision-Enabled Wireless Sensor Networking System
• publisher: IEEE
• isbn: 978-0-7695-3062-8
• issn: 1052-8725
• partnum: 07PR3062
• rank: 2494
• access_type: LOCKED
• content_type: Conferences
• abstract: With the advent of CMOS cameras, it is now possible to make compact, cheap and low-power image sensors capable of on-board image processing. These embedded vision sensors provide a rich new sensing modality enabling new classes of wireless sensor networking applications. In order to build these applications, system designers need to overcome challenges associated with limited bandwidth, limited power, group coordination and fusing of multiple camera views with various other sensory inputs. Real-time properties must be upheld if multiple vision sensors are to process data, communicate with each other and make a group decision before the measured environmental feature changes. In this paper, we present FireFly Mosaic, a wireless sensor network image processing framework with operating system, networking and image processing primitives that assist in the development of distributed vision-sensing tasks. Each FireFly Mosaic wireless camera consists of a FireFly (Rowe et al., 2006) node coupled with a CMUcam3 (Rowe et al., 2007) embedded vision processor. The FireFly nodes run the nano-RK (Eswaran et al., 2005) real-time operating system and communicate using the RT-link (Rowe et al., 2006) collision-free TDMA link protocol. Using FireFly Mosaic, we demonstrate an assisted living application capable of fusing multiple cameras with overlapping views to discover and monitor daily activities in a home. Using this application, we show how an integrated platform with support for time synchronization, a collision-free TDMA link layer, an underlying RTOS and an interface to an embedded vision sensor provides a stable framework for distributed real-time vision processing. To the best of our knowledge, this is the first wireless sensor networking system to integrate multiple coordinating cameras performing local processing.
• article_number: 4408328
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=4408328
• html_url: https://ieeexplore.ieee.org/document/4408328/
• abstract_url: https://ieeexplore.ieee.org/document/4408328/
• publication_title: 28th IEEE International Real-Time Systems Symposium (RTSS 2007)
• conference_location: Tucson, AZ, USA
• conference_dates: 3-6 Dec. 2007
• publication_number: 4408277
• is_number: 4408278
• publication_year: 2007
• publication_date: 3-6 Dec. 2007
• start_page: 459
• end_page: 468
• citing_paper_count: 66
• citing_patent_count: 3
• download_count: 571
• insert_date: 20071226
• index_terms:
  • ieee_terms:
    • Wireless sensor networks
    • Sensor systems
    • Cameras
    • Image processing
    • CMOS image sensors
    • Operating systems
    • Time division multiple access
    • CMOS process
    • Image sensors
    • Bandwidth
  • dynamic_index_terms:
    • Firefly
    • Sensor Networks
    • Wireless Sensor Networks
    • Image Processing
    • Visual Processing
    • Wireless Networks
    • Image Sensor
    • Camera Sensor
    • Time Synchronization
    • Vision Sensors
    • Multiple Cameras
    • Link Layer
    • Field Of View
    • Apartment
    • Level Of Quality
    • Point System
    • Gaussian Mixture Model
    • Active Clusters
    • Image Capture
    • Efficient Communication
    • Transfer Time
    • Global Synchronization
    • Global Synchrony
    • Single Camera
    • JPEG Compression
    • Start Of Cycle
    • Start Of Each Cycle
    • Objects In The Scene
    • Timing Jitter
    • Local Communication
    • Home Activities
    • Flash Memory
    • Flash Storage
    • Network Bandwidth
    • Data Bandwidth
    • Modulation Bandwidth
    • Internet Bandwidth
• isbn_formats:
  • format: Print ISBN, value: 978-0-7695-3062-8, isbnType: New-2005
  • format: Print ISBN, value: 0-7695-3062-1, isbnType: Historical
• authors:
  • Author Name: Anthony Rowe
    Affiliation: Department of Electrical & Computer Engineering, Carnegie Mellon University, USA
    Author URL: https://ieeexplore.ieee.org/author/37324658900
    ID: 37324658900
    Order: 1
    Author Affiliations:
    • Department of Electrical & Computer Engineering, Carnegie Mellon University, USA
  • Author Name: Dhiraj Goel
    Affiliation: Department of Electrical & Computer Engineering, Carnegie Mellon University, USA
    Author URL: https://ieeexplore.ieee.org/author/37837236500
    ID: 37837236500
    Order: 2
    Author Affiliations:
    • Department of Electrical & Computer Engineering, Carnegie Mellon University, USA
  • Author Name: Raj Rajkumar
    Affiliation: Department of Electrical & Computer Engineering, Carnegie Mellon University, USA
    Author URL: https://ieeexplore.ieee.org/author/37268048500
    ID: 37268048500
    Order: 3
    Author Affiliations:
    • Department of Electrical & Computer Engineering, Carnegie Mellon University, USA

Image Sensor

• sensor_type: CMOS
• resolution: 352x288 (QCIF)
• dynamic_range: Not specified
• pixel_size: Not specified
• dark_current: Not specified

Optical Data

• focal_length: Not specified
• aperture: Not specified
• field_of_view: Not specified
• distortion: Not specified

Performance Metrics

• frame_rate: 30 fps
• power_consumption: 125 mW for camera, 572.3 mW total in active state

Applications & Benefits

• cell_imaging: Used for assisted living application to monitor daily activities in the home, helping with elder care.
• benefits: Low-cost, energy-efficient, and scalable solution for distributed visual sensor networks.

Supporting Organizations

• supported_by: Carnegie Mellon University (CMU)

Manuscript Details

• publication_date: 3-6 Dec. 2007

Relevancy Score

• score: 9
• missing_fields:
  • dynamic_range
  • pixel_size
  • dark_current
  • focal_length
  • aperture
  • field_of_view
  • distortion
  • signal_to_noise_ratio
  • sensitivity
  • noise

Processed JSON Filename

request_36b3dd59-a231-4d48-a4cf-f75400a6bc2d-firefly_mosaic_a_visionenabled_wireless_sensor_networking_system.json