Design Of A High Speed 360Degree Panoramic Video Acquisition System Based On Fpga And Usb 30

• doi: 10.1109/JSEN.2016.2628240
• title: Design of a High Speed 360-degree Panoramic Video Acquisition System Based on FPGA and USB 3.0
• publisher: IEEE
• isbn:
• issn: 2379-9153
• rank: 2168
• access_type: LOCKED
• content_type: Early Access Articles
• abstract: This paper presents a FPGA-based hardware architecture for capturing real-time panoramic images and the parallel implementation of an image stitching algorithm based on the scale-invariant feature transform (SIFT) features. First, the system transfers the images captured by five CMOS sensors to the designed FPGA board through the FMC adapter plate. Then, the system employs the FPGA-based parallel computing to extract the SIFT features and detect the best matching region and points for image registration. Finally, in order to obtain the panoramic image with smooth changes at the junctions, images of the adjacent images are fused. Using the designed FPGA platform makes it possible to extract the SIFT and stitch the images in real-time, which is not realized in most panoramic imaging systems. The panoramic system, developed using the Xilinx Zynq®-7000 all programmable SOC, can capture video of 5*640*480 images at the speed of 60 fps. To enable high-speed image transfer from the imaging system to the host computer, the USB3.0 interface with the transmission speed of 359MB/s has been developed. The real-time efficiency of the parallel system will be demonstrated by the simulations and experiments.
• article_number: 7742337
• pdf_url: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7742337
• html_url: https://ieeexplore.ieee.org/document/7742337/
• abstract_url: https://ieeexplore.ieee.org/document/7742337/
• publication_title: IEEE Sensors Journal
• conference_location:
• conference_dates:
• publication_number: 7361
• is_number: 4427201
• publication_year: 2016
• publication_date:
• start_page: 1
• end_page: 1
• citing_paper_count: 8
• citing_patent_count: 0
• download_count: 833
• insert_date: 20161111
• index_terms:
  • ieee_terms:
    • Feature extraction
    • Dogs
    • Real-time systems
    • Algorithm design and analysis
    • Sensors
    • Field programmable gate arrays
    • Hardware
  • author_terms:
    • Panoramic images
    • FPGA-based parallel computing
    • Image mosaicking
    • Embedded systems
  • dynamic_index_terms:
    • Image Features
    • Imaging Characteristics
    • Parallelization
    • Parallel Computing
    • Image Registration
    • Image Matching
    • Co-registration
    • Implementation Of Algorithm
    • Real-time Performance
    • Real-time Operation
    • Real-time Processing
    • Robust Features
    • Robust Characterization
    • Line Segment
    • Parallel System
    • Analogous Systems
    • Feature Matching
    • Matching Characteristics
    • Scale-invariant Feature Transform
    • Adjacent Images
    • Panoramic Images
    • Speeded Up Robust Features
    • 360-degree Video
    • Omnidirectional Video
    • Immersive Video
    • Host PC
    • Imaging Data
    • Descriptive Characteristics
    • Feature Descriptors
    • Second Derivative
    • Second-order Derivatives
    • Gaussian Filter
    • Image Sensor
    • Camera Sensor
    • System-on-chip
    • Image Smoothing
    • Smooth Image
    • State Machine
    • Finite-state
    • Finite State Machine
    • Feature Points
    • Characteristic Points
    • Extreme Points
    • Images In Order
    • Gradient Magnitude
    • Scale Space
    • Gradient Direction
    • Camera System
• authors:
  • Author Name: Congyi Lyu
    Affiliation: Intelligent Robotics Institute, Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, State Key Laboratory of Intelligent Control and Decision of Complex Systems, School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China (e-mail: lylvcongyi@126.com)
    Author URL: https://ieeexplore.ieee.org/author/37085741684
    ID: 37085741684
    Order: 1
    Author Affiliations:
    • Intelligent Robotics Institute, Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, State Key Laboratory of Intelligent Control and Decision of Complex Systems, School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China (e-mail: lylvcongyi@126.com)
  • Author Name: Jianqing Peng
    Affiliation:
    Author URL: https://ieeexplore.ieee.org/author/37086102610
    ID: 37086102610
    Order: 2
    
  • Author Name: Weiguo Zhou
    Affiliation:
    Author URL: https://ieeexplore.ieee.org/author/37086022207
    ID: 37086022207
    Order: 3
    
  • Author Name: Shanshan Yang
    Affiliation:
    Author URL: https://ieeexplore.ieee.org/author/37086193063
    ID: 37086193063
    Order: 4
    
  • Author Name: Yunhui Liu
    Affiliation:
    Author URL: https://ieeexplore.ieee.org/author/37085480665
    ID: 37085480665
    Order: 5
    

Image Sensor

• sensor_type: CMOS
• resolution: 640(H) × 480(V)
• dynamic_range:
• pixel_size:
• dark_current:

Optical Data

• focal_length:
• aperture:
• field_of_view:
• distortion:

Performance Metrics

• frame_rate: 60 fps
• signal_to_noise_ratio:
• sensitivity:
• shutter_speed:
• power_consumption:
• noise:

Applications & Benefits

• cell_imaging:
• benefits: Used in various applications including smartphones, medical devices, and automotive systems.

Supporting Organizations

• supported_by: Shenzhen Peacock Plan Team, Shenzhen Fundamental Research, Shenzhen Key Laboratory

Manuscript Details

• publication_date: 2016-XX-XX

Relevancy Score

• score: 8
• missing_fields:
  • dynamic_range
  • pixel_size
  • dark_current
  • focal_length
  • aperture
  • field_of_view
  • distortion
  • signal_to_noise_ratio
  • sensitivity
  • shutter_speed
  • noise

Processed JSON Filename

request_34d0c289-b74b-4507-902e-7b8e74d83da5-design_of_a_high_speed_360degree_panoramic_video_acquisition_system_based_on_fpga_and_usb_30.json