Skip to main navigation Skip to search Skip to main content

A Video Analytic System for Rail Crossing Point Protection

  • Guangliang Zhao
  • , Abhineet Kumar Pandey
  • , Ming Ching Chang
  • , Siwei Lyu
  • General Electric
  • SUNY Albany

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

6 Scopus citations

Abstract

With the rise of AI deep learning, video surveillance based on deep neural networks can provide real-time detection and tracking of vehicles and pedestrians. We present a video analytic system for monitoring railway crossing and providing security protection for rail intersections. Our system can automatically determine the rail-crossing gate status via visual detection and analyze traffic by detecting and tracking passing vehicles, thus to oversee a set of rail-transportation related safety events. Assuming a fixed camera view, each gate RoI can be manually annotated once for each site during system setup, and then gate status can be automatically detected afterwards. Vehicles are detected using YOLOv4 and multi-target tracking is performed using DeepSORT. Safety-related events including trespassing are continuously monitored using rule-based triggering. Experimental evaluation is performed on a Youtube rail crossing dataset as well as a private dataset. On the private dataset of 76 total minutes from 38 videos, our system can successfully detect all 56 events out of 58 annotated events. On the public dataset of 14.21 hrs of videos, it detects 58 out of 62 events.

Original languageEnglish
Title of host publicationAVSS 2021 - 17th IEEE International Conference on Advanced Video and Signal-Based Surveillance
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665433969
DOIs
StatePublished - 2021
Event17th IEEE International Conference on Advanced Video and Signal-Based Surveillance, AVSS 2021 - Virtual, Online, United States
Duration: Nov 16 2021 → Nov 19 2021

Publication series

NameAVSS 2021 - 17th IEEE International Conference on Advanced Video and Signal-Based Surveillance

Conference

Conference17th IEEE International Conference on Advanced Video and Signal-Based Surveillance, AVSS 2021
Country/TerritoryUnited States
CityVirtual, Online
Period11/16/21 → 11/19/21

Keywords

  • event monitoring
  • rail crossing gate
  • railway crossing
  • safety
  • surveillance
  • tracking
  • traffic analysis
  • vehicle detection
  • video analytics

Fingerprint

Dive into the research topics of 'A Video Analytic System for Rail Crossing Point Protection'. Together they form a unique fingerprint.

Cite this