Skip to main navigation Skip to search Skip to main content

FlagDetSeg: Multi-Nation Flag Detection and Segmentation in the Wild

  • Shou Fang Wu
  • , Ming Ching Chang
  • , Siwei Lyu
  • , Cheng Shih Wong
  • , Abhineet Kumar Pandey
  • , Po Chi Su
  • National Central University
  • SUNY Albany
  • Academia Sinica Taiwan HQ

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

We present a simple and effective flag detection approach for multi-nation flag instance segmentation in-the-wild based on data augmentation and Mask-RCNN PointRend. To the best of our knowledge, this is the first multi-nation flag detection work incorporating recent deep object detection with code and dataset that will be released for public use. Flag images with binary segmentation are collected from public domain including the Open Image V6 and annotated for up to 225 countries. Additional flag images are generated from template flag images with cropping, warping, masking, and color adaption to hallucinate realistic-looking flag images for training and testing. Data augmentation is performed by fusing and transforming the segmented flags on top of natural image backgrounds to synthesize new images. To cope with the large variability of flags with the lack of authentic annotated flags, we combine the trained binary Mask-RCNN segmentation weights with the new multi-nation classifier for fine-tuning. For evaluation, the proposed model is compared with other popular detectors and instance segmentation methods including YOLACT++. Results show the efficacy of the proposed approach.

Original languageEnglish
Title of host publicationAVSS 2021 - 17th IEEE International Conference on Advanced Video and Signal-Based Surveillance
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665433969
DOIs
StatePublished - 2021
Event17th IEEE International Conference on Advanced Video and Signal-Based Surveillance, AVSS 2021 - Virtual, Online, United States
Duration: Nov 16 2021Nov 19 2021

Publication series

NameAVSS 2021 - 17th IEEE International Conference on Advanced Video and Signal-Based Surveillance

Conference

Conference17th IEEE International Conference on Advanced Video and Signal-Based Surveillance, AVSS 2021
Country/TerritoryUnited States
CityVirtual, Online
Period11/16/2111/19/21

Keywords

  • data augmentation
  • dataset
  • fine-tuning
  • flag detection
  • instance segmentation
  • Mask-RCNN
  • multi-nation
  • synthetic image generation

Fingerprint

Dive into the research topics of 'FlagDetSeg: Multi-Nation Flag Detection and Segmentation in the Wild'. Together they form a unique fingerprint.

Cite this