Skip to main navigation Skip to search Skip to main content

Detecting figure-panel labels in medical journal articles using MRF

  • Daekeun You
  • , Sameer Antani
  • , Dina Demner-Fushman
  • , Venu Govindaraju
  • , George R. Thoma
  • SUNY Buffalo
  • National Institutes of Health

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

12 Scopus citations

Abstract

We present a method for figure-panel (subfigure) label detection and recognition in multi-panel figures extracted from biomedical articles. Figures in biomedical articles often comprise several subfigures that are identified by superimposed panel labels ('A', 'B',...) which are referenced in the figure caption and discussion in the article body. Splitting such multi-panel figures into individual subfigures is a necessary step for improved multimodal biomedical information retrieval. Prior to feature extraction for indexing and retrieval of biomedical figures it is necessary to classify image content in each subfigure by its modality (X-ray, MRI, CT, etc.) and other relevant criteria. Subfigure labels are valuable in associating individual panels with relevant text in captions and discussion. We propose a 4-step panel label detection method based on Markov Random Field (MRF). Experiments on 515 multi-panel figures and analysis of the results show promising results. We present the successes and identify critical challenges.

Original languageEnglish
Title of host publicationProceedings - 11th International Conference on Document Analysis and Recognition, ICDAR 2011
Pages967-971
Number of pages5
DOIs
StatePublished - 2011
Event11th International Conference on Document Analysis and Recognition, ICDAR 2011 - Beijing, China
Duration: Sep 18 2011Sep 21 2011

Publication series

NameProceedings of the International Conference on Document Analysis and Recognition, ICDAR
ISSN (Print)1520-5363

Conference

Conference11th International Conference on Document Analysis and Recognition, ICDAR 2011
Country/TerritoryChina
CityBeijing
Period09/18/1109/21/11

Keywords

  • belief propagation
  • CBIR
  • image binarization
  • image classification
  • image-text detection
  • Markov Random Field
  • Neural network
  • OCR

Fingerprint

Dive into the research topics of 'Detecting figure-panel labels in medical journal articles using MRF'. Together they form a unique fingerprint.

Cite this