Skip to main navigation Skip to search Skip to main content

InverseNet: Solving inverse problems of multimedia data with splitting networks

  • Qi Wei
  • , Kai Fan
  • , Wenlin Wang
  • , Tianhang Zheng
  • , Chakraborty Amit
  • , Katherine Heller
  • , Changyou Chen
  • , Kui Ren
  • ROAR
  • Alibaba Group Holding Ltd.
  • Duke University
  • SUNY Buffalo
  • Siemens
  • Zhejiang University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

We propose a novel network architecture, namely InverseNet, to solve the inverse problems of multimedia data. The inverse problem is cast in the form of learning an end-to-end mapping from observed multimedia data to the ground-truth data. Inspired by the splitting strategy to tackle inverse problems, the mapping is learned by InverseNet, a composition of two networks, with one handling the inversion of the physical forward model and the other handling the denoising of the output from the former network. Training InverseNet is annealing as the intermediate variable between these two networks bridges the gap between the input and output and progressively approaches to the ground-truth. Extensive experiments on synthetic and real multimedia datasets on the tasks, e.g., motion deblurring, super-resolution, and colorization, demonstrate the efficiency and accuracy of the proposed method compared with other image processing algorithms.

Original languageEnglish
Title of host publicationProceedings - 2019 IEEE International Conference on Multimedia and Expo, ICME 2019
PublisherIEEE Computer Society
Pages1324-1329
Number of pages6
ISBN (Electronic)9781538695524
DOIs
StatePublished - Jul 2019
Event2019 IEEE International Conference on Multimedia and Expo, ICME 2019 - Shanghai, China
Duration: Jul 8 2019Jul 12 2019

Publication series

NameProceedings - IEEE International Conference on Multimedia and Expo
Volume2019-July
ISSN (Print)1945-7871
ISSN (Electronic)1945-788X

Conference

Conference2019 IEEE International Conference on Multimedia and Expo, ICME 2019
Country/TerritoryChina
CityShanghai
Period07/8/1907/12/19

Keywords

  • Inverse problem
  • Splitting networks

Fingerprint

Dive into the research topics of 'InverseNet: Solving inverse problems of multimedia data with splitting networks'. Together they form a unique fingerprint.

Cite this