Multimodal metadata fusion using causal strength

  title={Multimodal metadata fusion using causal strength},
  author={Yi Wu and Edward Y. Chang and Belle L. Tseng},
  booktitle={ACM Multimedia},
We propose a probabilistic framework that uses influence diagrams to fuse metadata of multiple modalities for photo annotation. We fuse contextual information (location, time, and camera parameters), visual content (holistic and local perceptual features), and semantic ontology in a synergistic way. We use causal strengths to encode causalities between variables, and between variables and semantic labels. Through analytical and empirical studies, we demonstrate that our fusion approach can… CONTINUE READING
Highly Cited
This paper has 38 citations. REVIEW CITATIONS