An Efficient Approach to Informative Feature Extraction from Multimodal Data

@article{Wang2019AnEA,
  title={An Efficient Approach to Informative Feature Extraction from Multimodal Data},
  author={L. Wang and J. Wu and Shao-Lun Huang and L. Zheng and Xiangxiang Xu and Lin Zhang and J. Huang},
  journal={ArXiv},
  year={2019},
  volume={abs/1811.08979}
}
One primary focus in multimodal feature extraction is to find the representations of individual modalities that are maximally correlated. [...] Key Method Specifically, our framework prevents the "hard" whitening constraints, while simultaneously preserving the same feature geometry as in the HGR maximal correlation. The objective of Soft-HGR is straightforward, only involving two inner products, which guarantees the efficiency and stability in optimization.Expand
View PDF on arXiv
17 Citations
Highly Influential Citations
2
Background Citations
6
Methods Citations
10

17 Citations

Citation Type

Citation Type

TCGM: An Information-Theoretic Framework for Semi-Supervised Multi-Modality Learning
  • 2
  • Highly Influenced
  • PDF
Semantically Supervised Maximal Correlation For Cross-Modal Retrieval
An Information-Theoretic Approach to Unsupervised Feature Selection for High-Dimensional Data
  • 1
Knowledge As Priors: Cross-Modal Knowledge Generalization for Datasets Without Superior Knowledge
  • 9
  • PDF
An End-to-End Learning Approach for Multimodal Emotion Recognition: Extracting Common and Private Information
Generalizing Correspondence Analysis for Applications in Machine Learning
  • 1
  • PDF
An Information-Theoretic Approach to Transferability in Task Transfer Learning
  • 5
Multimodal Emotion Recognition by extracting common and modality-specific information
  • 3
  • PDF
Correlated Embeddings of Pairs of Dependent Random Variables
  • 1
On the Sample Complexity of HGR Maximal Correlation Functions for Large Datasets
...
1
2
...

References

SHOWING 1-10 OF 45 REFERENCES
Improved Multimodal Deep Learning with Variation of Information
  • 147
  • PDF
Multimodal learning with deep Boltzmann machines
  • 1,347
  • PDF
Heterogeneous Feature Selection With Multi-Modal Deep Neural Networks and Sparse Group LASSO
  • 53
  • PDF
Multimodal Machine Learning: A Survey and Taxonomy
  • 648
  • PDF
DeViSE: A Deep Visual-Semantic Embedding Model
  • 1,559
  • PDF
Deep Canonical Correlation Analysis
  • 992
  • PDF
An information-theoretic approach to universal feature selection in high-dimensional inference
  • 21
  • PDF
Correlational Neural Networks
  • 101
  • PDF
Scalable and Effective Deep CCA via Soft Decorrelation
  • 25
  • PDF
Adam: A Method for Stochastic Optimization
  • 61,253
  • PDF
...
1
2
3
4
5
...