• Corpus ID: 218487412

Stochastic Neighbor Embedding of Multimodal Relational Data for Image-Text Simultaneous Visualization

  title={Stochastic Neighbor Embedding of Multimodal Relational Data for Image-Text Simultaneous Visualization},
  author={Morihiro Mizutani and Akifumi Okuno and Geewook Kim and Hidetoshi Shimodaira},
Multimodal relational data analysis has become of increasing importance in recent years, for exploring across different domains of data, such as images and their text tags obtained from social networking services (e.g., Flickr). A variety of data analysis methods have been developed for visualization; to give an example, t-Stochastic Neighbor Embedding (t-SNE) computes low-dimensional feature vectors so that their similarities keep those of the observed data vectors. However, t-SNE is designed… 


Visualizing Data using t-SNE
We present a new technique called “t-SNE” that visualizes high-dimensional data by giving each datapoint a location in a two or three-dimensional map. The technique is a variation of Stochastic
m-SNE: Multiview Stochastic Neighbor Embedding
A multiview stochastic neighbor embedding that systematically integrates heterogeneous features into a unified representation for subsequent processing based on a probabilistic framework and can automatically learn a combination coefficient for each view adapted to its contribution to the data embedding.
Learning Multi-View Neighborhood Preserving Projections
We address the problem of metric learning for multi-view data, namely the construction of embedding projections from data in different representations into a shared feature space, such that the
LINE: Large-scale Information Network Embedding
A novel network embedding method called the ``LINE,'' which is suitable for arbitrary types of information networks: undirected, directed, and/or weighted, and optimizes a carefully designed objective function that preserves both the local and global network structures.
A probabilistic framework for multi-view feature learning with many-to-many associations via neural networks
PMvGE is a probabilistic model for predicting new associations via graph embedding of the nodes of data vectors with links of their associations that generalizes various existing multi-view methods such as Multiset Canonical Correlation Analysis and Cross-view Graph Embedding.
Locality preserving CCA with applications to data visualization and pose estimation
Canonical correlation analysis (CCA) is a major linear subspace approach to dimensionality reduction and has been applied to image processing, pose estimation and other fields. However, it fails to
A New Locality-Preserving Canonical Correlation Analysis Algorithm for Multi-View Dimensionality Reduction
This paper proposes an alternative formulation for integrating the neighborhood information into CCA and derive a new locality-preserving CCA algorithm called ALPCCA, which can better discover the local manifold structure of data and further enhance the discriminative power for high-dimensional classification.
Generalized Multiview Analysis: A discriminative latent space
GMA solves a joint, relaxed QCQP over different feature spaces to obtain a single (non)linear subspace and is a supervised extension of Canonical Correlational Analysis (CCA), which is useful for cross-view classification and retrieval.
GloVe: Global Vectors for Word Representation
A new global logbilinear regression model that combines the advantages of the two major model families in the literature: global matrix factorization and local context window methods and produces a vector space with meaningful substructure.
A hybrid recommendation system considering visual information for predicting favorite restaurants
This paper investigates the influence of visual information, i.e., photos taken by customers and put on blogs, on predicting favorite restaurants for any given user and advocates that, in addition to text information or metadata, restaurant attributes and user preference can both be represented by visual features.