Corpus ID: 11216909

Learning to Answer Questions from Image Using Convolutional Neural Network

@inproceedings{Ma2016LearningTA,
  title={Learning to Answer Questions from Image Using Convolutional Neural Network},
  author={L. Ma and Z. Lu and Hang Li},
  booktitle={AAAI},
  year={2016}
}
  • L. Ma, Z. Lu, Hang Li
  • Published in AAAI 2016
  • Computer Science
  • In this paper, we propose to employ the convolutional neural network (CNN) for the image question answering (QA). Our proposed CNN provides an end-to-end framework with convolutional architectures for learning not only the image and question representations, but also their inter-modal interactions to produce the answer. More specifically, our model consists of three CNNs: one image CNN to encode the image content, one sentence CNN to compose the words of the question, and one multimodal… CONTINUE READING
    AnswerNet: Learning to Answer Questions
    3
    Exploring Models and Data for Image Question Answering
    418
    Ask Your Neurons: A Deep Learning Approach to Visual Question Answering
    59
    Visual Question Answering with Question Representation Update (QRU)
    52
    Open-Ended Visual Question-Answering
    6

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 69 REFERENCES
    Multimodal Convolutional Neural Networks for Matching Image and Sentence
    226
    Exploring Models and Data for Image Question Answering
    418
    Explain Images with Multimodal Recurrent Neural Networks
    273
    Are You Talking to a Machine? Dataset and Methods for Multilingual Image Question
    330
    Deep Captioning with Multimodal Recurrent Neural Networks (m-RNN)
    801
    Convolutional Neural Network for Sentence Classification
    24
    Ask Your Neurons: A Neural-Based Approach to Answering Questions about Images
    438
    Image Question Answering: A Visual Semantic Embedding Model and a New Dataset
    105
    Convolutional Neural Networks for Sentence Classification
    6404
    Show and tell: A neural image caption generator
    3306