Corpus ID: 6173444

Applying Deep Belief Networks to Word Sense Disambiguation

@article{Wiriyathammabhum2012ApplyingDB,
  title={Applying Deep Belief Networks to Word Sense Disambiguation},
  author={Peratham Wiriyathammabhum and Boonserm Kijsirikul and Hiroya Takamura and Manabu Okumura},
  journal={ArXiv},
  year={2012},
  volume={abs/1207.0396}
}
  • Peratham Wiriyathammabhum, Boonserm Kijsirikul, +1 author Manabu Okumura
  • Published in ArXiv 2012
  • Computer Science
  • In this paper, we applied a novel learning algorithm, namely, Deep Belief Networks (DBN) to word sense disambiguation (WSD). DBN is a probabilistic generative model composed of multiple layers of hidden units. DBN uses Restricted Boltzmann Machine (RBM) to greedily train layer by layer as a pretraining. Then, a separate fine tuning step is employed to improve the discriminative power. We compared DBN with various state-of-the-art supervised learning algorithms in WSD such as Support Vector… CONTINUE READING

    Citations

    Publications citing this paper.
    SHOWING 1-9 OF 9 CITATIONS

    Word sense disambiguation for Punjabi language using deep learning techniques

    VIEW 1 EXCERPT
    CITES METHODS

    Word sense disambiguation of Bangla sentences using statistical approach

    Adapting deep belief nets to Chinese entity detection

    • Yu Chen, Dequan Zheng, Tiejun Zhao
    • Computer Science
    • Proceedings 2013 International Conference on Mechatronic Sciences, Electric Engineering and Computer (MEC)
    • 2013
    VIEW 1 EXCERPT
    CITES BACKGROUND

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 22 REFERENCES

    Theano: a CPU and GPU Math Expression

    • Bergstra, James, +15 authors Yoshua
    • 2010
    VIEW 4 EXCERPTS
    HIGHLY INFLUENTIAL

    Natural Language Processing with Python

    VIEW 4 EXCERPTS
    HIGHLY INFLUENTIAL

    Bergstra , James and Breuleux , Olivier and Bastien , Frédéric and Lamblin , Pascal and Pascanu , Razvan and Desjardins , Guillaume and Turian , Joseph and Warde - Farley , David and Bengio , Yoshua

    • Chih-Chung Chang, Chih-Jen Lin
    • Theano : a CPU and GPU Math Expression Compiler . Proceedings of the Python for Scientific Computing Conference ( SciPy )
    • 2010