Corpus ID: 118697759

DocBERT: BERT for Document Classification

@article{Adhikari2019DocBERTBF,
  title={DocBERT: BERT for Document Classification},
  author={Ashutosh Adhikari and Achyudh Ram and Raphael Tang and Jimmy Lin},
  journal={ArXiv},
  year={2019},
  volume={abs/1904.08398}
}
  • Ashutosh Adhikari, Achyudh Ram, +1 author Jimmy Lin
  • Published in ArXiv 2019
  • Computer Science
  • We present, to our knowledge, the first application of BERT to document classification. A few characteristics of the task might lead one to think that BERT is not the most appropriate model: syntactic structures matter less for content categories, documents can often be longer than typical BERT input, and documents often have multiple labels. Nevertheless, we show that a straightforward classification model using BERT is able to achieve the state of the art across four popular datasets. To… CONTINUE READING

    Create an AI-powered research feed to stay up to date with new papers like this posted to ArXiv

    Figures, Tables, and Topics from this paper.

    Citations

    Publications citing this paper.
    SHOWING 1-10 OF 17 CITATIONS

    Long-length Legal Document Classification

    VIEW 4 EXCERPTS
    CITES BACKGROUND
    HIGHLY INFLUENCED

    Personalized Patent Claim Generation and Measurement

    VIEW 2 EXCERPTS
    CITES METHODS
    HIGHLY INFLUENCED

    A Joint Sentence Scoring and Selection Framework for Neural Extractive Document Summarization

    PEL-BERT: A Joint Model for Protocol Entity Linking

    VIEW 2 EXCERPTS
    CITES METHODS

    BERT with Enhanced Layer for Assistant Diagnosis Based on Chinese Obstetric EMRs

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 16 REFERENCES

    Deep contextualized word representations

    VIEW 4 EXCERPTS
    HIGHLY INFLUENTIAL

    SGM: Sequence Generation Model for Multi-label Classification

    VIEW 5 EXCERPTS
    HIGHLY INFLUENTIAL

    Convolutional Neural Networks for Sentence Classification

    VIEW 6 EXCERPTS
    HIGHLY INFLUENTIAL