Skip to search form
Skip to main content
Skip to account menu
Semantic Scholar
Semantic Scholar's Logo
Search 217,275,344 papers from all fields of science
Search
Sign In
Create Free Account
Transformer
Known as:
Magnetizing current
, Electrical transformer
, Primary
Expand
A transformer is an electrical device that transfers electrical energy between two or more circuits through electromagnetic induction…
Expand
Wikipedia
(opens in a new tab)
Create Alert
Alert
Related topics
Related topics
50 relations
Balanced audio
Balanced line
Booster (electric power)
Bridged T delay equaliser
Expand
Broader (1)
Electric power conversion
Papers overview
Semantic Scholar uses AI to extract papers important to this topic.
Highly Cited
2020
Highly Cited
2020
Longformer: The Long-Document Transformer
Iz Beltagy
,
Matthew E. Peters
,
Arman Cohan
arXiv.org
2020
Corpus ID: 215737171
Transformer-based models are unable to process long sequences due to their self-attention operation, which scales quadratically…
Expand
Highly Cited
2020
Highly Cited
2020
End-to-End Object Detection with Transformers
Nicolas Carion
,
Francisco Massa
,
Gabriel Synnaeve
,
Nicolas Usunier
,
Alexander Kirillov
,
Sergey Zagoruyko
European Conference on Computer Vision
2020
Corpus ID: 218889832
We present a new method that views object detection as a direct set prediction problem. Our approach streamlines the detection…
Expand
Highly Cited
2020
Highly Cited
2020
Reformer: The Efficient Transformer
Nikita Kitaev
,
Lukasz Kaiser
,
Anselm Levskaya
International Conference on Learning…
2020
Corpus ID: 209315300
Large Transformer models routinely achieve state-of-the-art results on a number of tasks but training these models can be…
Expand
Highly Cited
2020
Highly Cited
2020
Conformer: Convolution-augmented Transformer for Speech Recognition
Anmol Gulati
,
James Qin
,
+8 authors
Ruoming Pang
Interspeech
2020
Corpus ID: 218674528
Recently Transformer and Convolution neural network (CNN) based models have shown promising results in Automatic Speech…
Expand
Highly Cited
2020
Highly Cited
2020
Heterogeneous Graph Transformer
Ziniu Hu
,
Yuxiao Dong
,
Kuansan Wang
,
Yizhou Sun
The Web Conference
2020
Corpus ID: 211818229
Recent years have witnessed the emerging success of graph neural networks (GNNs) for modeling structured data. However, most GNNs…
Expand
Highly Cited
2020
Highly Cited
2020
On Layer Normalization in the Transformer Architecture
Ruibin Xiong
,
Yunchang Yang
,
+7 authors
Tie-Yan Liu
International Conference on Machine Learning
2020
Corpus ID: 211082816
The Transformer is widely used in natural language processing tasks. To train a Transformer however, one usually needs a…
Expand
Highly Cited
2019
Highly Cited
2019
Transformer-XL: Attentive Language Models beyond a Fixed-Length Context
Zihang Dai
,
Zhilin Yang
,
Yiming Yang
,
J. Carbonell
,
Quoc V. Le
,
R. Salakhutdinov
Annual Meeting of the Association for…
2019
Corpus ID: 57759363
Transformers have a potential of learning longer-term dependency, but are limited by a fixed-length context in the setting of…
Expand
Highly Cited
2019
Highly Cited
2019
Graph Transformer Networks
Seongjun Yun
,
Minbyul Jeong
,
Raehyun Kim
,
Jaewoo Kang
,
Hyunwoo J. Kim
Neural Information Processing Systems
2019
Corpus ID: 202763464
Graph neural networks (GNNs) have been widely used in representation learning on graphs and achieved state-of-the-art performance…
Expand
Highly Cited
2019
Highly Cited
2019
HuggingFace's Transformers: State-of-the-art Natural Language Processing
Thomas Wolf
,
Lysandre Debut
,
+19 authors
Alexander M. Rush
arXiv.org
2019
Corpus ID: 267921564
Recent progress in natural language processing has been driven by advances in both model architecture and model pretraining…
Expand
Highly Cited
2018
Highly Cited
2018
Image Transformer
Niki Parmar
,
Ashish Vaswani
,
+4 authors
Dustin Tran
International Conference on Machine Learning
2018
Corpus ID: 3353110
Image generation has been successfully cast as an autoregressive sequence generation or transformation problem. Recent work has…
Expand
By clicking accept or continuing to use the site, you agree to the terms outlined in our
Privacy Policy
(opens in a new tab)
,
Terms of Service
(opens in a new tab)
, and
Dataset License
(opens in a new tab)
ACCEPT & CONTINUE