Skip to search form
Skip to main content
Skip to account menu
Semantic Scholar
Semantic Scholar's Logo
Search 238,215,521 papers from all fields of science
Search
Sign In
Create Free Account
Lexical analysis
Known as:
Semicolon insertion
, Token splitting
, Lexical analyzer
Expand
In computer science, lexical analysis is the process of converting a sequence of characters (such as in a computer program or web page) into a…
Expand
Wikipedia
(opens in a new tab)
Create Alert
Alert
Related topics
Related topics
49 relations
.NET Compiler Platform
ALGOL
ANTLR
Atari BASIC
Expand
Broader (1)
Programming language implementation
Papers overview
Semantic Scholar uses AI to extract papers important to this topic.
2003
2003
Contractions: Breaking the Tokenization-Tagging Circularity
A. Branco
,
J. Silva
International Conference on Computational…
2003
Corpus ID: 434246
Ambiguous strings are strings of non-whitespace characters, typically coinciding with orthographic contractions of word forms…
Expand
2003
2003
GATE : A Unicode-based Infrastructure Supporting Multilingual Information Extraction
Kalina Bontcheva
,
Diana Maynard
,
V. Tablan
,
H. Cunningham
2003
Corpus ID: 18821590
NLP infrastructures with comprehensive multilingual support can substantially decrease the overhead of developing Information…
Expand
2003
2003
The LIC2M's CLEF 2003 System
Romaric Besançon
,
Gaël de Chalendar
,
Olivier Ferret
,
C. Fluhr
,
O. Mesnard
,
Hubert Naets
Conference and Labs of the Evaluation Forum
2003
Corpus ID: 9056654
For its rst birthday, the LIC2M has participated to the Small Multilingual Track of CLEF 2003. Our system is based on a deep…
Expand
2001
2001
New Directions in Middle High German Lexicography: Dictionaries Interlinked Electronically
Johannes Fournier
Literary and Linguistic Computing
2001
Corpus ID: 37086604
The paper describes the creation of a digital network of the extant Middle High German dictionaries. As these works of reference…
Expand
1999
1999
Hand-Crafted Rules
Atro Voutilainen
1999
Corpus ID: 59703961
As already stated in Chapter 8, a linguistic tagger can consist of the following modules:1 Tokenizer (identification of…
Expand
1999
1999
Structuring and expanding queries in the probabilistic model
Yasushi Ogawa
,
Hiroko Mano
,
Masumi Narita
,
Sakiko Honma
Text Retrieval Conference
1999
Corpus ID: 1823104
This is our rst participation in TREC and ve runs were submitted for the ad-hoc main task. Our system is based on our Japanese…
Expand
1999
1999
Words, lexemes, concepts : approaches to the lexicon : studies in honour of Leonhard Lipka
Wolfgang Falkner
,
H. Schmid
1999
Corpus ID: 60311118
1994
1994
The XSB Programmer's Manual Version 1.7.1
Konstantinos Sagonas
,
T. Swift
,
D. S. Warren
,
J. Freire
,
P. Rao
1994
Corpus ID: 59735167
To date (Version 1.7.1), the core engine development of the SLG-WAM has been mainly implemented by Terrance Swift, Kostis Sagonas…
Expand
1993
1993
A model checker for statecharts (linking case tools with formal methods)
N. A. Day
1993
Corpus ID: 60739372
Computer-Aided Software Engineering (CASE) tools encourage users to codify the speciication for the design of a system early in…
Expand
1989
1989
Etymologický slovník jazyka staroslověnského
B. Skalka
,
Adolf Erhart
,
E. Havlová
1989
Corpus ID: 60386858
The etymological explanation of Old Church Slavonic lexemes in alphabetical order. The publication informs about hypothetical…
Expand