Skip to search formSkip to main contentSkip to account menu

Lexical analysis

Known as: Semicolon insertion, Token splitting, Lexical analyzer 
In computer science, lexical analysis is the process of converting a sequence of characters (such as in a computer program or web page) into a… 
Wikipedia (opens in a new tab)

Related topics

Related topics

49 relations
.NET Compiler PlatformALGOLANTLRAtari BASIC

Broader (1)

Programming language implementation

Papers overview

Semantic Scholar uses AI to extract papers important to this topic.
2012
2012
PoliMorf: a (not so) new open morphological dictionary for Polish
This paper presents preliminary results of an effort aiming at the creation of a morphological dictionary of Polish, PoliMorf… 
Highly Cited
2007
Highly Cited
2007
The influence of semantic transparency on eye movements during English compound word recognition
2007
2007
IceNLP: a natural language processing toolkit for icelandic
Icelandic is a morphologically complex language, for which language technology resources are scarce. Only a few years ago, it… 
2006
2006
Open Source Corpus Analysis Tools for Malay
Tokenisers, lemmatisers and POS taggers are vital to the linguistic and digital furtherment of any language. In this paper, we… 
2006
2006
A Historical Dictionary of Yukaghir
Tundra and Kolyma Yukaghir are highly endangered languages spoken in the extreme North-East of Siberia and usually considered… 
2003
2003
Language identification using parallel sub-word recognition
Parallel sub-word recognition (PSWR) is a new model that has been proposed for language identification (LID) which does not need… 
2001
2001
Towards a Lexicographic Approach to Lexical Transfer in Machine Translation (Illustrated by the German–Russian Language Pair)
The translation of lexical items is still a formidableobstacle in the field of Machine Translation. The present articleaddresses… 
2000
2000
Using a Large Set of EAGLES-compliant Morpho-syntactic Descriptors as a Tagset for Probabilistic Tagging
The paper presents one way of reconciling data sparseness with the requirement of high accuracy tagging in terms of fine-grained… 
1998
1998
Les comités d'entreprise face aux licenciements collectifs : trois registres d'argumentation
La jurisprudence sur les plans sociaux est utilisee comme un instrument permettant de degager une pluralite de modeles d'action… 
1991
1991
Relation grammars and their application to multi-dimensional languages
By clicking accept or continuing to use the site, you agree to the terms outlined in our Privacy Policy (opens in a new tab), Terms of Service (opens in a new tab), and Dataset License (opens in a new tab)