(Q15019)

Statements

0 references
0 references
breaking a stream of text up into chunks for analysis or further processing
55
LexBib Nov 2021 stopterms
LexBib en/es 07-2022
0 references
21 August 2021
0 references
segmentació (Catalan)
COMPLETED
0 references
sõnestamine (Estonian)
COMPLETED
0 references
tilreiðing (Icelandic)
0 references
tokenizzazione (Italian)
COMPLETED
0 references
tokenizacija (Lithuanian)
COMPLETED
0 references
segmentación (Spanish)
COMPLETED
0 references
Tokenisierung (German)
COMPLETED
0 references
tokenizazio (Basque)
COMPLETED
0 references
tokenisering (Danish)
COMPLETED
0 references
tokenizacja (Polish)
0 references
tokenizare (Romanian)
COMPLETED
0 references
Токен (Russian)
AUTOMATIC
0 references
токенизација (Serbian)
COMPLETED
0 references
tokenizálás (Hungarian)
COMPLETED
0 references
tokenizacija (Montenegrin)
COMPLETED
0 references
αναγνώριση λέξεων και προτάσεων (Greek)
0 references
segmentación (Galician)
COMPLETED
0 references
tokeniseren (Dutch)
COMPLETED
0 references
tokeniseerimine (Estonian)
COMPLETED
0 references
tokenization (Italian)
COMPLETED
0 references
analizare (Romanian)
COMPLETED
0 references
identificare (Romanian)
COMPLETED
0 references
structurare (Romanian)
COMPLETED
0 references
αναγνώριση λέξεων και περιόδων (Greek)
0 references
tokenización (Galician)
COMPLETED
0 references
tokenization (Galician)
COMPLETED
0 references