tokenization (Q15019): Difference between revisions

From LexBib
(‎Added qualifier: translation status (P128): TO CHECK)
(‎Created claim: prefLabel translation (P129): segmentación)
Property / prefLabel translation
 
segmentación (Galician)
Property / prefLabel translation: segmentación (Galician) / rank
 
Normal rank

Revision as of 10:57, 6 July 2022

a term
Language Label Description Also known as
English
tokenization
a term

    Statements

    0 references
    0 references
    breaking a stream of text up into chunks for analysis or further processing
    45
    LexBib Aug 2021
    LexBib Oct 2021
    LexBib Oct 2021 stopterms
    LexBib Nov 2021 stopterms
    0 references
    53
    LexBib en/es 12-2021
    0 references
    21 August 2021
    0 references
    segmentació (Catalan)
    COMPLETED
    0 references
    sõnestamine (Estonian)
    COMPLETED
    0 references
    tilreiðing (Icelandic)
    0 references
    tokenizzazione (Italian)
    COMPLETED
    0 references
    tokenizacija (Lithuanian)
    COMPLETED
    0 references
    segmentación (Spanish)
    COMPLETED
    0 references
    Tokenisierung (German)
    COMPLETED
    0 references
    tokenizazio (Basque)
    COMPLETED
    0 references
    tokenisering (Danish)
    COMPLETED
    0 references
    tokenizacja (Polish)
    0 references
    tokenizare (Romanian)
    COMPLETED
    0 references
    Токен (Russian)
    AUTOMATIC
    0 references
    токенизација (Serbian)
    0 references
    tokenizálás (Hungarian)
    COMPLETED
    0 references
    tokenizacija (Montenegrin)
    COMPLETED
    0 references
    αναγνώριση λέξεων και προτάσεων (Greek)
    0 references
    segmentación (Galician)
    0 references
    tokeniseerimine (Estonian)
    COMPLETED
    0 references
    tokenization (Italian)
    COMPLETED
    0 references
    analizare (Romanian)
    COMPLETED
    0 references
    identificare (Romanian)
    COMPLETED
    0 references
    structurare (Romanian)
    COMPLETED
    0 references
    αναγνώριση λέξεων και περιόδων (Greek)
    0 references