tokenization (Q15019)

From LexBib
a term
Language Label Description Also known as
English
tokenization
a term

    Statements

    instance of
    Concept
    0 references
    skos:broader
    NLP
    0 references
    skos:definition
    breaking a stream of text up into chunks for analysis or further processing
    1 reference
    wikidata entity
    Q2438971
    occurs in # of LexBib BibItems
    55
    source name
    LexBib Nov 2021 stopterms
    LexBib en/es 07-2022
    0 references
    sent to LexVoc Lexonomy
    21 August 2021
    0 references
    prefLabel translation
    segmentació (Catalan)
    translation status
    COMPLETED
    0 references
    sõnestamine (Estonian)
    translation status
    COMPLETED
    0 references
    tilreiðing (Icelandic)
    translation status
    COMPLETE
    0 references
    tokenizzazione (Italian)
    translation status
    COMPLETED
    0 references
    tokenizacija (Lithuanian)
    translation status
    COMPLETED
    0 references
    segmentación (Spanish)
    translation status
    COMPLETED
    0 references
    Tokenisierung (German)
    translation status
    COMPLETED
    0 references
    tokenizazio (Basque)
    translation status
    COMPLETED
    0 references
    tokenisering (Danish)
    translation status
    COMPLETED
    0 references
    tokenizacja (Polish)
    translation status
    TO CHECK
    0 references
    tokenizare (Romanian)
    translation status
    COMPLETED
    0 references
    Токен (Russian)
    translation status
    AUTOMATIC
    0 references
    токенизација (Serbian)
    translation status
    COMPLETED
    0 references
    tokenizálás (Hungarian)
    translation status
    COMPLETED
    0 references
    tokenizacija (Montenegrin)
    translation status
    COMPLETED
    0 references
    αναγνώριση λέξεων και προτάσεων (Greek)
    translation status
    TO CHECK
    0 references
    segmentación (Galician)
    translation status
    COMPLETED
    0 references
    tokeniseren (Dutch)
    translation status
    COMPLETED
    0 references
    altLabel translation
    tokeniseerimine (Estonian)
    translation status
    COMPLETED
    0 references
    tokenization (Italian)
    translation status
    COMPLETED
    0 references
    analizare (Romanian)
    translation status
    COMPLETED
    0 references
    identificare (Romanian)
    translation status
    COMPLETED
    0 references
    structurare (Romanian)
    translation status
    COMPLETED
    0 references
    αναγνώριση λέξεων και περιόδων (Greek)
    translation status
    TO CHECK
    0 references
    tokenización (Galician)
    translation status
    COMPLETED
    0 references
    tokenization (Galician)
    translation status
    COMPLETED
    0 references
     
    Retrieved from "https://lexbib.elex.is/w/index.php?title=Item:Q15019&oldid=819663"