tokenization (Q15019): Difference between revisions

From LexBib
(‎Added reference to claim: skos:definition (P80): breaking a stream of text up into chunks for analysis or further processing)
(‎Removed qualifier: wikidata entity (P2): Q2438971)
Property / skos:definition: breaking a stream of text up into chunks for analysis or further processing / qualifier
 

Revision as of 12:00, 17 November 2021

a term
Language Label Description Also known as
English
tokenization
a term

    Statements

    0 references
    0 references
    breaking a stream of text up into chunks for analysis or further processing
    45
    LexBib Aug 2021
    LexBib Oct 2021
    LexBib Oct 2021 stopterms
    0 references
    21 August 2021
    0 references
    segmentació (Catalan)
    COMPLETED
    0 references
    sõnestamine (Estonian)
    COMPLETED
    0 references
    tilreiðing (Icelandic)
    COMPLETED
    0 references
    tokenizzazione (Italian)
    COMPLETED
    0 references
    tokenizacija (Lithuanian)
    COMPLETED
    0 references
    segmentación (Spanish)
    COMPLETED
    0 references
    Tokenisierung (German)
    COMPLETED
    0 references
    tokenizazio (Basque)
    COMPLETED
    0 references
    tokeniseerimine (Estonian)
    COMPLETED
    0 references
    tokenization (Italian)
    COMPLETED
    0 references