tokenization (Q15019): Difference between revisions

From LexBib
(‎Added [et] label: sõnestamine)
(‎Set [et] alias: tokeniseerimine)
aliases / et / 0aliases / et / 0
 
tokeniseerimine

Revision as of 05:08, 26 October 2021

a term
Language Label Description Also known as
English
tokenization
a term

    Statements

    0 references
    0 references
    breaking a stream of text up into chunks for analysis or further processing
    0 references
    45
    LexBib Aug 2021
    LexBib Oct 2021
    LexBib Oct 2021 stopterms
    0 references
    21 August 2021
    0 references
    segmentació (Catalan)
    COMPLETED
    0 references
    sõnestamine (Estonian)
    COMPLETED
    0 references
    tokeniseerimine (Estonian)
    COMPLETED
    0 references