tokenization (Q15019)

From LexBib
Revision as of 17:10, 8 September 2021 by DavidLbot (talk | contribs) (‎Added qualifier: source name (P84): LexBib Aug 2021)
a term
Language Label Description Also known as
English
tokenization
a term

    Statements

    0 references
    0 references
    breaking a stream of text up into chunks for analysis or further processing
    0 references
    44
    LexBib Aug 2021
    0 references