tokenization (Q15019): Difference between revisions
From LexBib
(Added [et] label: sõnestamine) |
(Set [et] alias: tokeniseerimine) |
||
aliases / et / 0 | aliases / et / 0 | ||
tokeniseerimine |
Revision as of 05:08, 26 October 2021
a term
Language | Label | Description | Also known as |
---|---|---|---|
English | tokenization |
a term |
Statements
breaking a stream of text up into chunks for analysis or further processing
0 references
21 August 2021
0 references