tokenization (Q15019): Difference between revisions
From LexBib
(Added [gl] label: segmentación) |
(Added [sr] label: токенизација) |
||
label / sr | label / sr | ||
токенизација |
Revision as of 07:56, 7 July 2022
a term
Language | Label | Description | Also known as |
---|---|---|---|
English | tokenization |
a term |
Statements
breaking a stream of text up into chunks for analysis or further processing
1 reference
45
0 references
21 August 2021
0 references