tokenization (Q15019): Difference between revisions
From LexBib
(Added [de] label: Tokenisierung) |
(Added [ru] label: Токен) |
||
| label / ru | label / ru | ||
Токен | |||
Revision as of 10:10, 15 August 2021
a term
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | tokenization |
a term |
Statements
breaking a stream of text up into chunks for analysis or further processing
0 references
