tokenization (Q15019)
From LexBib
a term
Language | Label | Description | Also known as |
---|---|---|---|
English | tokenization |
a term |
Statements
breaking a stream of text up into chunks for analysis or further processing
0 references
44
0 references
Language | Label | Description | Also known as |
---|---|---|---|
English | tokenization |
a term |