tokenization (Q15019): Difference between revisions
From LexBib
(Added qualifier: source name (P84): LexBib Nov 2021 stopterms) |
(Created claim: prefLabel translation (P129): tokenisering) |
||
| Property / prefLabel translation | |||
tokenisering (Danish) | |||
| Property / prefLabel translation: tokenisering (Danish) / rank | |||
Normal rank | |||
Revision as of 12:44, 1 December 2021
a term
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | tokenization |
a term |
Statements
breaking a stream of text up into chunks for analysis or further processing
1 reference
45
0 references
21 August 2021
0 references
tokenisering (Danish)
0 references
