tokenization (Q15019): Difference between revisions
From LexBib
(Added qualifier: source name (P84): LexBib en/es 12-2021) |
(Created claim: prefLabel translation (P129): tokenizacija) |
||
Property / prefLabel translation | |||
tokenizacija (Montenegrin) | |||
Property / prefLabel translation: tokenizacija (Montenegrin) / rank | |||
Normal rank |
Revision as of 10:57, 6 July 2022
a term
Language | Label | Description | Also known as |
---|---|---|---|
English | tokenization |
a term |
Statements
breaking a stream of text up into chunks for analysis or further processing
1 reference
45
0 references
21 August 2021
0 references
tokenizacija (Montenegrin)
0 references