tokenization (Q15019): Difference between revisions
From LexBib
(Removed qualifier: source name (P84): LexBib Oct 2021 stopterms) |
(Removed claim: LexBib v2 legacy ID (P1): Q23340) |
||
(One intermediate revision by the same user not shown) | |||
Property / LexBib v2 legacy ID | |||
Property / LexBib v2 legacy ID: Q23340 / rank | |||
Property / occurs in # of LexBib BibItems: 55 / qualifier | |||
source name: LexBib en/es 07-2022 |
Latest revision as of 20:24, 23 August 2023
a term
Language | Label | Description | Also known as |
---|---|---|---|
English | tokenization |
a term |
Statements
breaking a stream of text up into chunks for analysis or further processing
1 reference
21 August 2021
0 references