tokenization (Q15019): Difference between revisions

From LexBib
(‎Created claim: prefLabel translation (P129): tokenizacja)
(‎Removed claim: LexBib v2 legacy ID (P1): Q23340)
 
(51 intermediate revisions by the same user not shown)
label / rolabel / ro
 
tokenizare
label / dalabel / da
 
tokenisering
label / hulabel / hu
 
tokenizálás
label / nllabel / nl
 
tokeniseren
label / gllabel / gl
 
segmentación
label / srlabel / sr
 
токенизација
aliases / ro / 0aliases / ro / 0
 
analizare
aliases / ro / 1aliases / ro / 1
 
identificare
aliases / ro / 2aliases / ro / 2
 
structurare
aliases / gl / 0aliases / gl / 0
 
tokenization
aliases / gl / 1aliases / gl / 1
 
tokenización
Property / LexBib v2 legacy ID
 
Property / LexBib v2 legacy ID: Q23340 / rank
Normal rank
 
Property / occurs in # of LexBib BibItemsProperty / occurs in # of LexBib BibItems
45
55
Property / occurs in # of LexBib BibItems: 55 / qualifier
 
source name: LexBib Nov 2021 stopterms
Property / occurs in # of LexBib BibItems: 55 / qualifier
 
source name: LexBib en/es 07-2022
Property / occurs in # of LexBib BibItems: 45 / qualifier
source name: LexBib Aug 2021
 
Property / occurs in # of LexBib BibItems: 45 / qualifier
source name: LexBib Oct 2021
 
Property / occurs in # of LexBib BibItems: 45 / qualifier
source name: LexBib Oct 2021 stopterms
 
Property / occurs in # of LexBib BibItems: 45 / qualifier
source name: LexBib Nov 2021 stopterms
 
Property / prefLabel translation: tokenisering (Danish) / qualifier
 
Property / prefLabel translation: tokenisering (Danish) / qualifier
 
Property / prefLabel translation: tokenizacja (Polish) / qualifier
 
Property / prefLabel translation
 
tokenizare (Romanian)
Property / prefLabel translation: tokenizare (Romanian) / rank
 
Normal rank
Property / prefLabel translation: tokenizare (Romanian) / qualifier
 
Property / prefLabel translation
 
Токен (Russian)
Property / prefLabel translation: Токен (Russian) / rank
 
Normal rank
Property / prefLabel translation: Токен (Russian) / qualifier
 
Property / prefLabel translation
 
токенизација (Serbian)
Property / prefLabel translation: токенизација (Serbian) / rank
 
Normal rank
Property / prefLabel translation: токенизација (Serbian) / qualifier
 
Property / prefLabel translation
 
tokenizálás (Hungarian)
Property / prefLabel translation: tokenizálás (Hungarian) / rank
 
Normal rank
Property / prefLabel translation: tokenizálás (Hungarian) / qualifier
 
Property / prefLabel translation
 
tokenizacija (Montenegrin)
Property / prefLabel translation: tokenizacija (Montenegrin) / rank
 
Normal rank
Property / prefLabel translation: tokenizacija (Montenegrin) / qualifier
 
Property / prefLabel translation
 
αναγνώριση λέξεων και προτάσεων (Greek)
Property / prefLabel translation: αναγνώριση λέξεων και προτάσεων (Greek) / rank
 
Normal rank
Property / prefLabel translation: αναγνώριση λέξεων και προτάσεων (Greek) / qualifier
 
Property / prefLabel translation
 
segmentación (Galician)
Property / prefLabel translation: segmentación (Galician) / rank
 
Normal rank
Property / prefLabel translation: segmentación (Galician) / qualifier
 
Property / prefLabel translation
 
tokeniseren (Dutch)
Property / prefLabel translation: tokeniseren (Dutch) / rank
 
Normal rank
Property / prefLabel translation: tokeniseren (Dutch) / qualifier
 
Property / altLabel translation
 
analizare (Romanian)
Property / altLabel translation: analizare (Romanian) / rank
 
Normal rank
Property / altLabel translation: analizare (Romanian) / qualifier
 
Property / altLabel translation
 
identificare (Romanian)
Property / altLabel translation: identificare (Romanian) / rank
 
Normal rank
Property / altLabel translation: identificare (Romanian) / qualifier
 
Property / altLabel translation
 
structurare (Romanian)
Property / altLabel translation: structurare (Romanian) / rank
 
Normal rank
Property / altLabel translation: structurare (Romanian) / qualifier
 
Property / altLabel translation
 
αναγνώριση λέξεων και περιόδων (Greek)
Property / altLabel translation: αναγνώριση λέξεων και περιόδων (Greek) / rank
 
Normal rank
Property / altLabel translation: αναγνώριση λέξεων και περιόδων (Greek) / qualifier
 
Property / altLabel translation
 
tokenización (Galician)
Property / altLabel translation: tokenización (Galician) / rank
 
Normal rank
Property / altLabel translation: tokenización (Galician) / qualifier
 
Property / altLabel translation
 
tokenization (Galician)
Property / altLabel translation: tokenization (Galician) / rank
 
Normal rank
Property / altLabel translation: tokenization (Galician) / qualifier
 

Latest revision as of 20:24, 23 August 2023

a term
Language Label Description Also known as
English
tokenization
a term

    Statements

    0 references
    0 references
    breaking a stream of text up into chunks for analysis or further processing
    55
    LexBib Nov 2021 stopterms
    LexBib en/es 07-2022
    0 references
    21 August 2021
    0 references
    segmentació (Catalan)
    COMPLETED
    0 references
    sõnestamine (Estonian)
    COMPLETED
    0 references
    tilreiðing (Icelandic)
    0 references
    tokenizzazione (Italian)
    COMPLETED
    0 references
    tokenizacija (Lithuanian)
    COMPLETED
    0 references
    segmentación (Spanish)
    COMPLETED
    0 references
    Tokenisierung (German)
    COMPLETED
    0 references
    tokenizazio (Basque)
    COMPLETED
    0 references
    tokenisering (Danish)
    COMPLETED
    0 references
    tokenizacja (Polish)
    0 references
    tokenizare (Romanian)
    COMPLETED
    0 references
    Токен (Russian)
    AUTOMATIC
    0 references
    токенизација (Serbian)
    COMPLETED
    0 references
    tokenizálás (Hungarian)
    COMPLETED
    0 references
    tokenizacija (Montenegrin)
    COMPLETED
    0 references
    αναγνώριση λέξεων και προτάσεων (Greek)
    0 references
    segmentación (Galician)
    COMPLETED
    0 references
    tokeniseren (Dutch)
    COMPLETED
    0 references
    tokeniseerimine (Estonian)
    COMPLETED
    0 references
    tokenization (Italian)
    COMPLETED
    0 references
    analizare (Romanian)
    COMPLETED
    0 references
    identificare (Romanian)
    COMPLETED
    0 references
    structurare (Romanian)
    COMPLETED
    0 references
    αναγνώριση λέξεων και περιόδων (Greek)
    0 references
    tokenización (Galician)
    COMPLETED
    0 references
    tokenization (Galician)
    COMPLETED
    0 references