tokenization (Q15019)

From LexBib
a term
Language Label Description Also known as
English
tokenization
a term
    default for all languages
    No label defined

      Statements

      instance of
      Concept
      0 references
      skos:broader
      NLP
      0 references
      skos:definition
      breaking a stream of text up into chunks for analysis or further processing
      1 reference
      wikidata entity
      Q2438971
      occurs in # of LexBib BibItems
      55
      source name
      LexBib Nov 2021 stopterms
      LexBib en/es 07-2022
      0 references
      sent to LexVoc Lexonomy
      21 August 2021
      0 references
      prefLabel translation
      segmentació (Catalan)
      translation status
      COMPLETED
      0 references
      sõnestamine (Estonian)
      translation status
      COMPLETED
      0 references
      tilreiðing (Icelandic)
      translation status
      COMPLETE
      0 references
      tokenizzazione (Italian)
      translation status
      COMPLETED
      0 references
      tokenizacija (Lithuanian)
      translation status
      COMPLETED
      0 references
      segmentación (Spanish)
      translation status
      COMPLETED
      0 references
      Tokenisierung (German)
      translation status
      COMPLETED
      0 references
      tokenizazio (Basque)
      translation status
      COMPLETED
      0 references
      tokenisering (Danish)
      translation status
      COMPLETED
      0 references
      tokenizacja (Polish)
      translation status
      TO CHECK
      0 references
      tokenizare (Romanian)
      translation status
      COMPLETED
      0 references
      Токен (Russian)
      translation status
      AUTOMATIC
      0 references
      токенизација (Serbian)
      translation status
      COMPLETED
      0 references
      tokenizálás (Hungarian)
      translation status
      COMPLETED
      0 references
      tokenizacija (Montenegrin)
      translation status
      COMPLETED
      0 references
      αναγνώριση λέξεων και προτάσεων (Greek)
      translation status
      TO CHECK
      0 references
      segmentación (Galician)
      translation status
      COMPLETED
      0 references
      tokeniseren (Dutch)
      translation status
      COMPLETED
      0 references
      altLabel translation
      tokeniseerimine (Estonian)
      translation status
      COMPLETED
      0 references
      tokenization (Italian)
      translation status
      COMPLETED
      0 references
      analizare (Romanian)
      translation status
      COMPLETED
      0 references
      identificare (Romanian)
      translation status
      COMPLETED
      0 references
      structurare (Romanian)
      translation status
      COMPLETED
      0 references
      αναγνώριση λέξεων και περιόδων (Greek)
      translation status
      TO CHECK
      0 references
      tokenización (Galician)
      translation status
      COMPLETED
      0 references
      tokenization (Galician)
      translation status
      COMPLETED
      0 references
       
      Retrieved from "https://lexbib.elex.is/w/index.php?title=Item:Q15019&oldid=819663"