Standard Lemma guide
Definitions and examples are grouped by meaning. Pronunciation, history, word forms, translations, descendants, synonyms, antonyms, derived terms, and related words appear whenever the source provides them.
Sound
Each Play button uses your device's default local English voice, or a natural local fallback. The selected voice name appears after playback. This is synthesized speech, not a source recording.
verb
To reduce to a token or set of tokens by lexical analysis.
Definition source: English Wiktionary via Wiktextract
Usage: transitive
Topics: computing, engineering, mathematics, natural-sciences, physical-sciences, sciences
No example sentence was provided for this meaning.
Synonyms: none provided
Antonyms: none provided
verb
To substitute sensitive data with meaningless placeholders.
Definition source: English Wiktionary via Wiktextract
Usage: transitive
Topics: computing, engineering, mathematics, natural-sciences, physical-sciences, sciences
No example sentence was provided for this meaning.
Synonyms: none provided
Antonyms: none provided
verb
To treat as a token minority.
Definition source: English Wiktionary via Wiktextract
Usage: transitive
No example sentence was provided for this meaning.
Synonyms: none provided
Antonyms: none provided
History
Etymology tree English token Proto-Indo-European *-id- Proto-Indo-European *-yéti Proto-Indo-European *-idyéti Proto-Hellenic *-íďďō Ancient Greek -ῐ́ζω (-ĭ́zō)bor. Late Latin -izōder. Middle French -iserbor. Middle English -isen English -ize English tokenize From token + -ize.
