English
tokenize
From token + -ize.
A compound of token + -ize
Proto-Indo-European *deyḱ- ‘to show, instruct, teach’
Proto-Germanic *taikną ‘indicator, symbol, sign’
Proto-West Germanic *taikn ‘sign, token, symbol’
Old English tācn ‘sign, symbol’
Middle English token
English token
Today it means
verb To reduce to a token or set of tokens by lexical analysis.
Sources
Sources: Wiktionary, “tokenize”. By Wiktionary contributors, CC BY-SA 4.0, via kaikki.org (dump of Oct 3 2026); text adapted and restructured. Language periods are conventional ranges, not dates for this word. License.
Etymograph / tokenize