Associations to the word «Tokenize»
Noun
Adjective
Verb
| 1 |
Wiktionary
TOKENIZE, verb. (transitive) (computing) To reduce to a set of tokens by parsing.
TOKENIZE, verb. (transitive) To treat as a token minority.
Wise words
One merit of poetry few persons will deny: it says more and
in fewer words than prose.