tokenizer
English
Etymology
tokenize + -er
Noun
tokenizer (plural tokenizers)
- (computing) A system that parses an input stream into its component tokens.
单词 | tokenizer |
释义 | tokenizer |
随便看 |
国际大辞典收录了7408809条英语、德语、日语等多语种在线翻译词条,基本涵盖了全部常用单词及词组的翻译及用法,是外语学习的有利工具。