1 point
"Tokenization" is when the
characters are translated into a
sequence of tokens, classifying
each by it's
category.
O Lexicon
O Lexical
O Logical
0 Syntactical
Answers
Answered by
0
Answer:
I think logical not sure
Answered by
0
Answer:
logical is the answer. .
Similar questions
Math,
4 months ago
English,
4 months ago
Math,
4 months ago
Computer Science,
9 months ago
Chemistry,
9 months ago
English,
1 year ago
Social Sciences,
1 year ago