Question

1 point
"Tokenization" is when the
characters are translated into a
sequence of tokens, classifying
each by it's
category.
O Lexicon
O Lexical
O Logical
0 Syntactical​

Answer 1

Answer:

I think logical not sure

Answer 2

Answer:

logical is the answer. .