Question

What are tokens in Python? Name the types of tokens which are

allowed in Python?​

Answer 1

Answer:

Python breaks each logical line into a sequence of elementary lexical components known as tokens. NEWLINE, INDENT and DEDENT, the following categories of tokens exist: identifiers, keywords, literals, operators, and delimiters

Explanation:

Python breaks each logical line into a sequence of elementary lexical components known as tokens. Each token corresponds to a substring of the logical line. The normal token types are identifiers, keywords, operators, delimiters, and literals, as covered in the following sections.

Answer 2

Explanation:

NEWLINE, INDENT and DEDENT , the following categories of tokens exist : identifiers , keywords , literals , operators , and delimiters.