x = 150 ; Note that tokens are not just the characters that make up the line, but the parts that make up the entire line.  In the above example , 150 is recognized as a single token and not 3 tokens of 1, 5 and 0. For our line of code above, the following … Continue reading Lexical Analysis