Intel Corporation interview question

Describe tokenizing concepts?