Implements a tokenizer and compilation engine to parse Jack source code and generate XML output. Supports both individual files and directory processing, with optional tokenization-only mode.