The London Perl and Raku Workshop takes place on 26th Oct 2024. If your company depends on Perl, please consider sponsoring and/or attending.

Changes for version 0.04 - 2021-03-09

  • Always call `next` method, so it can be overridden

Modules

lexer to break text up into user-defined tokens
reusable lexer for token-stream scanning
role for token-stream classes
class to model scanned tokens
types used by Text::TokenStream et al