theseer/tokenizer
A small library for converting tokenized PHP source code into XML (and potentially other formats)
10 Releases
Latest: 6mo ago
Release 2.0.12.0.1Latest
theseer·6mo ago·December 8, 2025📋 Changes
- Removed the custom token `T_AMPERSAND` as PHP 8.1+ provides tokens for it already and our 2.0.0 release overwrote it. See [#44](https://github.com/theseer/tokenizer/issues/44) for details.
Release 2.0.02.0.0
theseer·6mo ago·December 6, 2025📋 What's Changed
- Utilize `PhpToken::tokenize()` - requires PHP8+ by @staabm in https://github.com/theseer/tokenizer/pull/35
- Add XMLSerializer->appendToWriter() by @staabm in https://github.com/theseer/tokenizer/pull/38
- Full Changelog: https://github.com/theseer/tokenizer/compare/1.3.1...2.0.0
Release 1.3.11.3.1
theseer·7mo ago·November 17, 2025📋 Changes
- Fix [#37](https://github.com/theseer/tokenizer/issues/37): v1.3.0 introduced a breaking change on the token collection (ArrayAccess interface removed)
Release 1.3.01.3.0
theseer·7mo ago·November 13, 2025📋 Changes
- Require at least PHP 7.3 for building, code should still be PHP 7.2 compliant
- Merge various performance improvements provided by @staabm
- Merge some code cleanups provided by @staabm
Release 1.2.31.2.3
theseer·2y ago·March 3, 2024📋 Changed
- Do not use implict nullable type (thanks @sebastianbergmann), this should make things work on PHP 8.4
Release 1.2.21.2.2
theseer·2y ago·November 20, 2023🐛 Fixed
- [#18](https://github.com/theseer/tokenizer/issues/18): Tokenizer fails on protobuf metadata files
Release 1.1.21.1.2
theseer·7y ago·April 4, 2019Revert PHPUnit 8 update to stay PHP 7.0 compliant. This release does not include any functionality change otherwise.
Release 1.1.11.1.1
theseer·7y ago·April 3, 2019🐛 Fixed
- [#1](https://github.com/theseer/tokenizer/issues/1): Empty file causes invalid array read
📋 Changed
- Tests should now be PHPUnit 8 compliant
Release 1.1.01.1.0
theseer·9y ago·April 7, 2017📋 Changes
- Allow use of custom namespace for XML serialization
Release 1.0.01.0.0
theseer·9y ago·April 5, 2017