textproc/py-tokenizers: update to 0.15.2
While here, enable tests.
Changelog: https://github.com/huggingface/tokenizers/releases/tag/v0.15.2
Reported by: portscout
Description
Description
Details
Details
- Provenance
tagattie Authored on Feb 14 2024, 9:15 AM - Parents
- R11:cfa4f61d65bb: www/chromium: update to 121.0.6167.184
- Branches
- Unknown
- Tags