textproc/py-tokenizers: update to 0.20.1
While here, add LICENSE_FILE.
Changelog: https://github.com/huggingface/tokenizers/releases/tag/v0.20.1
Reported by: Repology
Description
Description
Details
Details
- Provenance
tagattie Authored on Oct 18 2024, 5:10 AM - Parents
- R11:80b6a2e096fa: misc/llama-cpp: update 3914 → 3938
- Branches
- Unknown
- Tags