Published November 7, 2022
| Version python-v0.13.2
Software
Open
huggingface/tokenizers: Python 0.13.2
Authors/Creators
- Anthony MOI1
- Nicolas Patry1
- Pierric Cistac1
- Pete
- Funtowicz Morgan2
- Sebastian Pütz
- Mishig1
- Bjarte Johansen3
- Thomas Wolf1
- Sylvain Gugger
- Clement1
- Julien Chaumond1
- Lysandre Debut4
- François Garillot
- Luc Georges4
- dctelus
- JC Louis
- MarcusGrass
- Taufiquzzaman Peyash5
- 0xflotus
- Alan deLevie6
- Alexander Mamaev
- Arthur1
- Cameron
- Colin Clement7
- Dagmawi Moges8
- David Hewitt9
- Denis Zolotukhin
- Geoffrey Thomas
- 1. @huggingface
- 2. HuggingFace
- 3. @equinor
- 4. Hugging Face
- 5. AssemblyAI
- 6. @casetext
- 7. Microsoft Corporation
- 8. Maharishi International University
- 9. @Rothesay
Description
[0.13.2]
- [#1096] Python 3.11 support
Files
huggingface/tokenizers-python-v0.13.2.zip
Files
(875.8 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:ef79df739ffdcd01b4c69d9a92a3345a
|
875.8 kB | Preview Download |
Additional details
Related works
- Is supplement to
- https://github.com/huggingface/tokenizers/tree/python-v0.13.2 (URL)