Published October 6, 2022
| Version python-v0.13.1
Software
Open
huggingface/tokenizers: python-v0.13.1
Authors/Creators
- Anthony MOI1
- Nicolas Patry1
- Pierric Cistac1
- Pete
- Funtowicz Morgan2
- Sebastian Pütz
- Mishig1
- Bjarte Johansen3
- Thomas Wolf1
- Sylvain Gugger
- Clement1
- Julien Chaumond1
- Lysandre Debut4
- François Garillot
- Luc Georges4
- dctelus
- JC Louis
- MarcusGrass
- Taufiquzzaman Peyash5
- 0xflotus
- Alan deLevie6
- Alexander Mamaev
- Arthur1
- Colin Clement7
- Dagmawi Moges8
- David Hewitt9
- Denis Zolotukhin
- Geoffrey Thomas
- HaoboGu10
- 1. @huggingface
- 2. HuggingFace
- 3. @equinor
- 4. Hugging Face
- 5. AssemblyAI
- 6. @casetext
- 7. Microsoft Corporation
- 8. Maharishi International University
- 9. @Rothesay
- 10. Alibaba Inc.
Description
[0.13.1]
- [#1072] Fixing Roberta type ids.
Files
huggingface/tokenizers-python-v0.13.1.zip
Additional details
Related works
- Is supplement to
- https://github.com/huggingface/tokenizers/tree/python-v0.13.1 (URL)