Published January 21, 2022
| Version 1.18.0
Software
Open
huggingface/datasets: 1.18.0
Authors/Creators
- Quentin Lhoest1
-
Albert Villanova del Moral1
- Patrick von Platen1
- Thomas Wolf1
- Mario Šaško1
- Yacine Jernite1
- Abhishek Thakur1
- Lewis Tunstall1
- Suraj Patil1
- Mariama Drame1
- Julien Chaumond1
- Julien Plu1
- Joe Davison1
- Simon Brandeis1
- Victor Sanh1
- Teven Le Scao1
- Kevin Canwen Xu1
- Nicolas Patry1
- Steven Liu1
- Angelina McMillan-Major1
- Philipp Schmid1
- Sylvain Gugger1
- Nathan Raw1
- Sylvain Lesage1
- Anton Lozhkov1
- Matthew Carrigan1
- Théo Matussière1
- Leandro von Werra1
- Lysandre Debut1
- Stas Bekman1
- Clément Delangue1
- 1. Hugging Face
Description
Datasets Changes
- New: VCTK
- Add VCTK dataset by @jaketae in https://github.com/huggingface/datasets/pull/3351
- Fix VCTK encoding by @lhoestq in https://github.com/huggingface/datasets/pull/3493
- Docs: Add VCTK dataset description by @jaketae in https://github.com/huggingface/datasets/pull/3500
- New: CPPE-5 dataset by @mariosasko in https://github.com/huggingface/datasets/pull/3517
- New: RedCaps dataset by @mariosasko in https://github.com/huggingface/datasets/pull/3424
- New: WIDER FACE dataset by @mariosasko in https://github.com/huggingface/datasets/pull/3413
- New: SVHN dataset by @mariosasko in https://github.com/huggingface/datasets/pull/3535
- New: BNL newspapers by @davanstrien in https://github.com/huggingface/datasets/pull/3397
- New: PASS dataset by @mariosasko in https://github.com/huggingface/datasets/pull/3576
- New: Text2log Dataset by @apergo-ai in https://github.com/huggingface/datasets/pull/3579
- Update: beans, cats_vs_dogs - Use
iter_filesinstead ofstr(Path(...)in image dataset by @mariosasko in https://github.com/huggingface/datasets/pull/3477 - Update : PIB - update version and make it streamable by @albertvillanova in https://github.com/huggingface/datasets/pull/3496
- Update: code_x_glue_tt_text_to_text, compguesswhat - Remove print statements in datasets by @mariosasko in https://github.com/huggingface/datasets/pull/3546
- Update: MuchoCine - add missing tasks by @mariosasko in https://github.com/huggingface/datasets/pull/3571
- Fix: Tashkeela - fix to yield stripped text by @albertvillanova in https://github.com/huggingface/datasets/pull/3471
- Fix: asset - change to raw.githubusercontent.com URLs by @VictorSanh in https://github.com/huggingface/datasets/pull/3516
- Fix: CC100 - use HTTPS for the data source URL by @aajanki in https://github.com/huggingface/datasets/pull/3519
- Fix: vision datsets - Fix bug in
ImageClassifcationtask template by @mariosasko in https://github.com/huggingface/datasets/pull/3557 - Fix: tweet_qa - fix
DuplicatedKeysErrorand improve card by @mariosasko in https://github.com/huggingface/datasets/pull/3559 - Fix: mC4 - fix multiple language downloading by @polinaeterna in https://github.com/huggingface/datasets/pull/3594
- Fix: CoNLL2003:
- Use old url for conll2003 by @lhoestq in https://github.com/huggingface/datasets/pull/3600
- Update url for conll2003 by @lhoestq in https://github.com/huggingface/datasets/pull/3602
- Add conll2003 licensing by @lhoestq in https://github.com/huggingface/datasets/pull/3601
- [Time series] Add support for time, date, duration, and decimal dtypes by @mariosasko in https://github.com/huggingface/datasets/pull/3591
- [Image][Audio] Add flexible casting for Image and Audio + Support nested casting by @lhoestq in https://github.com/huggingface/datasets/pull/3575
- Allows DatasetDict.filter to have batching option by @thomasw21 in https://github.com/huggingface/datasets/pull/3506
- Add desc parameter to filter by @mariosasko in https://github.com/huggingface/datasets/pull/3513
- Add
gzipforto_jsonby @bhavitvyamalik in https://github.com/huggingface/datasets/pull/3492 - Allow multiple task templates of the same type by @mariosasko in https://github.com/huggingface/datasets/pull/3562
- Add parameter
preserve_indextofrom_pandasby @Sorrow321 in https://github.com/huggingface/datasets/pull/3565 - Dataset Streaming:
- Fix
str(Path(...))conversion in streaming on Linux by @mariosasko in https://github.com/huggingface/datasets/pull/3472 - Extend support for streaming datasets that use ET.parse by @albertvillanova in https://github.com/huggingface/datasets/pull/3476
- Extend support for streaming datasets that use os.walk by @albertvillanova in https://github.com/huggingface/datasets/pull/3478
- Fix
- Add Mauve metric by @jthickstun in https://github.com/huggingface/datasets/pull/3573
- update
pretty_namefor first 200 datasets by @bhavitvyamalik in https://github.com/huggingface/datasets/pull/3498 - update
pretty_namefor all the other datasets by @bhavitvyamalik in https://github.com/huggingface/datasets/pull/3536 - pib: Update pib dataset card by @albertvillanova in https://github.com/huggingface/datasets/pull/3501
- arabic_speech_corpus: Adding link to license. by @meg-huggingface in https://github.com/huggingface/datasets/pull/3524
- Covost2: Update README.md by @meg-huggingface in https://github.com/huggingface/datasets/pull/3528
- librispeech_asr: Update README.md by @meg-huggingface in https://github.com/huggingface/datasets/pull/3529
- vivos: Update README.md by @meg-huggingface in https://github.com/huggingface/datasets/pull/3530
- audio datasets: Audio datacard update - first pass by @meg-huggingface in https://github.com/huggingface/datasets/pull/3520
- common_language: Update README.md by @meg-huggingface in https://github.com/huggingface/datasets/pull/3527
- wiki_dpr: Update wiki_dpr README.md by @lhoestq in https://github.com/huggingface/datasets/pull/3534
- qa4mre: Fix qa4mre tags by @lhoestq in https://github.com/huggingface/datasets/pull/3574
- HellaSwag: Update HellaSwag README.md by @borgr in https://github.com/huggingface/datasets/pull/3588
- ANLI: Update ANLI README.md by @borgr in https://github.com/huggingface/datasets/pull/3590
- tweet_eval: Update README.md by @borgr in https://github.com/huggingface/datasets/pull/3593
- Fix rendering of docs by @albertvillanova in https://github.com/huggingface/datasets/pull/3470
- Fix to_tf_dataset references in docs by @mariosasko in https://github.com/huggingface/datasets/pull/3514
- added PII statements and license links to data cards by @mcmillanmajora in https://github.com/huggingface/datasets/pull/3537
- Readme usage update by @meg-huggingface in https://github.com/huggingface/datasets/pull/3538
- Update the CC-100 dataset card by @aajanki in https://github.com/huggingface/datasets/pull/3542
- Research wording for nc licenses by @meg-huggingface in https://github.com/huggingface/datasets/pull/3539
- Added links to licensing and PII message in vctk dataset by @mcmillanmajora in https://github.com/huggingface/datasets/pull/3523
- Give clearer instructions to add the YAML tags by @albertvillanova in https://github.com/huggingface/datasets/pull/3532
- Fix overriding of filesystem info by @albertvillanova in https://github.com/huggingface/datasets/pull/3481
- Update ADD_NEW_DATASET.md by @apergo-ai in https://github.com/huggingface/datasets/pull/3487
- Fix weird spacing in ManualDownloadError message by @bryant1410 in https://github.com/huggingface/datasets/pull/3486
- Clone full repo to detect new tags when mirroring datasets on the Hub by @lhoestq in https://github.com/huggingface/datasets/pull/3494
- Remove unused phony rule from Makefile by @bryant1410 in https://github.com/huggingface/datasets/pull/3483
- fix: 🐛 pass token when retrieving the split names by @severo in https://github.com/huggingface/datasets/pull/3545
- Pin torchmetrics to fix the COMET test by @lhoestq in https://github.com/huggingface/datasets/pull/3589
- Preserve encoding/decoding with features in
Iterable.mapcall by @mariosasko in https://github.com/huggingface/datasets/pull/3556
- @apergo-ai made their first contribution in https://github.com/huggingface/datasets/pull/3487
- @bryant1410 made their first contribution in https://github.com/huggingface/datasets/pull/3486
- @meg-huggingface made their first contribution in https://github.com/huggingface/datasets/pull/3527
- @aajanki made their first contribution in https://github.com/huggingface/datasets/pull/3519
- @Sorrow321 made their first contribution in https://github.com/huggingface/datasets/pull/3565
- @jthickstun made their first contribution in https://github.com/huggingface/datasets/pull/3573
- @borgr made their first contribution in https://github.com/huggingface/datasets/pull/3588
Full Changelog: https://github.com/huggingface/datasets/compare/1.17.0...1.18.0
Files
huggingface/datasets-1.18.0.zip
Files
(51.2 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:6cbd5b6ec1f330532de4136aa5dea061
|
51.2 MB | Preview Download |
Additional details
Related works
- Is supplement to
- https://github.com/huggingface/datasets/tree/1.18.0 (URL)