requirements/datasets.txt

addict
attrs
datasets>=4.0.0,<=4.8.4
einops
oss2
Pillow
python-dateutil>=2.1
scipy
setuptools
simplejson>=3.3.0
sortedcontainers>=1.5.9
urllib3>=1.26
add dataset download (#906) * add dataset download * fix cr issue * fix cv matplotlib issue * refactor code * fix ut issue * remove debug code * remove unused import * fix import issue * sleep 65s before start docker avoid kill and run failed --------- Co-authored-by: mulin.lyh <mulin.lyh@taobao.com> 2024-07-12 19:06:44 +08:00			`addict`
			`attrs`
[Fix \| Refactor] Fix preview loading and refactor hf datasets utils (#1654) 2026-03-27 15:28:57 +08:00			`datasets>=4.0.0,<=4.8.4`
add dataset download (#906) * add dataset download * fix cr issue * fix cv matplotlib issue * refactor code * fix ut issue * remove debug code * remove unused import * fix import issue * sleep 65s before start docker avoid kill and run failed --------- Co-authored-by: mulin.lyh <mulin.lyh@taobao.com> 2024-07-12 19:06:44 +08:00			`einops`
			`oss2`
Upgrade datasets (#921) * del _datasets_server import in hf_dataset_util * fix streaming for youku-mplug and adopt latest datasets * fix download config copy * update ut * add youku in test_general_datasets * update UT for general dataset * adapt to datasets version: 2.19.0 or later * add assert for youku data UT * fix disable_tqdm in some functions for 2.19.0 or later * update get_module_with_script * set trust_remote_code is True in load_dataset_with_ctx * update print info * update requirements for datasets version restriction * fix _dataset_info * add pillow * update comments * update comment * reuse _download function in DataDownloadManager * remove unused code * update test_run_modelhub in Human3DAnimationTest * set datasets>=2.18.0 2024-07-23 22:26:12 +08:00			`Pillow`
add dataset download (#906) * add dataset download * fix cr issue * fix cv matplotlib issue * refactor code * fix ut issue * remove debug code * remove unused import * fix import issue * sleep 65s before start docker avoid kill and run failed --------- Co-authored-by: mulin.lyh <mulin.lyh@taobao.com> 2024-07-12 19:06:44 +08:00			`python-dateutil>=2.1`
			`scipy`
Add setuptools for hub requirements (#1343) * add setuptools in hub.txt and update setuptools version 2025-05-22 10:44:47 +08:00			`setuptools`
add dataset download (#906) * add dataset download * fix cr issue * fix cv matplotlib issue * refactor code * fix ut issue * remove debug code * remove unused import * fix import issue * sleep 65s before start docker avoid kill and run failed --------- Co-authored-by: mulin.lyh <mulin.lyh@taobao.com> 2024-07-12 19:06:44 +08:00			`simplejson>=3.3.0`
			`sortedcontainers>=1.5.9`
			`urllib3>=1.26`