modelscope

mirror of https://github.com/modelscope/modelscope.git synced 2025-12-16 08:17:45 +01:00

Files

Xingjun.Wang 1a66f069c4 Dataset refactor (#807 )

* add main entry in ms_dataset

* update func get_data_patterns import

* modify return_config_only

* modify return_config_only to dataset_info_only

* udpate version for test

* del get_logger(__name__)

* fix py script loading

* fix loading py and without py

* add subset support

* add hf_datasets_util; refine list_repo_tree_ms; fix private datasets loading issue

* update version to rc5

* fix and support preview for dataset_info_only mode

* fix urlencode

* update to rc7

* loading of dataset_infos.json is deprecated; 2. add some ut

* update version

* add escapechar for read_csv and to_csv

* add params: Source=SDK

* add create_dataset func

* overwrite _get_paths_info

* update & version

* update list_repo_tree name

* add get_module_with_script, fix download imports

* fix py script loading issue in dataset_module_factory

* fix create dataset

* update log info in api

2024-03-22 17:30:34 +08:00

audio

Merge branch 'master' into master-merge-internal20240110

2024-01-14 10:43:11 +08:00

audio.txt

add audio codec and codec-based TTS model

2023-12-26 20:54:59 +08:00

cv.txt

fix python3.10 compatible issue

2023-11-29 17:41:44 +08:00

docs.txt

google style docs and selected file generator