* fix#845
Supports resumption of downloads from breakpoints, optimized download progress bar, finer display granularity, better experience under low bandwidth, and added function of downloading specified directories.
* restore push to hub
* fix merge issue
* fix ut issue
---------
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
When we use `modelscope server` to serve the model, the comma after last json object in this file will cause the error bellow:
```log
ERROR: Traceback (most recent call last):
File "/opt/conda/lib/python3.10/site-packages/starlette/routing.py", line 732, in lifespan
async with self.lifespan_context(app) as maybe_state:
File "/opt/conda/lib/python3.10/site-packages/starlette/routing.py", line 608, in __aenter__
await self._router.startup()
File "/opt/conda/lib/python3.10/site-packages/starlette/routing.py", line 711, in startup
handler()
File "/opt/conda/lib/python3.10/site-packages/modelscope/server/core/event_handlers.py", line 37, in startup
_startup_model(app)
File "/opt/conda/lib/python3.10/site-packages/modelscope/server/core/event_handlers.py", line 22, in _startup_model
info['schema'] = get_task_schemas(app.state.pipeline.group_key)
File "/opt/conda/lib/python3.10/site-packages/modelscope/utils/input_output.py", line 837, in get_task_schemas
schema = json.load(f)
File "/opt/conda/lib/python3.10/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/opt/conda/lib/python3.10/json/__init__.py", line 346, in loads
return _default_decoder.decode(s)
File "/opt/conda/lib/python3.10/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/opt/conda/lib/python3.10/json/decoder.py", line 353, in raw_decode
obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting property name enclosed in double quotes: line 3836 column 1 (char 100720)
```
* add main entry in ms_dataset
* update func get_data_patterns import
* modify return_config_only
* modify return_config_only to dataset_info_only
* udpate version for test
* del get_logger(__name__)
* fix py script loading
* fix loading py and without py
* add subset support
* add hf_datasets_util; refine list_repo_tree_ms; fix private datasets loading issue
* update version to rc5
* fix and support preview for dataset_info_only mode
* fix urlencode
* update to rc7
* loading of dataset_infos.json is deprecated; 2. add some ut
* update version
* add escapechar for read_csv and to_csv
* add params: Source=SDK
* add create_dataset func
* overwrite _get_paths_info
* update & version
* update list_repo_tree name
* add get_module_with_script, fix download imports
* fix py script loading issue in dataset_module_factory
* fix create dataset
* update log info in api
