Commit Graph

2451 Commits

Author SHA1 Message Date
tastelikefeet
7ceac5a359 fix recursion (#1024)
* fix recursion

* lint code
2024-10-16 08:42:46 +08:00
Xingjun.Wang
eab95f909f del ignore_verifications and add trust_remote_code for local py_script (#1021) 2024-10-15 12:41:12 +08:00
Xingjun.Wang
90acaccc28 Fix trust_remote_code (#1016)
* add cmd line option of clear-cache

* fix typo

* fix trust_remote_code for old dataset and py-script

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-10-12 22:00:30 +08:00
tastelikefeet
b0f03ffd6d Fix template of eos_token (#1013) 2024-10-10 21:40:51 +08:00
suluyana
bd1544bef0 fix template: llava-llama-3 & yi-1.5 (#1011) 2024-10-10 10:01:45 +08:00
Yingda Chen
adc0374088 add cmd line option of clear-cache (#1009)
* add cmd line option of clear-cache

* fix typo

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-10-02 22:47:52 +08:00
Yingda Chen
9f631056f3 do not download pt and pth files for autoconfig, autotoknizer and generation config (#1008)
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-10-01 15:17:05 +08:00
Yingda Chen
8d72902e20 Update issue templates 2024-10-01 12:52:52 +08:00
Xingjun.Wang
2c4505e13a Adapt new datasets (#1002)
* update ds==3.0

* update

* add http_get_ms func

* del unused code

* fix pr issue and update requirements
2024-09-30 16:46:00 +08:00
tastelikefeet
834db59952 template and ollama in modelscope (#995) 2024-09-29 19:13:50 +08:00
Yingda Chen
058df0e34c Unify dataset download log and remove tqdm disable option (#997)
* use tqdm auto

* unify dataset download log and remove tqdm disable option

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-09-24 21:38:36 +08:00
suluyana
d5c9c82340 Fix problems with serializing audio output in serving (#993)
* fix audio out

* fix value in json output

* fix audio out
2024-09-18 08:48:20 +08:00
tastelikefeet
74d97ea7e0 Refactor zero sized file downloading (#991) 2024-09-14 15:12:28 +08:00
tastelikefeet
4c518db424 patch hf hub (#987) 2024-09-14 12:24:19 +08:00
tastelikefeet
51b33cecef Support create file with size 0 (#984)
* Support file size == 0
2024-09-11 19:35:02 +08:00
Yingda Chen
469159de34 use tqdm auto (#982)
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-09-11 11:40:37 +08:00
tastelikefeet
96e33878b4 lint code (#970) 2024-09-02 10:16:35 +08:00
gylcalex1314
ce1ee32fde add facial 68 landmark detection model (#964)
Co-authored-by: 敛沧 <liancang.gy@cainiao.com>
2024-09-01 19:53:18 +08:00
Yingda Chen
de68c847d8 Merge pull request #969 from tastelikefeet/fix/patch-hf
Fix patching hf
2024-09-01 19:10:35 +08:00
yuze.zyz
7271542d7f add more requirements 2024-09-01 19:02:16 +08:00
yuze.zyz
8b5a5bd1e3 fix 2024-09-01 18:37:01 +08:00
yuze.zyz
61a88d00be fix patch hf 2024-09-01 13:58:09 +08:00
Yingda Chen
b28518d6b9 Merge pull request #965 from modelscope/download-file
log download file name
2024-08-28 19:45:54 +08:00
Yingda Chen
412e29c555 log download file name 2024-08-28 16:25:34 +08:00
Yingda Chen
1f63111d15 Merge pull request #958 from modelscope/log-config
[fix #934] allow logging level to be configurable

ci test failed due to connection error. from ut log, we can see that the logging is still functioning OK with default setting.
2024-08-27 21:14:31 +08:00
Yingda Chen
eec64bfbe2 fix format 2024-08-27 17:25:18 +08:00
Xingjun.Wang
41f227fecb Fix datasets issues (#948)
* update

* user-custom timeout and retry in HubApi

* update

* del download count for snapshot_download
2024-08-26 21:20:02 +08:00
Xingjun.Wang
3f7ce97319 Fix streaming load issues (#953)
* fix streaming context

* add ut for stream
2024-08-22 14:43:37 +08:00
Yingda Chen
005a482522 Merge pull request #947 from modelscope/fixdocs
fix docs build
2024-08-13 19:32:57 +08:00
Yingda Chen
90b53547c4 fix docs build 2024-08-13 14:54:45 +08:00
liuyhwangyh
96dfccbd75 fix compatible of origin command line (#944)
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-08-07 18:31:45 +08:00
liuyhwangyh
bf7c717e17 fix file download off by one bug (#943)
* fix file download off by one bug, command line default download model, add repo-type parameter
---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-08-07 10:40:25 +08:00
Yingda Chen
d6eb8f7ebe Merge pull request #942 from modelscope/release/1.17
Release/1.17
2024-08-06 14:26:13 +08:00
suluyana
e492aeb04d for merge back 2024-08-06 11:32:08 +08:00
Xingjun.Wang
234729b2f8 fix page in list_repo (#938) 2024-08-01 18:17:35 +08:00
xingjun.wang
90969ad277 fix page in list_repo v1.17.0 2024-08-01 17:47:06 +08:00
mulin.lyh
da9f3e58e3 enable download branch 2024-07-31 18:10:44 +08:00
mulin.lyh
775c29ef79 optimize code 2024-07-31 17:01:06 +08:00
mulin.lyh
2b4f09f999 fix bug 2024-07-31 16:47:15 +08:00
mulin.lyh
c2af84dfe6 delete dup code 2024-07-31 13:39:50 +08:00
mulin.lyh
cfc53a0854 Merge branch 'master' into release/1.17 2024-07-31 13:37:14 +08:00
mulin.lyh
2d14d24d3e fix file pattern compatible issue 2024-07-31 10:44:28 +08:00
Ranqing
543a2b32d7 upload high quality human normal estimation model (#903)
* upload human normal estimation model

* upload human normal estimation unittest

* update human normal estimation

* update test data

---------

Co-authored-by: 葭润 <ranqing.rq@alibaba-inc.com>
Co-authored-by: ranqing <ranqing@Sundays-Mac.local>
Co-authored-by: suluyana <suluyan_sly@163.com>
2024-07-31 10:19:41 +08:00
植心
836f206207 Update README_zh.md (#928)
* Update README_zh.md
2024-07-30 20:13:53 +08:00
wenmeng zhou
a1c8196abe Update README.md 2024-07-29 16:57:23 +08:00
wenmeng zhou
0184eadf64 Update README.md 2024-07-29 16:53:45 +08:00
liuyhwangyh
92ce1aa41d fix dataset page bug, framework add transformers dependency (#927)
* fix dataset page bug, framework add transformers dependency
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-07-26 19:03:39 +08:00
suluyana
e4f5f95cc2 bump version 2024-07-26 18:12:37 +08:00
suluyana
017c3e806f Squashed commit of the following:
commit 33bdd0d215
Author: mulin.lyh <mulin.lyh@taobao.com>
Date:   Fri Jul 26 16:34:47 2024 +0800

    fix bug

commit abacad997a
Author: mulin.lyh <mulin.lyh@taobao.com>
Date:   Fri Jul 26 15:35:11 2024 +0800

    fix bug

commit 67bf0eea23
Author: mulin.lyh <mulin.lyh@taobao.com>
Date:   Thu Jul 25 20:51:31 2024 +0800

    fix comments issue

commit d5d3d49206
Author: mulin.lyh <mulin.lyh@taobao.com>
Date:   Thu Jul 25 19:35:52 2024 +0800

    fix dataset page bug, framework add transformers dependency
2024-07-26 18:08:35 +08:00
Xingjun.Wang
210ab40c54 Upgrade datasets (#921)
* del _datasets_server import in hf_dataset_util

* fix streaming for youku-mplug and adopt latest datasets

* fix download config copy

* update ut

* add youku in test_general_datasets

* update UT for general dataset

* adapt to datasets version: 2.19.0 or later

* add assert for youku data UT

* fix disable_tqdm in some functions for 2.19.0 or later

* update get_module_with_script

* set trust_remote_code is True in load_dataset_with_ctx

* update print info

* update requirements for datasets version restriction

* fix _dataset_info

* add pillow

* update comments

* update comment

* reuse _download function in DataDownloadManager

* remove unused code

* update test_run_modelhub in Human3DAnimationTest

* set datasets>=2.18.0
2024-07-23 22:26:12 +08:00