Commit Graph

2825 Commits

Author SHA1 Message Date
Xingjun.Wang
41f227fecb Fix datasets issues (#948)
* update

* user-custom timeout and retry in HubApi

* update

* del download count for snapshot_download
2024-08-26 21:20:02 +08:00
Xingjun.Wang
3f7ce97319 Fix streaming load issues (#953)
* fix streaming context

* add ut for stream
2024-08-22 14:43:37 +08:00
Yingda Chen
005a482522 Merge pull request #947 from modelscope/fixdocs
fix docs build
2024-08-13 19:32:57 +08:00
Yingda Chen
90b53547c4 fix docs build 2024-08-13 14:54:45 +08:00
liuyhwangyh
96dfccbd75 fix compatible of origin command line (#944)
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-08-07 18:31:45 +08:00
liuyhwangyh
bf7c717e17 fix file download off by one bug (#943)
* fix file download off by one bug, command line default download model, add repo-type parameter
---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-08-07 10:40:25 +08:00
Yingda Chen
d6eb8f7ebe Merge pull request #942 from modelscope/release/1.17
Release/1.17
2024-08-06 14:26:13 +08:00
suluyana
e492aeb04d for merge back 2024-08-06 11:32:08 +08:00
Xingjun.Wang
234729b2f8 fix page in list_repo (#938) 2024-08-01 18:17:35 +08:00
xingjun.wang
90969ad277 fix page in list_repo v1.17.0 2024-08-01 17:47:06 +08:00
mulin.lyh
da9f3e58e3 enable download branch 2024-07-31 18:10:44 +08:00
mulin.lyh
775c29ef79 optimize code 2024-07-31 17:01:06 +08:00
mulin.lyh
2b4f09f999 fix bug 2024-07-31 16:47:15 +08:00
mulin.lyh
c2af84dfe6 delete dup code 2024-07-31 13:39:50 +08:00
mulin.lyh
cfc53a0854 Merge branch 'master' into release/1.17 2024-07-31 13:37:14 +08:00
mulin.lyh
2d14d24d3e fix file pattern compatible issue 2024-07-31 10:44:28 +08:00
Ranqing
543a2b32d7 upload high quality human normal estimation model (#903)
* upload human normal estimation model

* upload human normal estimation unittest

* update human normal estimation

* update test data

---------

Co-authored-by: 葭润 <ranqing.rq@alibaba-inc.com>
Co-authored-by: ranqing <ranqing@Sundays-Mac.local>
Co-authored-by: suluyana <suluyan_sly@163.com>
2024-07-31 10:19:41 +08:00
植心
836f206207 Update README_zh.md (#928)
* Update README_zh.md
2024-07-30 20:13:53 +08:00
wenmeng zhou
a1c8196abe Update README.md 2024-07-29 16:57:23 +08:00
wenmeng zhou
0184eadf64 Update README.md 2024-07-29 16:53:45 +08:00
liuyhwangyh
92ce1aa41d fix dataset page bug, framework add transformers dependency (#927)
* fix dataset page bug, framework add transformers dependency
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-07-26 19:03:39 +08:00
suluyana
e4f5f95cc2 bump version 2024-07-26 18:12:37 +08:00
suluyana
017c3e806f Squashed commit of the following:
commit 33bdd0d215
Author: mulin.lyh <mulin.lyh@taobao.com>
Date:   Fri Jul 26 16:34:47 2024 +0800

    fix bug

commit abacad997a
Author: mulin.lyh <mulin.lyh@taobao.com>
Date:   Fri Jul 26 15:35:11 2024 +0800

    fix bug

commit 67bf0eea23
Author: mulin.lyh <mulin.lyh@taobao.com>
Date:   Thu Jul 25 20:51:31 2024 +0800

    fix comments issue

commit d5d3d49206
Author: mulin.lyh <mulin.lyh@taobao.com>
Date:   Thu Jul 25 19:35:52 2024 +0800

    fix dataset page bug, framework add transformers dependency
2024-07-26 18:08:35 +08:00
Xingjun.Wang
210ab40c54 Upgrade datasets (#921)
* del _datasets_server import in hf_dataset_util

* fix streaming for youku-mplug and adopt latest datasets

* fix download config copy

* update ut

* add youku in test_general_datasets

* update UT for general dataset

* adapt to datasets version: 2.19.0 or later

* add assert for youku data UT

* fix disable_tqdm in some functions for 2.19.0 or later

* update get_module_with_script

* set trust_remote_code is True in load_dataset_with_ctx

* update print info

* update requirements for datasets version restriction

* fix _dataset_info

* add pillow

* update comments

* update comment

* reuse _download function in DataDownloadManager

* remove unused code

* update test_run_modelhub in Human3DAnimationTest

* set datasets>=2.18.0
2024-07-23 22:26:12 +08:00
liuyhwangyh
4e2555c5a3 Release/1.16 merge to master (#922)
* update version

* merge master

* fix fairseq issue

* fix pip compatible issue

* fix bug

* version to 1.16.1

* xformers<0.0.27

* fix matplotlib.cm compatible issue

* remove transformers from frameowrk

* vllm to 0.5.1

* not upgrade pip

* add Pillow to framework

* Update version.py

---------

Co-authored-by: xingjun.wang <xingjun.wxj@alibaba-inc.com>
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-07-22 20:58:32 +08:00
Yingda Chen
710fdaf081 Merge pull request #910 from SNESNya/patch-1
将 "library" 改为 "Library"
2024-07-15 08:42:23 +08:00
LAGSNES
c069e1cbf4 将 "library" 改为 "Library" 2024-07-15 00:23:04 +08:00
wenmeng zhou
09d7a231de update discord in readme (#908) 2024-07-13 19:50:54 +08:00
wenmeng zhou
5c9e5a6283 Update discord in README.md 2024-07-13 19:29:23 +08:00
liuyhwangyh
f7a32e48e3 add dataset download (#906)
* add dataset download

* fix cr issue

* fix cv matplotlib issue

* refactor code

* fix ut issue

* remove debug code

* remove unused import

* fix import issue

* sleep 65s before start docker avoid kill and run failed

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-07-12 19:06:44 +08:00
liuyhwangyh
53acf79d04 fix logger issue (#899)
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-07-03 20:03:46 +08:00
liuyhwangyh
083aa80d09 refactor ast index file generator (#897)
* refactor ast index file generator

* fix lint issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-07-03 18:23:50 +08:00
Zhongbing-Chen
3bafc5c344 exchange the order of replacement (#893) 2024-07-01 20:49:08 +08:00
liuyhwangyh
6995662f38 shorten check model timeout and snapshot_download file patter folder/ to folder/* (#896)
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-07-01 15:52:16 +08:00
zhyncs
5b8e1e971c fix ignore_file_pattern (#886)
* fix ignore_file_pattern

---------

Co-authored-by: root <root@kunkun>
2024-07-01 14:31:39 +08:00
liuyhwangyh
ff77845772 add command line usage, optimize command line log, optimize packaging… (#888)
* add command line usage, optimize command line log, optimize packaging version compatible

* Update command.md

* fix logging dup

* Refactor install dependencies (#889)

* refactor install dependencies, default only depencies of hub and datasets

* move pandas import to function

* update hub deps

* test

* remove generate ast file

* remove gast dependency

* replace gast with ast

* add dependency version

* remove lap for compile error

* fix comments issue

* add install ollama

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-06-30 20:15:03 +08:00
Firmament-cyou
8cdbeec3f6 Support swift model inference for llm pipeline (#880)
* Support swift model inference for llm pipeline

* fix bug

* Add 'swfit' llm_framework and fix stream bug

* For pass the unittest run action
2024-06-30 19:43:13 +08:00
yfchenmodelscope
f65f45959d Add Eres2netv2ep4 (#892)
* add eres2netv2ep4
2024-06-27 21:09:51 +08:00
wenmeng zhou
5d00b7c304 Merge pull request #876 from modelscope/release/1.15
Release/1.15
2024-06-06 18:01:22 +08:00
mulin.lyh
f34817e95d modify version merge master 2024-06-06 16:23:19 +08:00
wenmeng zhou
894bc90d96 remove assets and download from oss when running app (#875) 2024-06-05 21:18:21 +08:00
mulin.lyh
909e54fa33 modify build script 2024-06-05 19:08:46 +08:00
mulin.lyh
339ebab9dd fix download retry bug, add get_cache_dir to hut/util v1.15.0 2024-06-04 16:18:52 +08:00
mulin.lyh
7b18f99d03 release to 06.05 2024-06-03 10:09:07 +08:00
mulin.lyh
4a22b05891 restore http_get_file interface 2024-05-28 15:09:05 +08:00
mulin.lyh
e2d8a6d45f restore TDNN.py 2024-05-28 14:57:05 +08:00
mulin.lyh
8947d69fe2 Merge branch 'master' into release/1.15 2024-05-28 14:55:46 +08:00
liuyhwangyh
17da5e2264 fix error report (#868)
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-05-28 14:38:19 +08:00
mulin.lyh
b46c5bc3f7 add TDNN.py and version to 1.15.0 2024-05-25 22:35:29 +08:00
mulin.lyh
f69ddba0bb fix TDNN.py and tdnn.py 2024-05-25 22:34:11 +08:00