suluyana
299ece8b8a
support ms-swift 3.0.0 ( #1166 )
2025-01-02 17:20:32 +08:00
Xingjun.Wang
71a54c1a51
support latest datasets version ( #1163 )
2025-01-02 17:06:46 +08:00
tastelikefeet
d257fdeac6
fix lint ( #1168 )
2025-01-02 17:06:24 +08:00
tastelikefeet
a89bb73995
fix check model ( #1134 )
2025-01-02 16:08:10 +08:00
Xingjun.Wang
9ee1ff8cee
Update downloading progress ( #1167 )
...
* add MODELSCOPE_SHOW_PROGRESS_THRESHOLD
* lint
* update: MODELSCOPE_SHOW_INDIVIDUAL_PROGRESS_THRESHOLD
2024-12-31 18:28:15 +08:00
Yingda Chen
391c6cdec9
handle resuming download as retry ( #1147 )
...
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-12-30 12:48:55 +08:00
yuze.zyz
640b3bd49b
wip
2024-12-29 18:13:05 +08:00
yuze.zyz
c42a0aca1f
wip
2024-12-29 14:41:36 +08:00
yuze.zyz
225d1058e3
lint
2024-12-29 13:32:23 +08:00
yuze.zyz
9f7484bb82
wip
2024-12-29 13:21:01 +08:00
yuze.zyz
560a21e2a5
wip
2024-12-28 23:08:23 +08:00
Xingjun.Wang
8f3cf81982
Improve&fix dataset download command line ( #1158 )
...
* fix dataset download cli
* fix default revision
* pre-commit
* add --max-workers for cli
* pre-commit
* update default max_workers
2024-12-27 14:30:19 +08:00
yuze.zyz
402904333a
fix
2024-12-27 00:04:59 +08:00
yuze.zyz
d39f0b12ce
fix
2024-12-26 23:43:14 +08:00
yuze.zyz
7769531e9e
add upload files
2024-12-26 23:16:25 +08:00
yuze.zyz
3a5505f50e
wip
2024-12-25 23:29:15 +08:00
yuze.zyz
8509b31729
Merge commit '60780769b1c9c19bbbdaae02edb0d7d9dfeb8da5' into feat/whoami
...
* commit '60780769b1c9c19bbbdaae02edb0d7d9dfeb8da5':
Fix/daily (#1155 )
fix user-specified cache path (#1154 )
fix pipeline builder when model is not supported (#1125 )
Fix python push model no disk space (#1148 )
use streaming hash validation (#1127 )
fix daily fail case 1210yk (#1142 )
fix ut (#1143 )
Fix ollama template (#1141 )
downgrade moviepy to 1.0.3 (#1133 )
Skip obsolete sd pipeline (#1131 )
2024-12-25 20:31:16 +08:00
yuze.zyz
6e68cb92c1
add whoami
2024-12-25 20:29:44 +08:00
suluyana
60780769b1
Fix/daily ( #1155 )
...
* fix(llm ppl): 1. cache position; 2. stream_gready_search; 3. swift_mapping
* fix punkt
---------
Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com >
2024-12-23 09:55:12 +08:00
Yingda Chen
9304d40539
fix user-specified cache path ( #1154 )
...
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-12-18 09:01:41 +08:00
suluyana
1fe211ffe5
fix pipeline builder when model is not supported ( #1125 )
...
* fix pipeline builder when model is not supported
* fix ci & skip
---------
Co-authored-by: suluyan.sly@alibaba-inc.com <suluyan.sly@alibaba-inc.com >
2024-12-12 19:24:38 +08:00
Yunlin Mao
c3a9bcd803
Fix python push model no disk space ( #1148 )
...
* fix python push model
2024-12-12 16:46:00 +08:00
Yingda Chen
8ba3a185e5
use streaming hash validation ( #1127 )
...
* support streaming hash
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-12-11 18:59:42 +08:00
mushenL
b9f7b60d8f
fix daily fail case 1210yk ( #1142 )
...
* init commit
* init commit
* init commit
* add AutoImageProcessor and BatchFeature
* Modify format specifications
* fix daily fail case
* fix daily fail case
2024-12-11 10:40:26 +08:00
tastelikefeet
7579fac6f3
fix ut ( #1143 )
2024-12-11 10:19:29 +08:00
yuze.zyz
1366dcf479
fix ut
2024-12-10 19:28:51 +08:00
suluyana
40b689795a
Fix ollama template ( #1141 )
...
* add marco o1
* add qwq
* feat: llama3.3
* fix space , add exaone3.5 , fix ministral
2024-12-10 14:22:02 +08:00
Yunlin Mao
31bf308e44
downgrade moviepy to 1.0.3 ( #1133 )
2024-12-10 10:10:01 +08:00
tastelikefeet
d2ef1003ea
Skip obsolete sd pipeline ( #1131 )
2024-12-05 20:07:32 +08:00
Yingda Chen
101b9249f8
fix missing import ( #1126 )
...
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-12-05 09:26:34 +08:00
Yingda Chen
8d66932e3f
make hash validation optional ( #1124 )
...
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-12-04 18:46:48 +08:00
Yingda Chen
c67ffd4cbc
optional hash
2024-12-04 18:25:52 +08:00
Yingda Chen
0411beeb05
fix windows path ( #1119 )
...
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-12-03 21:57:50 +08:00
Yingda Chen
140ac66c62
fix windows path
2024-12-03 21:51:35 +08:00
Yingda Chen
e32a9361e3
fix accuracy case sensitiveness ( #1118 )
...
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-12-03 21:25:18 +08:00
Yingda Chen
1950ec1839
add hash verficiation into cache file existence check ( #1116 )
...
* add hash check into cache file existence check
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-12-02 19:29:11 +08:00
Jintao
0daf77d489
remove unnecessary code ( #1115 )
...
* remove the extra rows
---------
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-12-02 15:34:23 +08:00
Yingda Chen
3017a70262
Handle unsupported Transformers class, and add more auto classes ( #1113 )
...
* optimize unsupported transformer class and add more automodel
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-12-02 15:17:17 +08:00
Yunlin Mao
a4582012ff
fix tqdm bar ( #1108 )
2024-12-01 15:38:03 +08:00
Jintao
a721220fa1
release transformers version to 4.33-4.46 ( #1111 )
2024-12-01 15:32:33 +08:00
tastelikefeet
46c4ce9bdd
support tag ci_image ( #1112 )
2024-12-01 15:17:25 +08:00
Jintao
b1e1f66fad
Merge release 1.20 docker ( #1109 )
2024-11-29 13:44:36 +08:00
Yingda Chen
95cad91c21
add transformers compatability for Vision2seq ( #1107 )
...
* add vision2seq
---------
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-11-29 10:35:50 +08:00
Yingda Chen
3e13cc899b
add transformer support for Qwen2vl ( #1106 )
...
* add qwen2vlconfig
* rearrange
---------
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-11-28 20:08:14 +08:00
Yingda Chen
e2bd302175
fix potential double definition for ocr pipeline ( #1102 )
...
* fix potential double definition issue
---------
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-11-28 00:43:24 +08:00
Yunlin Mao
a7856a5995
add multi-thread download ( #1095 )
...
* add thread download
* add thread download
* fix print
* change default workers to 8
* fix return cache path
* manage tqdm progress bars
---------
Co-authored-by: DaozeZhang <zdz408@126.com >
2024-11-26 20:22:36 +08:00
Yingda Chen
6d9e6d57c0
More automodel ( #1098 )
...
* add more hf alias
---------
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-11-25 22:16:05 +08:00
Yingda Chen
4a3b255d53
change warning to debug ( #1099 )
...
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-11-25 22:15:03 +08:00
Yingda Chen
5ca12c6cc4
Llamafile support gpu flag ( #1097 )
...
* add gpu flag when gpu is detected
* fix typo
* fix typo
* add printout prompt
---------
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com >
2024-11-25 16:31:52 +08:00
Jintao
e3f63fd1ea
lazy print ast logs ( #1089 )
2024-11-25 10:32:16 +08:00
