Commit Graph

1171 Commits

Author SHA1 Message Date
tastelikefeet
75d54927e1 Support trust_remote_code for pipeline and model (#1333) 2025-05-13 22:52:57 +08:00
tastelikefeet
a91f19ea54 Support downloading exact file for hf wrapper (#1323) 2025-04-30 14:57:59 +08:00
NononoSugar
8f3e1845d2 feat: new ollama template (#1318)
Co-authored-by: jbh02127155 <jbh02127155@alibaba-inc.com>
2025-04-24 12:43:07 +08:00
Xingjun.Wang
6adc8614c9 Add create_repo and upload UTs (#1282)
* add delete_repo, delete_dataset, exists_ok in create_repo

* add UT for create_repo
2025-04-07 10:24:26 +08:00
xingjun.wxj
10aa2c6bd8 add login for HFUtilTest 2025-03-27 22:42:48 +08:00
suluyana
1d1463434d fix: pipeline builder (#1280)
* fix pipeline builder
---------

Co-authored-by: suluyan <suluyan.sly@aliabab-inc.com>
2025-03-21 12:29:06 +08:00
suluyana
41ad01681f ollama_template gemma3, command-a (#1264)
Co-authored-by: suluyan <suluyan.sly@aliabab-inc.com>
2025-03-19 08:44:48 +08:00
Yingda Chen
12d492e21f fix log level 2025-03-13 17:23:01 +08:00
xingjun.wxj
1036316afe update fallback for UTs 2025-03-12 22:39:00 +08:00
Yingda Chen
175b8d315e support dataset too 2025-03-11 18:22:29 +08:00
Yingda Chen
7d91e1b243 add tests 2025-03-11 17:05:08 +08:00
Yingda Chen
80302f3dcf Merge remote-tracking branch 'origin' into fallback 2025-03-11 14:44:03 +08:00
suluyana
0bddd46cc9 feat ollama template: 1. allow_general_name; 2. 7 new templates (#1247)
Co-authored-by: suluyan <suluyan.sly@aliabab-inc.com>
2025-03-05 10:57:52 +08:00
Yingda Chen
18fb4286d9 repo exist api support dataset 2025-03-04 15:18:37 +08:00
chenzhaofei01
51d27d7d04 face recognition pipline adds use_det parameter to control whether to use face detection model (#1212)
* face recognition pipline adds use_det parameter to control whether to use face detection model

---------

Co-authored-by: zhaoshao <chenzhaofei.czf@alibaba-inc.com>
2025-03-03 14:15:36 +08:00
suluyana
57044b9c88 feat: compatible with hf_pipeline (#1221)
compatible with hf_pipeline
2025-02-21 15:49:39 +08:00
Yingda Chen
1f88654aa1 support multiple include/exclude filter patterns in command line (#1214)
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2025-02-07 16:02:37 +08:00
tastelikefeet
1cf7f4ff52 fix create_commit login (#1210) 2025-02-06 18:22:29 +08:00
tastelikefeet
f74433f6b2 Add more patches for hf (#1160) 2025-02-06 11:09:37 +08:00
Yingda Chen
65075191f7 clean directory structure (#1201)
默认
模型:
~/.cache/modelscope/hub/models/{model_owner}/{model_name}
数据集:
~/.cache/modelscope/hub/datasets/{dataset_owner}/{dataset_name}

配置MODELSCOPE_CACHE环境变量:
模型:
$MODELSCOPE_CACHE/models/{model_owner}/{model_name}
数据集:
$MODELSCOPE_CACHE/datasets/{dataset_owner}/{dataset_name}

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2025-01-23 17:31:49 +08:00
suluyana
dc7e22ebeb feat: new ollama template (#1199)
* feat: deepseek-r1, olmo2, command-r7b, deepseek-v3

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
2025-01-21 17:49:54 +08:00
tastelikefeet
b1404cdc2e Fix typo and unused imports (#1196)
* fix file exists of sub folder

* fix code doc

* add ci

* lint code

* fix unused imports and typo
2025-01-18 10:22:22 +08:00
tastelikefeet
b892164d11 Fix file exists of sub folder (#1192)
* fix file exists of sub folder

* fix code doc

* add ci

* lint code
2025-01-18 09:59:14 +08:00
suluyana
9aa661118c feat: all other ollama models (#1174)
* add cases

* new models

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
2025-01-10 15:42:22 +08:00
suluyana
1fe211ffe5 fix pipeline builder when model is not supported (#1125)
* fix pipeline builder when model is not supported

* fix ci & skip
---------

Co-authored-by: suluyan.sly@alibaba-inc.com <suluyan.sly@alibaba-inc.com>
2024-12-12 19:24:38 +08:00
tastelikefeet
7579fac6f3 fix ut (#1143) 2024-12-11 10:19:29 +08:00
suluyana
40b689795a Fix ollama template (#1141)
* add marco o1

* add qwq

* feat: llama3.3

* fix space , add exaone3.5 , fix ministral
2024-12-10 14:22:02 +08:00
tastelikefeet
d2ef1003ea Skip obsolete sd pipeline (#1131) 2024-12-05 20:07:32 +08:00
Yingda Chen
e32a9361e3 fix accuracy case sensitiveness (#1118)
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-12-03 21:25:18 +08:00
Yingda Chen
2b1c839918 Format llm pipeline (#1094)
* format llm pipeline

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-11-22 20:04:59 +08:00
Yingda Chen
63febc58a6 add llamafile support to command line (#1087)
* add llamafile support to command line


Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-11-20 09:24:58 +08:00
suluyana
19fc9dc3f1 feat ollama template: llama3.2-vision (#1070) 2024-11-07 16:09:12 +08:00
suluyana
ae1541846b Template.to_ollama: add new argument split (#1039)
feat: 1. add new argument `split` 2. ollama template
2024-11-04 13:46:07 +08:00
Yingda Chen
83f1e20e80 add repo existence check hub-api (#1060)
* add repo existence check api

* update

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-11-02 08:04:40 +08:00
Mark
250b72fce7 fix: text error correction batch run bug (#1052)
Co-authored-by: Mark <smartmark-pro@qq.com>
2024-11-01 09:35:19 +08:00
Mashiro
e71057cacf feat(audio/ans): Add ZipEnhancer and related layers for acoustic nois… (#1019)
* feat(audio): Add acoustic noise suppression pipeline and tests for zipenhancer model

* Introduce `ZipEnhancer` module and associated layers (`ZipEnhancerLayer`, `Generator`, `ZipFormer`, ...).
* Add `speech_zipenhancer_ans_multiloss_16k_base` pipeline for `ZipEnhancer` module.
* Add new test cases and update metainfo.


Co-authored-by: Haoxu Wang <wanghaoxu.whx@alibaba-inc.com>
2024-10-24 15:38:09 +08:00
suluyana
bacdc53327 fix: set device_map=cuda if using gptq in gpu (#1027) 2024-10-17 17:13:22 +08:00
Xingjun.Wang
eab95f909f del ignore_verifications and add trust_remote_code for local py_script (#1021) 2024-10-15 12:41:12 +08:00
tastelikefeet
b0f03ffd6d Fix template of eos_token (#1013) 2024-10-10 21:40:51 +08:00
suluyana
bd1544bef0 fix template: llava-llama-3 & yi-1.5 (#1011) 2024-10-10 10:01:45 +08:00
Xingjun.Wang
2c4505e13a Adapt new datasets (#1002)
* update ds==3.0

* update

* add http_get_ms func

* del unused code

* fix pr issue and update requirements
2024-09-30 16:46:00 +08:00
tastelikefeet
834db59952 template and ollama in modelscope (#995) 2024-09-29 19:13:50 +08:00
tastelikefeet
74d97ea7e0 Refactor zero sized file downloading (#991) 2024-09-14 15:12:28 +08:00
tastelikefeet
96e33878b4 lint code (#970) 2024-09-02 10:16:35 +08:00
yuze.zyz
8b5a5bd1e3 fix 2024-09-01 18:37:01 +08:00
Xingjun.Wang
3f7ce97319 Fix streaming load issues (#953)
* fix streaming context

* add ut for stream
2024-08-22 14:43:37 +08:00
liuyhwangyh
96dfccbd75 fix compatible of origin command line (#944)
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-08-07 18:31:45 +08:00
liuyhwangyh
bf7c717e17 fix file download off by one bug (#943)
* fix file download off by one bug, command line default download model, add repo-type parameter
---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-08-07 10:40:25 +08:00
mulin.lyh
da9f3e58e3 enable download branch 2024-07-31 18:10:44 +08:00
mulin.lyh
775c29ef79 optimize code 2024-07-31 17:01:06 +08:00