Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-22 19:19:21 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,822 Commits 263 Branches 106 Tags
update/list_datasets
Commit Graph

1195 Commits

Author SHA1 Message Date
Yunnglin
d9e0fb7221 update list datasets 2025-10-31 17:02:21 +08:00
Gongsheng Li
3fd95b1bd7 Feat/support commit scheduler (#1480) 2025-10-21 16:41:55 +08:00
Gongsheng Li
4733d5374b add support for siblings field in repo_info (#1490) 2025-09-08 17:22:29 +08:00
Gongsheng Li
2fc6d8e822 Feat/support repo info (#1483) 2025-08-29 17:23:46 +08:00
tastelikefeet
a5039281d3 skip aigc test (#1476) 2025-08-23 11:12:35 +08:00
Xingjun.Wang
7d11b77112 Fix trust_remote_code (#1462) 
1. Set `trust_remote_code` to `True` by default in datasets module
2. Set `trust_remote_code` to `True` by default in PolyLM pipeline
 2025-08-14 10:56:16 +08:00
Xingjun.Wang
055496c597 Fix CI 2025-08-07 19:26:32 +08:00
Xingjun.Wang
0e49156bbe fix TestTinynasDamoyoloTrainerSingleGPU (#1449) 2025-08-06 18:50:25 +08:00
Koko-ry
1d93f7e56d Feat: Add AIGC model creation support to create_model (#1431) 
1.  Add create aigc model in `create_model` func
2. Add CLI for creating aigc model
 2025-08-06 17:01:42 +08:00
suluyana
53ceca4df4 feat: sentence_embedding pipeline (#1435) 2025-08-06 15:43:36 +08:00
Xingjun.Wang
ee05e12d75 Add create repo cli (#1445) 2025-08-05 21:42:41 +08:00
Koko-ry
51e28f5a49 Feat: add atomic capabilities - MCPApi (#1426) 2025-08-05 21:41:26 +08:00
tastelikefeet
d8bb003681 fix bug (#1441) 2025-08-04 22:05:49 +08:00
Yunlin Mao
ff7551c494 fix large log in scan cache test (#1439) 2025-08-04 20:58:30 +08:00
suluyana
b3d24d18e6 ollama template: qwen3-coder, gemma3n, mistral-small3.2, magistral, devstral (#1434) 
Co-authored-by: suluyan <suluyan.sly@aliabab-inc.com>
 2025-08-04 17:07:06 +08:00
tastelikefeet
556aa76dc3 fix pyyaml according to: https://github.com/Anchor0221/CVE-2025-50460 (#1428) 2025-08-01 22:04:44 +08:00
Koko-ry
d6f11c1c22 Skip UT TextToSpeechSambertHifigan16kPipelineTest temporarily (#1420) 2025-07-17 18:57:44 +08:00
tastelikefeet
f01864a2f9 weak file lock (#1417) 2025-07-17 18:38:24 +08:00
Jintao
29ea57dfbc [hub] Support ProgressCallback (#1380) 
1. Add ProgressCallback for file download
 2025-06-26 14:02:05 +08:00
Emmanuel Ferdman
7d71b45fa7 fix: migrate to unittest.assertNotEqual (#1350) 
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
 2025-06-05 14:54:45 +08:00
co63oc
8323fc5185 Fix typos in multiple files (#1357) 2025-06-05 14:04:29 +08:00
suluyana
800543d1aa fix: ollama template mapping (#1354) 
* feat ollama template qwen3

* add phi4, llama4, qwen2.5vl

* fix dpsk-r1-qwen3

* rm duplicate case

---------

Co-authored-by: suluyan <suluyan.sly@aliabab-inc.com>
 2025-06-04 20:13:35 +08:00
Z-yq
f9b8d4b9d2 vc ssr (#1208) 
* vc ssr

* Add more patches for hf (#1160)

* clone and lint #1205 (#1209)

* 更新格式

* fix cache path (#1211)

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>

* “update"

* fix create_commit login (#1210)

* support multiple include/exclude filter patterns in command line (#1214)

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>

* Use legacy cache (#1215)

* fix name (#1216)

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>

* fix path name for log accuracy (#1217)


* change log msg

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>

* fix visibility (#1222)

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>

* Merge 1.23 hotfix to master (#1227)

* 修复格式问题

* fix 路径问题

* Update test_speech_super_resolution.py

* Update test_voice_conversion.py

---------

Co-authored-by: tastelikefeet <58414341+tastelikefeet@users.noreply.github.com>
Co-authored-by: Yingda Chen <yingdachen@apache.org>
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
Co-authored-by: zhongyuqi <zhongyuqi@microbt.com>
 2025-06-04 16:08:20 +08:00
Yunlin Mao
b034267345 [Feature] Add scan_cache_dir function (#1348) 
* init cache manager

* add scan cache

* fix lint

* add scan cache unit test

* add download first for scan cache test
 2025-05-28 09:59:03 +08:00
tastelikefeet
75d54927e1 Support trust_remote_code for pipeline and model (#1333) 2025-05-13 22:52:57 +08:00
tastelikefeet
a91f19ea54 Support downloading exact file for hf wrapper (#1323) 2025-04-30 14:57:59 +08:00
NononoSugar
8f3e1845d2 feat: new ollama template (#1318) 
Co-authored-by: jbh02127155 <jbh02127155@alibaba-inc.com>
 2025-04-24 12:43:07 +08:00
Xingjun.Wang
6adc8614c9 Add create_repo and upload UTs (#1282) 
* add delete_repo, delete_dataset, exists_ok in create_repo

* add UT for create_repo
 2025-04-07 10:24:26 +08:00
xingjun.wxj
10aa2c6bd8 add login for HFUtilTest 2025-03-27 22:42:48 +08:00
suluyana
1d1463434d fix: pipeline builder (#1280) 
* fix pipeline builder
---------

Co-authored-by: suluyan <suluyan.sly@aliabab-inc.com>
 2025-03-21 12:29:06 +08:00
suluyana
41ad01681f ollama_template gemma3, command-a (#1264) 
Co-authored-by: suluyan <suluyan.sly@aliabab-inc.com>
 2025-03-19 08:44:48 +08:00
Yingda Chen
12d492e21f fix log level 2025-03-13 17:23:01 +08:00
xingjun.wxj
1036316afe update fallback for UTs 2025-03-12 22:39:00 +08:00
Yingda Chen
175b8d315e support dataset too 2025-03-11 18:22:29 +08:00
Yingda Chen
7d91e1b243 add tests 2025-03-11 17:05:08 +08:00
Yingda Chen
80302f3dcf Merge remote-tracking branch 'origin' into fallback 2025-03-11 14:44:03 +08:00
suluyana
0bddd46cc9 feat ollama template: 1. allow_general_name; 2. 7 new templates (#1247) 
Co-authored-by: suluyan <suluyan.sly@aliabab-inc.com>
 2025-03-05 10:57:52 +08:00
Yingda Chen
18fb4286d9 repo exist api support dataset 2025-03-04 15:18:37 +08:00
chenzhaofei01
51d27d7d04 face recognition pipline adds use_det parameter to control whether to use face detection model (#1212) 
* face recognition pipline adds use_det parameter to control whether to use face detection model

---------

Co-authored-by: zhaoshao <chenzhaofei.czf@alibaba-inc.com>
 2025-03-03 14:15:36 +08:00
suluyana
57044b9c88 feat: compatible with hf_pipeline (#1221) 
compatible with hf_pipeline
 2025-02-21 15:49:39 +08:00
Yingda Chen
1f88654aa1 support multiple include/exclude filter patterns in command line (#1214) 
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-02-07 16:02:37 +08:00
tastelikefeet
1cf7f4ff52 fix create_commit login (#1210) 2025-02-06 18:22:29 +08:00
tastelikefeet
f74433f6b2 Add more patches for hf (#1160) 2025-02-06 11:09:37 +08:00
Yingda Chen
65075191f7 clean directory structure (#1201) 
默认
模型：
~/.cache/modelscope/hub/models/{model_owner}/{model_name}
数据集：
~/.cache/modelscope/hub/datasets/{dataset_owner}/{dataset_name}

配置MODELSCOPE_CACHE环境变量：
模型：
$MODELSCOPE_CACHE/models/{model_owner}/{model_name}
数据集：
$MODELSCOPE_CACHE/datasets/{dataset_owner}/{dataset_name}

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-01-23 17:31:49 +08:00
suluyana
dc7e22ebeb feat: new ollama template (#1199) 
* feat: deepseek-r1, olmo2, command-r7b, deepseek-v3

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
 2025-01-21 17:49:54 +08:00
tastelikefeet
b1404cdc2e Fix typo and unused imports (#1196) 
* fix file exists of sub folder

* fix code doc

* add ci

* lint code

* fix unused imports and typo
 2025-01-18 10:22:22 +08:00
tastelikefeet
b892164d11 Fix file exists of sub folder (#1192) 
* fix file exists of sub folder

* fix code doc

* add ci

* lint code
 2025-01-18 09:59:14 +08:00
suluyana
9aa661118c feat: all other ollama models (#1174) 
* add cases

* new models

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
 2025-01-10 15:42:22 +08:00
suluyana
1fe211ffe5 fix pipeline builder when model is not supported (#1125) 
* fix pipeline builder when model is not supported

* fix ci & skip
---------

Co-authored-by: suluyan.sly@alibaba-inc.com <suluyan.sly@alibaba-inc.com>
 2024-12-12 19:24:38 +08:00
tastelikefeet
7579fac6f3 fix ut (#1143) 2024-12-11 10:19:29 +08:00