Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-02-24 04:01:10 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,578 Commits 267 Branches 107 Tags
fix/import
Commit Graph

2578 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
suluyan
c45bc6d19f rm import 2025-03-11 10:11:13 +08:00
suluyan
30d8995cd9 rm import 2025-03-11 10:11:00 +08:00
suluyana
0bddd46cc9 feat ollama template: 1. allow_general_name; 2. 7 new templates (#1247) 
Co-authored-by: suluyan <suluyan.sly@aliabab-inc.com>
 2025-03-05 10:57:52 +08:00
Xingjun.Wang
011d774be2 Refine CommitInfo (#1244) 
* test

* update

* refine commit info

* refine commit info
 2025-03-03 20:07:51 +08:00
chenzhaofei01
51d27d7d04 face recognition pipline adds use_det parameter to control whether to use face detection model (#1212) 
* face recognition pipline adds use_det parameter to control whether to use face detection model

---------

Co-authored-by: zhaoshao <chenzhaofei.czf@alibaba-inc.com>
 2025-03-03 14:15:36 +08:00
Yingda Chen
352336a8a2 Add download token (#1233) 
* update token behavior

* fix

* fixt

* address cr

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-02-24 22:59:06 +08:00
suluyana
57044b9c88 feat: compatible with hf_pipeline (#1221) 
compatible with hf_pipeline
 2025-02-21 15:49:39 +08:00
tastelikefeet
e733458746 Update omegaconf (#1234) 2025-02-19 18:11:23 +08:00
tastelikefeet
7246d0b359 Merge 1.23 hotfix to master (#1227) 2025-02-17 10:30:24 +08:00
Yingda Chen
98ac5605de fix visibility (#1222) 
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-02-11 20:37:14 +08:00
Yingda Chen
a3e4e632bf fix path name for log accuracy (#1217) 
* change log msg

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-02-08 14:47:35 +08:00
Yingda Chen
555d002bae fix name (#1216) 
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-02-07 18:27:26 +08:00
tastelikefeet
b5bb6d7bb0 Use legacy cache (#1215) 2025-02-07 17:31:32 +08:00
Yingda Chen
1f88654aa1 support multiple include/exclude filter patterns in command line (#1214) 
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-02-07 16:02:37 +08:00
tastelikefeet
1cf7f4ff52 fix create_commit login (#1210) 2025-02-06 18:22:29 +08:00
Yingda Chen
369606cda8 fix cache path (#1211) 
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-02-06 17:05:32 +08:00
tastelikefeet
3b4841054d clone and lint #1205 (#1209) 2025-02-06 11:36:11 +08:00
tastelikefeet
f74433f6b2 Add more patches for hf (#1160) 2025-02-06 11:09:37 +08:00
Xingjun.Wang
50726e01d5 Update upload func (#1204) 
* update upload

* update

* temp

* fix pr comments

* update api.py
 2025-02-05 20:09:18 +08:00
Xingjun.Wang
d53dc6d703 remove MODELSCOPE_SHOW_INDIVIDUAL_PROGRESS_THRESHOLD (#1206) 2025-02-05 18:47:58 +08:00
Xingjun.Wang
8048f3c6b2 update upload progress (#1203) 2025-01-31 14:37:19 +08:00
yingda
d16945ffc8 test 2025-01-31 11:17:28 +08:00
Yingda Chen
65075191f7 clean directory structure (#1201) 
默认
模型：
~/.cache/modelscope/hub/models/{model_owner}/{model_name}
数据集：
~/.cache/modelscope/hub/datasets/{dataset_owner}/{dataset_name}

配置MODELSCOPE_CACHE环境变量：
模型：
$MODELSCOPE_CACHE/models/{model_owner}/{model_name}
数据集：
$MODELSCOPE_CACHE/datasets/{dataset_owner}/{dataset_name}

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-01-23 17:31:49 +08:00
Xingjun.Wang
2c9ec4ff2d Add file size check in upload_folder (#1198) 
* add file size check in upload_folder

* update size_threshold_to_enforce_lfs
 2025-01-21 20:29:18 +08:00
suluyana
dc7e22ebeb feat: new ollama template (#1199) 
* feat: deepseek-r1, olmo2, command-r7b, deepseek-v3

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
 2025-01-21 17:49:54 +08:00
Yingda Chen
58c90dee2c fix model directory (#1197) 
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-01-20 15:19:15 +08:00
tastelikefeet
b1404cdc2e Fix typo and unused imports (#1196) 
* fix file exists of sub folder

* fix code doc

* add ci

* lint code

* fix unused imports and typo
 2025-01-18 10:22:22 +08:00
tastelikefeet
b892164d11 Fix file exists of sub folder (#1192) 
* fix file exists of sub folder

* fix code doc

* add ci

* lint code
 2025-01-18 09:59:14 +08:00
Xingjun.Wang
8387bd8e9c Fix cookies due to firewall token expired (#1193) 
* fix cookies due to firewall token expired

* update
 2025-01-18 00:57:29 +08:00
Xingjun.Wang
77d7262c22 fix lint (#1188) 2025-01-15 14:25:09 +08:00
Xingjun.Wang
648187626a Merge release 1.22 (#1187) 
* bump version 1.22.0

* fix confict between lmdeploy & vllm

* flash-attn version

* fix version building image

* fix https://www.modelscope.cn/models/iic/nlp_structbert_address-parsing_chinese_base/feedback/issueDetail/20431 (#1170)

* fix path contatenation to be windows compatabile (#1176)

* fix path contatenation to be windows compatabile

* support dataset too

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>

* logger.warning when using remote code (#1171)

* logger warning when using remote code

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>

* feat: all other ollama models (#1174)

* add cases

* new models

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>

* Unify datasets cache dir (#1178)

* fix cache

* fix lint

* fix dataset cache

* fix lint

* remove

* Add repo_id and repo_type in snapshot_download (#1172)

* add repo_id and repo_type in snapshot_download

* fix positional args

* update

* Fix/text gen (#1177)

* fix text-gen: read pipeline type from configuration.json first

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>

* update doc with llama_index (#1180)

* update version to 1.22.1

* merge release/1.22

---------

Co-authored-by: suluyana <suluyan_sly@163.com>
Co-authored-by: tastelikefeet <58414341+tastelikefeet@users.noreply.github.com>
Co-authored-by: Yingda Chen <yingdachen@apache.org>
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
Co-authored-by: suluyana <110878454+suluyana@users.noreply.github.com>
Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
Co-authored-by: Yunlin Mao <mao.looper@qq.com>
 2025-01-15 14:08:52 +08:00
Yingda Chen
70ac4db097 add file name (#1186) 
* add file name

* address cr

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-01-15 13:45:16 +08:00
Xingjun.Wang
f77b51e3c9 Support upload file and folder in the hub api (#1152) 
* update features

* update api

* add upload_file and thread_executor

* update upload file

* update api.py

* add cli for uploading

* run lint

* lint in msdataset

* temp

* add tqdm_desc in thread_executor

* update

* refine upload_file and upload_folder

* add endpoint for cli

* add uploading checker

* add path_or_fileobj and path_in_repo check in upload_file func

* add size limit to lfs: 1MB by default

* update lfs limit size: 10MB

* 5MB lfs limit

* fix test issue

* add pbar for upload_blob; del size_to_chunk_mb; fix allow_patterns and ignore_patterns

* fix commit uploaded blobs

* add update action for folder

* fix issues

* add normal files check

* update

* update

* set normal file size limit to 500MB

* update tqdm
 2025-01-14 23:59:53 +08:00
Yunlin Mao
bceb7196d1 update doc with llama_index (#1180) 2025-01-13 21:03:59 +08:00
suluyana
845a0bd5fe Fix/text gen (#1177) 
* fix text-gen: read pipeline type from configuration.json first

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
 2025-01-13 10:05:42 +08:00
Xingjun.Wang
8f3358fe50 Add repo_id and repo_type in snapshot_download (#1172) 
* add repo_id and repo_type in snapshot_download

* fix positional args

* update
 2025-01-10 23:38:46 +08:00
Yunlin Mao
26812dc028 Unify datasets cache dir (#1178) 
* fix cache

* fix lint

* fix dataset cache

* fix lint

* remove
 2025-01-10 17:56:05 +08:00
suluyana
9aa661118c feat: all other ollama models (#1174) 
* add cases

* new models

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
 2025-01-10 15:42:22 +08:00
suluyana
cc6fbbab5f logger.warning when using remote code (#1171) 
* logger warning when using remote code

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
 2025-01-10 15:38:05 +08:00
Yingda Chen
768f953b9d fix path contatenation to be windows compatabile (#1176) 
* fix path contatenation to be windows compatabile

* support dataset too

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-01-10 13:48:44 +08:00
tastelikefeet
ba15de012f fix https://www.modelscope.cn/models/iic/nlp_structbert_address-parsing_chinese_base/feedback/issueDetail/20431 (#1170) 2025-01-06 17:29:44 +08:00
suluyana
299ece8b8a support ms-swift 3.0.0 (#1166) 2025-01-02 17:20:32 +08:00
Xingjun.Wang
71a54c1a51 support latest datasets version (#1163) 2025-01-02 17:06:46 +08:00
tastelikefeet
d257fdeac6 fix lint (#1168) 2025-01-02 17:06:24 +08:00
tastelikefeet
a89bb73995 fix check model (#1134) 2025-01-02 16:08:10 +08:00
Xingjun.Wang
9ee1ff8cee Update downloading progress (#1167) 
* add MODELSCOPE_SHOW_PROGRESS_THRESHOLD

* lint

* update: MODELSCOPE_SHOW_INDIVIDUAL_PROGRESS_THRESHOLD
 2024-12-31 18:28:15 +08:00
Yingda Chen
391c6cdec9 handle resuming download as retry (#1147) 
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2024-12-30 12:48:55 +08:00
Xingjun.Wang
8f3cf81982 Improve&fix dataset download command line (#1158) 
* fix dataset download cli

* fix default revision

* pre-commit

* add --max-workers for cli

* pre-commit

* update default max_workers
 2024-12-27 14:30:19 +08:00
suluyana
60780769b1 Fix/daily (#1155) 
* fix(llm ppl): 1. cache position; 2. stream_gready_search; 3. swift_mapping

* fix punkt

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
 2024-12-23 09:55:12 +08:00
Yingda Chen
9304d40539 fix user-specified cache path (#1154) 
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2024-12-18 09:01:41 +08:00