Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-02-24 12:10:09 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,586 Commits 267 Branches 107 Tags
test_r_1.23
Commit Graph

2586 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yuze.zyz
8a93110bc2 fix datetime v1.23.1 2025-02-20 11:40:47 +08:00
yuze.zyz
5f00dfb8f9 bump version 2025-02-19 18:13:13 +08:00
tastelikefeet
88e6de000d Update omegaconf (#1234) 
(cherry picked from commit e733458746)
 2025-02-19 18:12:22 +08:00
yuze.zyz
e6db19c11f safe import v1.23.0 2025-02-13 20:52:08 +08:00
yuze.zyz
b2f8abe952 avoid throwing error when create repo 2025-02-13 17:38:21 +08:00
yuze.zyz
73f58d9a8d avoid massive imports 2025-02-13 17:12:42 +08:00
yuze.zyz
66ab912bc5 fix parent-child classmethod problem 2025-02-13 14:02:53 +08:00
yuze.zyz
005fdef502 bust cache 2025-02-12 20:30:27 +08:00
yuze.zyz
cdb4dd34a7 support subfolder of from_pretrained 2025-02-12 19:31:40 +08:00
yuze.zyz
0a03095396 fix bugs of main branch name and import modules 2025-02-12 19:00:07 +08:00
yuze.zyz
4f555551a1 remove requirements to avoid a low version of timm 2025-02-12 14:55:12 +08:00
yuze.zyz
6d1598fcfc enable cache 2025-02-10 18:52:55 +08:00
yuze.zyz
7cc885af3f fix import 2025-02-10 18:39:29 +08:00
yuze.zyz
a94bbc2f1e update version 
(cherry picked from commit d501fd405b)
 2025-02-10 10:51:31 +08:00
Yingda Chen
388ecb7208 fix path name for log accuracy (#1217) 
* change log msg

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-02-08 14:53:20 +08:00
yuze.zyz
a0c91ba2f2 upgrade timm version 2025-02-08 10:28:25 +08:00
Yingda Chen
27c57d0ca1 fix name (#1216) 
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
(cherry picked from commit 555d002bae)
 2025-02-07 18:29:11 +08:00
tastelikefeet
8282a236a0 Use legacy cache (#1215) 
(cherry picked from commit b5bb6d7bb0)
 2025-02-07 17:32:44 +08:00
Yingda Chen
2df80c0c40 support multiple include/exclude filter patterns in command line (#1214) 
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
(cherry picked from commit 1f88654aa1)
 2025-02-07 17:32:33 +08:00
yuze.zyz
9dda88a399 fix docker build 2025-02-07 15:58:35 +08:00
yuze.zyz
c220b4b5dd fix cache bust 2025-02-07 14:03:30 +08:00
tastelikefeet
40a57b6a7d fix create_commit login (#1210) 
(cherry picked from commit 1cf7f4ff52)
 2025-02-06 18:23:03 +08:00
Yingda Chen
f3985d9b10 fix cache path (#1211) 
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
(cherry picked from commit 369606cda8)
 2025-02-06 18:22:54 +08:00
yuze.zyz
ad3a45bc39 bump version 2025-02-06 13:54:29 +08:00
tastelikefeet
3b4841054d clone and lint #1205 (#1209) 2025-02-06 11:36:11 +08:00
tastelikefeet
f74433f6b2 Add more patches for hf (#1160) 2025-02-06 11:09:37 +08:00
Xingjun.Wang
50726e01d5 Update upload func (#1204) 
* update upload

* update

* temp

* fix pr comments

* update api.py
 2025-02-05 20:09:18 +08:00
Xingjun.Wang
d53dc6d703 remove MODELSCOPE_SHOW_INDIVIDUAL_PROGRESS_THRESHOLD (#1206) 2025-02-05 18:47:58 +08:00
Xingjun.Wang
8048f3c6b2 update upload progress (#1203) 2025-01-31 14:37:19 +08:00
yingda
d16945ffc8 test 2025-01-31 11:17:28 +08:00
Yingda Chen
65075191f7 clean directory structure (#1201) 
默认
模型：
~/.cache/modelscope/hub/models/{model_owner}/{model_name}
数据集：
~/.cache/modelscope/hub/datasets/{dataset_owner}/{dataset_name}

配置MODELSCOPE_CACHE环境变量：
模型：
$MODELSCOPE_CACHE/models/{model_owner}/{model_name}
数据集：
$MODELSCOPE_CACHE/datasets/{dataset_owner}/{dataset_name}

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-01-23 17:31:49 +08:00
Xingjun.Wang
2c9ec4ff2d Add file size check in upload_folder (#1198) 
* add file size check in upload_folder

* update size_threshold_to_enforce_lfs
 2025-01-21 20:29:18 +08:00
suluyana
dc7e22ebeb feat: new ollama template (#1199) 
* feat: deepseek-r1, olmo2, command-r7b, deepseek-v3

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
 2025-01-21 17:49:54 +08:00
Yingda Chen
58c90dee2c fix model directory (#1197) 
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-01-20 15:19:15 +08:00
tastelikefeet
b1404cdc2e Fix typo and unused imports (#1196) 
* fix file exists of sub folder

* fix code doc

* add ci

* lint code

* fix unused imports and typo
 2025-01-18 10:22:22 +08:00
tastelikefeet
b892164d11 Fix file exists of sub folder (#1192) 
* fix file exists of sub folder

* fix code doc

* add ci

* lint code
 2025-01-18 09:59:14 +08:00
Xingjun.Wang
8387bd8e9c Fix cookies due to firewall token expired (#1193) 
* fix cookies due to firewall token expired

* update
 2025-01-18 00:57:29 +08:00
Xingjun.Wang
77d7262c22 fix lint (#1188) 2025-01-15 14:25:09 +08:00
Xingjun.Wang
648187626a Merge release 1.22 (#1187) 
* bump version 1.22.0

* fix confict between lmdeploy & vllm

* flash-attn version

* fix version building image

* fix https://www.modelscope.cn/models/iic/nlp_structbert_address-parsing_chinese_base/feedback/issueDetail/20431 (#1170)

* fix path contatenation to be windows compatabile (#1176)

* fix path contatenation to be windows compatabile

* support dataset too

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>

* logger.warning when using remote code (#1171)

* logger warning when using remote code

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>

* feat: all other ollama models (#1174)

* add cases

* new models

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>

* Unify datasets cache dir (#1178)

* fix cache

* fix lint

* fix dataset cache

* fix lint

* remove

* Add repo_id and repo_type in snapshot_download (#1172)

* add repo_id and repo_type in snapshot_download

* fix positional args

* update

* Fix/text gen (#1177)

* fix text-gen: read pipeline type from configuration.json first

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>

* update doc with llama_index (#1180)

* update version to 1.22.1

* merge release/1.22

---------

Co-authored-by: suluyana <suluyan_sly@163.com>
Co-authored-by: tastelikefeet <58414341+tastelikefeet@users.noreply.github.com>
Co-authored-by: Yingda Chen <yingdachen@apache.org>
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
Co-authored-by: suluyana <110878454+suluyana@users.noreply.github.com>
Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
Co-authored-by: Yunlin Mao <mao.looper@qq.com>
 2025-01-15 14:08:52 +08:00
Yingda Chen
70ac4db097 add file name (#1186) 
* add file name

* address cr

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-01-15 13:45:16 +08:00
Xingjun.Wang
f77b51e3c9 Support upload file and folder in the hub api (#1152) 
* update features

* update api

* add upload_file and thread_executor

* update upload file

* update api.py

* add cli for uploading

* run lint

* lint in msdataset

* temp

* add tqdm_desc in thread_executor

* update

* refine upload_file and upload_folder

* add endpoint for cli

* add uploading checker

* add path_or_fileobj and path_in_repo check in upload_file func

* add size limit to lfs: 1MB by default

* update lfs limit size: 10MB

* 5MB lfs limit

* fix test issue

* add pbar for upload_blob; del size_to_chunk_mb; fix allow_patterns and ignore_patterns

* fix commit uploaded blobs

* add update action for folder

* fix issues

* add normal files check

* update

* update

* set normal file size limit to 500MB

* update tqdm
 2025-01-14 23:59:53 +08:00
Yunlin Mao
bceb7196d1 update doc with llama_index (#1180) 2025-01-13 21:03:59 +08:00
suluyana
845a0bd5fe Fix/text gen (#1177) 
* fix text-gen: read pipeline type from configuration.json first

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
 2025-01-13 10:05:42 +08:00
Xingjun.Wang
8f3358fe50 Add repo_id and repo_type in snapshot_download (#1172) 
* add repo_id and repo_type in snapshot_download

* fix positional args

* update
 2025-01-10 23:38:46 +08:00
Yunlin Mao
26812dc028 Unify datasets cache dir (#1178) 
* fix cache

* fix lint

* fix dataset cache

* fix lint

* remove
 2025-01-10 17:56:05 +08:00
suluyana
9aa661118c feat: all other ollama models (#1174) 
* add cases

* new models

---------

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
 2025-01-10 15:42:22 +08:00
suluyana
cc6fbbab5f logger.warning when using remote code (#1171) 
* logger warning when using remote code

Co-authored-by: suluyan <suluyan.sly@alibaba-inc.com>
 2025-01-10 15:38:05 +08:00
Yingda Chen
768f953b9d fix path contatenation to be windows compatabile (#1176) 
* fix path contatenation to be windows compatabile

* support dataset too

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
 2025-01-10 13:48:44 +08:00
tastelikefeet
ba15de012f fix https://www.modelscope.cn/models/iic/nlp_structbert_address-parsing_chinese_base/feedback/issueDetail/20431 (#1170) 2025-01-06 17:29:44 +08:00
suluyana
299ece8b8a support ms-swift 3.0.0 (#1166) 2025-01-02 17:20:32 +08:00