Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-23 03:29:27 +01:00
Code Issues Packages Projects Releases Wiki Activity
832 Commits 263 Branches 106 Tags
40b677095605594d426b9c731687fb834d04b4fc
Commit Graph

32 Commits

Author SHA1 Message Date
mulin.lyh
5302259a0a [to #45854437]fix: add user name to user-agent 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10584797
 2022-10-31 22:46:17 +08:00
mulin.lyh
3791ee7ad2 [to #45821936]fix: fix block user specify revision after release_datetime 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10572162
 2022-10-29 13:44:47 +08:00
xingjun.wxj
78f29cf999 [to #42322933] Add delete datasets files and upload mode. 
1. Add : MsDataset.delete() , support delete dataset file or dir.

2. Add: upload mode,  MsDataset.upload(xx, upload_mode=UploadMode.FORCE_UPLOAD), or  MsDataset.upload(xx, upload_mode=UploadMode.APPEND_UPLOAD)
     if upload_mode = UploadMode.APPEND_UPLOAD, then skip object in case of this object exists.

3. Add: support reload sts token automatically to avoid expire. (current expiration: 24h)

4. Fix: add cookies in api.py for downloading private datasets.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10524449
 2022-10-27 20:30:35 +08:00
mulin.lyh
3b75623be4 [to #45773874]fix: get_model revision=None bug, and hub case occasionally delete test model failed 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10549680
 2022-10-27 17:06:18 +08:00
jiaqi.sjq
7b84adc914 [to #42322933]Fix remove files in local model not take effect to remote repo after push_model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10533214
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10533214
 2022-10-26 19:15:43 +08:00
mulin.lyh
384377b8f5 * [to #45486649]feat: modelscope model version use model repo tag, unsupport branch or commit it, client user-agent header unified 2022-10-26 13:55:51 +08:00
mulin.lyh
b41d275c70 [to #45703335]feat: refactor deploy 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10501307
 2022-10-25 09:05:33 +08:00
mulin.lyh
7257f6c6fb [to #45631658]feat support eas deploy 
服务端文档链接(可能需要登录)：
https://test.modelscope.cn/api/v1/deployer/docs
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10478609
 2022-10-24 15:12:48 +08:00
yingda.chen
3cd5f73da0 [to #42322933] refactor push_model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10463992
 2022-10-20 10:28:15 +08:00
xingjun.wxj
9809d960b0 [to #42322933] Fix issue -- it's not necessary to login for loading public datasets. 
修复”公开数据集需要登录才能load“的问题
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10448936
 2022-10-19 10:09:06 +08:00
xingjun.wxj
1b4d5ccb9c [to #42322933]MsDataset upload and load supports directory. 
上传和下载支持多文件操作
 2022-10-14 18:32:38 +08:00
mulin.lyh
5bdb8fb78b [to #45451935]fix: add create model detail log for create failed. 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10382795
 2022-10-13 18:30:06 +08:00
wenmeng.zwm
6808e9a301 [to #44902099] add license for framework files 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10189613
 2022-09-20 17:49:31 +08:00
xingjun.wxj
7cb72cc46e [to #42322933]MsDataset upload bugfix for 0830 version. 
CR link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10109035#tab=changes&file=8348e8153b2f4a6dbd52e471b4980542355408ed

Please refer to aone links:

1. https://aone.alibaba-inc.com/v2/project/1162242/bug#viewIdentifier=b622c099e2199bc034401fbe&openWorkitemIdentifier=44889184

2. https://aone.alibaba-inc.com/v2/project/1162242/bug#viewIdentifier=b622c099e2199bc034401fbe&openWorkitemIdentifier=44858810

3. https://aone.alibaba-inc.com/v2/project/1162242/bug#viewIdentifier=b622c099e2199bc034401fbe&openWorkitemIdentifier=44857728

4. https://aone.alibaba-inc.com/v2/project/1162242/bug#viewIdentifier=b622c099e2199bc034401fbe&openWorkitemIdentifier=44658972
 2022-09-14 19:24:48 +08:00
xingjun.wxj
44033290d4 [to #42322933]MsDataset 支持上传数据集压缩包和meta 
1. MsDataset支持upload数据文件(压缩包)
2. MsDataset支持clone和upload meta data
3. 使用MsDataset.load()下载数据集，支持web端显示数据集下载计数
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9831232
 2022-08-25 22:28:10 +08:00
feiwu.yfw
35548bd492 [to #43875101] 
msdataset add coco dataset
unify taskdataset and ms dataset
fix hf datasets
 2022-08-17 22:51:22 +08:00
mulin.lyh
c57c91c359 [to #44031139]fix: fix hub ci case delete test project failure 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9736416

    * [to #44031139]fix: fix hub ci case delete test project failure
 2022-08-12 13:56:47 +08:00
mulin.lyh
0555a79693 [to #43776187] fix: fix token file name modify issue. 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9623747

    * [to #43776187]fix: fix git credminal file name change
 2022-08-03 15:41:43 +08:00
mulin.lyh
23658a63d7 [to #43751767]fix: get_model api url parameter is error 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9611548

    * [to #43751767]fix: get_model api url parameter is error
 2022-08-02 21:58:32 +08:00
mulin.lyh
47dda0a5f9 [to #43698011]feat: login with access token 2022-08-02 18:16:28 +08:00
feiwu.yfw
743e876981 [to #43660556] msdataset数据集加载 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9552632

* load csv dataset from modelscoop
 2022-07-29 12:22:48 +08:00
zhangzhicheng.zzc
016d22d8fb [to #43259593]update abs paths typo 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9491629
 2022-07-25 13:29:26 +08:00
mulin.lyh
c4fb2445d6 [to #43259593]feat: add list model api 
添加list model查询api
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9446917
 2022-07-22 22:46:01 +08:00
yingda.chen
d532d45559 [to #42322933]unified revision control 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9319772
 2022-07-08 20:20:42 +08:00
mulin.lyh
3eed264bad [to #43040150] fix: login warn refactor, error message when exception, ut case to new user 
未登录warn提示信息重构，只有遇到请求失败，exception时，如果cookie为空，提示用户login，单元测试用户修改成单独
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9283579

    * [to #42322933] add space dialog-state tracking pipeline 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9227018

    * init

* token to ids

* add model

* model forward ready

* add intent

* intent preprocessor ready

* intent success

* merge master

* test with model hub

* add flake8

* update

* update

* update

* Merge branch 'master' into nlp/space/gen

* delete file about gen

* init

* fix flake8 bug

* [to #42322933] init

* bug fix

* [to #42322933] init

* update pipeline registry info

* Merge remote-tracking branch 'origin/master' into feat/nli

* [to #42322933] init

* [to #42322933] init

* modify forward

* [to #42322933] init

* generation ready

* init

* Merge branch 'master' into feat/zero_shot_classification

# Conflicts:
#	modelscope/preprocessors/__init__.py

* [to #42322933] bugfix

* [to #42322933] pre commit fix

* fill mask

* registry multi models on model and pipeline

* add tests

* test level >= 0

* local gen ready

* merge with master

* dialog modeling ready

* fix comments: rename and refactor AliceMindMLM; adjust pipeline

* space intent and modeling(generation) are ready

* bug fix

* add dep

* add dep

* support dst data processor

* merge with nlp/space/dst

* merge with master

* Merge remote-tracking branch 'origin' into feat/fill_mask

Conflicts:
	modelscope/models/nlp/__init__.py
	modelscope/pipelines/builder.py
	modelscope/pipelines/outputs.py
	modelscope/preprocessors/nlp.py
	requirements/nlp.txt

* merge with master

* merge with master 2/2

* fix comments

* fix isort for pre-commit check

* allow params pass to pipeline's __call__ method

* Merge remote-tracking branch 'origin/master' into feat/zero_shot_classification

* merge with nli task

* merge with sentiment_classification

* merge with zero_shot_classfication

* merge with fill_mask

* merge with space

* merge with master head

* Merge remote-tracking branch 'origin' into feat/fill_mask

Conflicts:
	modelscope/utils/constant.py

* fix: pipeline module_name from model_type to 'fill_mask' & fix merge bug

* unfiinished change

* fix bug

* unfinished

* unfinished

* revise modelhub dependency

* Merge branch 'feat/nlp_refactor' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/nlp_refactor

* add eval() to pipeline call

* add test level

* ut run passed

* add default args

* tmp

* merge master

* all ut passed

* remove an useless enum

* revert a mis modification

* revert a mis modification

* Merge commit 'ace8af92465f7d772f035aebe98967726655f12c' into feat/nlp

* commit 'ace8af92465f7d772f035aebe98967726655f12c':
  [to #42322933] Add cv-action-recongnition-pipeline to maas lib
  [to #42463204]  support Pil.Image for image_captioning_pipeline
  [to #42670107] restore pydataset test
  [to #42322933] add create if not exist and add(back) create model example         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
  [to #41474818]fix: fix errors in task name definition

# Conflicts:
#	modelscope/pipelines/builder.py
#	modelscope/utils/constant.py

* Merge branch 'feat/nlp' into feat/nlp_refactor

* feat/nlp:
  [to #42322933] Add cv-action-recongnition-pipeline to maas lib
  [to #42463204]  support Pil.Image for image_captioning_pipeline
  [to #42670107] restore pydataset test
  [to #42322933] add create if not exist and add(back) create model example         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
  [to #41474818]fix: fix errors in task name definition

# Conflicts:
#	modelscope/pipelines/builder.py

* fix compile bug

* refactor space

* Merge branch 'feat/nlp_refactor' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/nlp_refactor

* Merge remote-tracking branch 'origin' into feat/fill_mask

* fix

* pre-commit lint

* lint file

* lint file

* lint file

* update modelhub dependency

* lint file

* ignore dst_processor temporary

* solve comment: 1. change MaskedLMModelBase to MaskedLanguageModelBase 2. remove a useless import

* recommit

* remove MaskedLanguageModel from __all__

* Merge commit '1a0d4af55a2eee69d89633874890f50eda8f8700' into feat/nlp_refactor

* commit '1a0d4af55a2eee69d89633874890f50eda8f8700':
  [to #42322933] test level check         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9143809
  [to #42322933] update nlp models name in metainfo         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9134657

# Conflicts:
#	modelscope/metainfo.py

* update

* revert pipeline params update

* remove zeroshot

* update sequence classfication outpus

* merge with fill mask

* Merge remote-tracking branch 'origin' into feat/fill_mask

* fix

* init dialog state tracking

* fix flake8 warning of dst

* Merge remote-tracking branch 'origin/feat/fill_mask' into feat/nlp

* merge with master

* remove useless test.py

* add init

* merge nlp

* Merge remote-tracking branch 'origin/master' into feat/nlp

* remove unformatted space trainer

* Merge branch 'feat/nlp' into nlp/space/dst

* revise based on comment except chinease comment

* skip ci blocking

* change Chinese notes of space3.0 into English

* translate chinese comment to english

* add space to metainfo

* space dst pipeline is ready, but model's result is wrong

* merge feat/nlp

* merge with master

* change processor

* change example

* test case ready

* dst loacl ready

* update dst conf

* merge feat/nlp

* inform revise

* inherit bug fix

* init

* add 2 complete examples

* fix bug

* add test case

* merge with master

* modify model name

* add missing setting

* add outputs

* modify test level

* modify chinese comment

* remove useless doc

* merge feat/nlp

* Merge remote-tracking branch 'origin' into nlp/space/dst

* Merge branch 'feat/nlp' into nlp/space/dst

* dst test ready

* merge feat nlp

* space outputs normalization

* update dst

* merge feat nlp

* Merge branch 'master' into nlp/space/dst

* update requirement

* merge with master

* Merge remote-tracking branch 'origin/master' into nlp/space/dst

* formating output

* update requirements/nlp

* merge with master

* add test cases

* Merge remote-tracking branch 'origin/master' into nlp/space/dst

* merge with master

* login warn refactor, error message when exception, ut case to new user

* login warn refactor, error message when exception, ut case to new user
 2022-07-08 20:03:23 +08:00
mulin.lyh
e7cb20614f [to #43019862]feat: remove gitlab address 
去掉gitlab地址配置
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9256404

    * remove gitlab address
 2022-07-04 20:12:31 +08:00
yingda.chen
9c72c06e0b [to #42322933] merge hub api for model and dataset 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9233644
 2022-07-01 11:29:33 +08:00
mulin.lyh
c2ae3de640 [to #42879757 #42887254]fix: Repository initialize lfs after clone, add download times counter 
Repository在clone后执行 git lfs install初始化lfs支持，下载技术添加到header里
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9204291

    * [to #42879757 #42887254]fix: Repository initialize lfs after clone, add download times counter
 2022-06-30 14:27:53 +08:00
mulin.lyh
0d17eb5b39 [to #42849800 #42822853 #42822836 #42822791 #42822717 #42820011]fix: bug test bugs 
修复测试bug
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9186775

    * [to #42849800 #42822853 #42822836 #42822791 #42822717 #42820011]fix: test bugs
 2022-06-28 21:12:15 +08:00
yingda.chen
0acbfe1663 [to #42322933] interface refine with doc 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9159678
 2022-06-24 23:54:10 +08:00
mulin.lyh
6991620f59 [to #42698276]fix: git repo operations supports, gitlab token certification support. 2022-06-24 16:43:32 +08:00
mulin.lyh
76c6ff6329 [to #42675838]merge model hub code 
合并model hub 代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9096493
 2022-06-21 20:04:25 +08:00