Commit Graph

2825 Commits

Author SHA1 Message Date
jiangyu.xzy
cc76d900bc add model name to baseModel. use model name as tag 2022-11-01 15:31:08 +08:00
干劲
2759d538bb fix ut level for unifold 2022-11-01 14:59:45 +08:00
翎航
b889e64067 add task preprocess 2022-11-01 14:44:37 +08:00
翎航
9c04fec99c add task preprocess 2022-11-01 14:28:57 +08:00
干劲
943478de63 Update 2022-11-01 13:32:57 +08:00
干劲
f5c31b3319 Add miss init 2022-11-01 13:31:25 +08:00
班扬
4080f8071e temp 2022-11-01 12:57:04 +08:00
jiangyu.xzy
60af6b701b fix task to model; handle exception 2022-11-01 11:59:59 +08:00
jiangyu.xzy
a79a900e94 change api to utils 2022-11-01 11:35:28 +08:00
jiangyu.xzy
f451ff8905 api tagging for pipeline/train/evaluate 2022-11-01 11:22:46 +08:00
liugao.lg
40b6770956 [to #42322933]fix ocr prepreocess & conflict
修复ocr预处理逻辑不一致问题
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10581697
2022-11-01 10:22:11 +08:00
yichang.zyc
9187103e3a [to #42322933]兼容新增clip huge模型
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10585552

    * compatiable with vit huge, and set clip base default mm-ebed pipeline
2022-11-01 09:57:31 +08:00
zhangzhicheng.zzc
06abae4dc6 [to #42322933]add token-cls test cases and bug fix
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10585502
2022-11-01 09:56:15 +08:00
mulin.lyh
5302259a0a [to #45854437]fix: add user name to user-agent
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10584797
2022-10-31 22:46:17 +08:00
Yingda Chen
3464324f6b [to #42322933] limit datasets version for now 2022-10-31 22:15:37 +08:00
zhangzhicheng.zzc
0d3b7b0df2 [to #42322933]fix bugs relate to token cls
1.修复token classification preprocessor finetune结果错误问题
2.修复word segmentation output 无用属性
3. 修复nlp preprocessor传use_fast错误
4. 修复torch model exporter bug
5. 修复文档撰写过程中发现trainer相关bug
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10573269
2022-10-31 20:52:27 +08:00
shouzhou.bx
e72988c2ba add face detection to face_2d_keypoints_pipeline 2022-10-31 20:46:49 +08:00
xiaodongdeng.dxd
64868bf2ad [to #42322933]多模态预训练模型OFA增加支持6b模型的feature
多模态预训练模型OFA增加支持6b模型的feature
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10574571
2022-10-31 20:42:56 +08:00
翎航
fd3679b547 add classification prepreocess 2022-10-31 20:00:42 +08:00
yuanzheng.yuanzhen
ce08cfbea8 [to #42322933]Add licenses
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10580553

    * Add licenses
2022-10-31 18:47:06 +08:00
翎航
11cebb8d64 fix ocr prepreocess & conflict 2022-10-31 17:03:18 +08:00
翎航
3b21ff10ec fix ocr prepreocess 2022-10-31 16:57:49 +08:00
yichang.zyc
e2d35fbb14 [to #42322933]clip支持finetune
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10572842
2022-10-30 21:51:11 +08:00
Yingda Chen
9f7b8b86a3 [to #42322933] disble 2dkeypoints training since face_2d_keypoints_dataset is set to be private 2022-10-30 13:59:12 +08:00
Yingda Chen
902019c2e0 [to #42322933] disble vgg19_fer 2022-10-30 13:55:49 +08:00
Yingda Chen
29448c0f57 [to #42322933] disble vit 2022-10-30 11:15:52 +08:00
wenmeng.zwm
e07f3cdbf5 remove fasttext 2022-10-29 15:05:26 +08:00
wenmeng.zwm
ae55fed216 bumpy version to 1.0.0 2022-10-29 14:37:56 +08:00
mulin.lyh
3791ee7ad2 [to #45821936]fix: fix block user specify revision after release_datetime
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10572162
2022-10-29 13:44:47 +08:00
yuze.zyz
4b7e8e89aa [to #42322933] Fix some bugs when downgrade the version of some dependencies
1. Fix bug in model exporting
2. Skip some long trainings in test level 2
3. Refine some comments
4. Fix a bug that mode is not correct when saving checkpoints
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10564716
2022-10-28 21:44:33 +08:00
Yufeng
261c04b8b5 add Mglm (#5)
* mglm init

* add mglm requirements

Co-authored-by: Yufeng <zhuyufeng@gmail.com>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
2022-10-28 17:12:47 +08:00
Yufeng
c390dc0c79 add Mglm (#5)
* mglm init

* add mglm requirements

Co-authored-by: Yufeng <zhuyufeng@gmail.com>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
2022-10-28 17:09:27 +08:00
lingcai.wl
84ed59d857 [to #44834022] add service utils for model deploy
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10529621
2022-10-28 16:10:50 +08:00
pangda
303ae2ff36 [to #42322933] fix bug for text logger
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10560149
2022-10-28 15:26:17 +08:00
Yingda Chen
632833695b Merge pull request #7 from modelscope/merge_mater_internal_1028
Merge master internal to github 1028
2022-10-28 12:12:06 +08:00
wenmeng.zwm
0223f6e6d7 Merge branch 'master-gitlab' into merge_mater_internal_1028 2022-10-28 10:02:45 +08:00
Yingda Chen
46cfa177aa [to #42322933]skip timeconsuming test 2022-10-28 09:34:29 +08:00
hemu.zp
53e9f02561 [to #42322933] Fix bug for bleu in text generation metrics.
修复了使用错误算法导致 BLEU-4 值计算结果偏小的问题
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10558494
2022-10-28 09:28:15 +08:00
xianzhe.xxz
88e8d4291a [to #42322933]"fix: set the eps and momentum of BN consistent with training"
To keep consistent between training and evaluation, change the eps and momentum of BN.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10554451
2022-10-28 09:27:55 +08:00
menrui.mr
c7b0787049 修复初始化过程参数未生效问题
此前文生图模型没有加载configuration.json中的参数 影响默认配置
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10558026
2022-10-27 23:29:08 +08:00
hemu.zp
fa415d8720 [to #42322933] Fix bug for bloom and gpt_neo
1. 修复 bloom 和 gpt_neo 模型更新 transformers 4.23 后后处理报错的问题
2. 统一使用 ModelOutput 作为模型输出
3. gpt_neo checkpoint 已上线,修改 ut 为 level2
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10553103
2022-10-27 23:27:28 +08:00
zhangzhicheng.zzc
b713e3de1c [to #42322933]fix token classification bugs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10550136
2022-10-27 22:53:16 +08:00
zhangzhicheng.zzc
9df3f5c41f override pipeline by tasks name after finetune done, avoid case like fill mask pipeline with a text cls task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10554512
2022-10-27 22:52:29 +08:00
xingjun.wxj
78f29cf999 [to #42322933] Add delete datasets files and upload mode.
1. Add : MsDataset.delete() , support delete dataset file or dir.

2. Add: upload mode,  MsDataset.upload(xx, upload_mode=UploadMode.FORCE_UPLOAD), or  MsDataset.upload(xx, upload_mode=UploadMode.APPEND_UPLOAD)
     if upload_mode = UploadMode.APPEND_UPLOAD, then skip object in case of this object exists.

3. Add: support reload sts token automatically to avoid expire. (current expiration: 24h)

4. Fix: add cookies in api.py for downloading private datasets.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10524449
2022-10-27 20:30:35 +08:00
Yingda Chen
374fd3090e [to #42322933]skip referring video tests since model is private 2022-10-27 20:23:51 +08:00
yuze.zyz
212cf53318 [to #42322933] Fix some bugs
1. Add F1 score to sequence classification metric
2. Fix a bug that the evaluate method in trainer does not support a pure pytorch_model.bin
3. Fix a bug in evaluation of veco trainer 
4. Add some tips if lr_scheduler in the trainer needs a higher version torch
5. Add some comments
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10532230
2022-10-27 19:49:21 +08:00
shuying.shu
ddcb57440d [to #42322933]add fine-tune code for referring video object segmentation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10539423
2022-10-27 19:43:54 +08:00
mulin.lyh
3b75623be4 [to #45773874]fix: get_model revision=None bug, and hub case occasionally delete test model failed
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10549680
2022-10-27 17:06:18 +08:00
yichang.zyc
bdadea9791 [to #42322933]fix image_open func, support url
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10548014

    * fix image_open func
2022-10-27 16:02:44 +08:00
Yingda Chen
dc3c0059ad Merge pull request #6 from modelscope/merge_master_internal_1026
merge master internal to github master
2022-10-27 12:33:18 +08:00