Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-02-25 04:30:48 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,977 Commits 267 Branches 107 Tags
dev/dataset_slice
Commit Graph

1977 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
wucong.lyb
a77d390238 fix extra_args 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12839071
* fix extra_args

* update extra_args
 2023-06-08 19:39:05 +08:00
hejunjie.hjj
ae672b73df bug fix for single human parsing 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12869114
* fix bug: single human parsing, 当src_h, src_w相等时，new_h, new_w = 0, 0, 出现bug
 2023-06-08 19:36:18 +08:00
zsl01670416
75c90d8a98 add model revision in training_args and modify dataset loading in finetune text classification 
1.add parameter model_revision in training_args.py.
2.add parameter model_revision in kwargs for finetune_text_classification.py and finetune_text_generation.py.
3.modify dataset loading in finetune_text_classification.py for flex training.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12869552
* add model revision in training_args and modify dataset loading in finetune text classification
 2023-06-08 19:36:05 +08:00
mulin.lyh
25a7398aea docker file py38 and py37 compatible merge 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12722824
* debug

* add missing deps

* add stanza

* fix numpy issue

* numpy version

* tf case

* numpy <= 1.22.0

* fix tf 1.15.5 case

* add python38 and python37 compatible docker file

* cv add fvcore

* add easycv

* remove debug code

* fix style issue

* fix python3.7 python3.8 compatible issue

* comment

* modify run config

* scipy<=1.7.3

* revert scipy<=1.7.3

* fix compatible bug

* fix compatible bug

* add easycv

* update version: 1.6.1rc0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12754942
fix python3.8 and python3.8 compatible issue

* numpy version change

* numpy version

* numpy version

* fix numpy version

* fix numpy version

* update version: 1.6.1rc0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12754942
fix python3.8 and python3.8 compatible issue

* restore setup.py

* restore setup.py

* add build base image

* fix style

* numpy version fix

* optimize build image, split base and modelscope image

* fix style issue

* modify example path

* modify examples folder

* add SETUPTOOLS_USE_DISTUTILS=stdlib comments
 2023-06-08 10:01:58 +08:00
pangda
73f8d39897 Add ner example for flextrain 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12835095
* update named_entity_recognition example
 2023-06-05 15:17:45 +08:00
liuyhwangyh
66fc614e15 Merge pull request #315 from liuyhwangyh/add_regression_workflow 
add daily regression workflow
 2023-06-03 06:14:52 +08:00
liuyhwangyh
2498bb60b6 fix cron format issue 2023-06-02 16:01:36 +08:00
liuyhwangyh
d61529dfa5 modify workflow name 2023-06-01 14:25:02 +08:00
mulin.lyh
8dc5246fdb add daily regression workflow 2023-06-01 09:36:06 +08:00
xixing.tj
1b7e0f50f4 add ocr detection new model db-nas 
新增5M的DB-NAS ocr detection 文字检测模型
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12760623
* add ocr detection new model db-nas

* add comment
 2023-05-31 21:32:46 +08:00
hemu.zp
898e3a42eb Fix bug for DeepspeedHook.register_processor 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12686921
 2023-05-31 21:29:36 +08:00
yuanzhi.zyz
10c39b5ce1 add new ocr recognition model (LightweightEdge) and some functions 
1. 增加了新轻量化端侧识别模型 LightweightEdge，并把原来CRNN和ConvNextViT的代码整理了
2. 增加batch inference支持
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12787905
 2023-05-31 21:16:22 +08:00
Xingjun.Wang
5634a18a58 Merge pull request #311 from modelscope/fix_master_version 
undo datetime to 2099
 2023-05-30 14:27:16 +08:00
xingjun.wang
6611445bab undo datetime to 2099 2023-05-30 14:04:12 +08:00
zhangzhicheng.zzc
c7aede97ba add pattern to skip easycv.thirdparty 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12785287

* add pattern to remove

* update pattern to remove

* avoid import with build
 2023-05-30 11:16:39 +08:00
yuze.zyz
003c33648a Fix CI: test merge dataset failed 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12771691
* fix CI

* add teardown
 2023-05-29 10:32:33 +08:00
xingjun.wxj
5b99bb24fe update version: 1.6.1rc0 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12754942
 2023-05-25 20:28:36 +08:00
yuze.zyz
e2a20fd817 fix merge_hook 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12718423
* fix merge_hook
 2023-05-25 20:05:04 +08:00
yuze.zyz
a7a3eb5dc5 Support flex train feature 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12737668
 2023-05-25 19:39:24 +08:00
yuze.zyz
c08b924968 Fix ner tokenizer which won't accept kwargs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12664244
* fix slow tokenizer
 2023-05-25 18:55:47 +08:00
feiyu.gfy
f82361d71b 修正lineless_table_recognition功能遇到空白图片崩溃的bug 
用户反馈lineless_table_recognition功能遇到空白图片会发生崩溃。
增加处理机制以防止崩溃。

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12741201
* fix bug
 2023-05-25 18:28:05 +08:00
lee.lcy
a524e01e47 feat: support onnx export for domain_specific_object_detection 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12682688
 2023-05-25 10:44:09 +08:00
xingjun.wxj
f2640a5a12 fix private dataset auth issue 
1. Fix private datasets auth issue
2. Add arg: token (optional) in MsDataset.load() for FlexTrain
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12721569
 2023-05-24 19:48:20 +08:00
Xingjun.Wang
92e12b5f19 Merge pull request #307 from modelscope/dev_rs_16 
Merge release 1.6
 2023-05-24 11:12:18 +08:00
xingjun.wang
d3fa166fe0 modify ignore 2023-05-23 21:21:15 +08:00
xingjun.wang
48c0d2a9af add 1.6 v1.6.0 2023-05-22 10:53:18 +08:00
yuze.zyz
d38fa563a8 Re commit lossing files for flextrain 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12674746
 2023-05-19 10:48:33 +08:00
mulin.lyh
6abdce929d fix py38 issue 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12660340
 2023-05-17 22:11:23 +08:00
chenyafeng.cyf
f6ea3eadea eres2net 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12640199
 2023-05-16 22:28:20 +08:00
yuze.zyz
c6ef9024d7 Fix distributed hook to lazyimport; fix an import bug 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12638653
 2023-05-16 21:37:12 +08:00
yuze.zyz
38fa4cceed fix transformer example and fix some bugs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12626375
 2023-05-16 15:27:17 +08:00
zsl01670416
71a80173e5 modify examples text_classification, text_generation, token_classification for improved trainer 
1.text_classification/run_train.sh
2.text_generation/run_train_mt5.sh, run_train_palm.sh
3.token_classification/finetune_token_classification.py, run_train_mgeo.sh, run_train_structbert.sh
above files were modified to adapt to improved trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12629010
 2023-05-16 14:32:43 +08:00
hemu.zp
5804ad2dc1 update multi_modal_embedding example 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12626062
 2023-05-16 14:31:26 +08:00
zhifu.gzf
6c8c3a53f8 fix bug in **kwargs duplicated 
修复**kwargs中参数重复的bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12633542
 2023-05-16 13:49:01 +08:00
wenmeng.zwm
3ac31290f2 add description for modelscope 2023-05-15 19:26:21 +08:00
yuze.zyz
e325862be8 add pop for base class parameters 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12622643
 2023-05-15 17:46:32 +08:00
yeqinghao.yqh
b9c8c99776 Support mPLUG-Owl model. 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12610417
 2023-05-15 16:32:46 +08:00
hemu.zp
1d28c5b730 mv mmdet to cv 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12614719
 2023-05-15 11:48:29 +08:00
wenmeng.zwm
a631c17353 Merge branch dev/merge_github_master_0512 into master 
Title: Merge github master 

Merge github master 0512

1. https://github.com/modelscope/modelscope/pull/297
2. https://github.com/modelscope/modelscope/pull/289
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12609811
 2023-05-15 09:39:28 +08:00
lingcai.wl
0aaaaa13ad [to #49275037] remove demo check and fix service decoder 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12432683
 2023-05-14 23:41:40 +08:00
xingjun.wang
98e899b8c2 merge master 2023-05-14 02:09:02 +08:00
xingjun.wang
bf2cd23aa2 cancel a ut 2023-05-14 02:06:11 +08:00
yuze.zyz
febc0365de Support FlexTrain and update the structure of trainer 
1. Refactor training_args
2. Refactor hooks
3. Add train_id for push_to_hub
4. Support both output_dir/output_sub_dir for checkpoint_hooks
5. Support copy when hardlink fails when checkpointing
6. Support mixed dataset config file as a CLI argument
7. Add eval txt in output folder
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12384253
* support the ignorance of file pattern
 2023-05-13 12:12:04 +08:00
xingjun.wang
4d5b111b08 update readme 2023-05-12 19:54:16 +08:00
Xingjun.Wang
52aea36c12 Merge pull request #302 from modelscope/langgz-patch-1 
add vad model and punc model in README.md
 2023-05-12 19:52:44 +08:00
xingjun.wang
41a40edef3 ok Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 19:05:22 +08:00
xingjun.wang
7fdfb1cd5d change version 2023-05-12 19:05:12 +08:00
zhifu gao
34e6f76c80 add vad model and punc model in README.md 
add vad model and punc model
 2023-05-12 18:46:24 +08:00
Wang Qiang
9ba53ad3ba Correcting the lora stable diffusion example script (#300) 2023-05-12 18:15:53 +08:00
veelion
d88ec54500 fix: device arg not work, rename device to ngpu (#272) 2023-05-12 18:15:18 +08:00