Commit Graph

1961 Commits

Author SHA1 Message Date
xingjun.wxj
5b99bb24fe update version: 1.6.1rc0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12754942
2023-05-25 20:28:36 +08:00
yuze.zyz
e2a20fd817 fix merge_hook
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12718423
* fix merge_hook
2023-05-25 20:05:04 +08:00
yuze.zyz
a7a3eb5dc5 Support flex train feature
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12737668
2023-05-25 19:39:24 +08:00
yuze.zyz
c08b924968 Fix ner tokenizer which won't accept kwargs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12664244
* fix slow tokenizer
2023-05-25 18:55:47 +08:00
feiyu.gfy
f82361d71b 修正lineless_table_recognition功能遇到空白图片崩溃的bug
用户反馈lineless_table_recognition功能遇到空白图片会发生崩溃。
增加处理机制以防止崩溃。

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12741201
* fix bug
2023-05-25 18:28:05 +08:00
lee.lcy
a524e01e47 feat: support onnx export for domain_specific_object_detection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12682688
2023-05-25 10:44:09 +08:00
xingjun.wxj
f2640a5a12 fix private dataset auth issue
1. Fix private datasets auth issue
2. Add arg: token (optional) in MsDataset.load() for FlexTrain
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12721569
2023-05-24 19:48:20 +08:00
Xingjun.Wang
92e12b5f19 Merge pull request #307 from modelscope/dev_rs_16
Merge release 1.6
2023-05-24 11:12:18 +08:00
xingjun.wang
d3fa166fe0 modify ignore 2023-05-23 21:21:15 +08:00
xingjun.wang
48c0d2a9af add 1.6 v1.6.0 2023-05-22 10:53:18 +08:00
yuze.zyz
d38fa563a8 Re commit lossing files for flextrain
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12674746
2023-05-19 10:48:33 +08:00
mulin.lyh
6abdce929d fix py38 issue
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12660340
2023-05-17 22:11:23 +08:00
chenyafeng.cyf
f6ea3eadea eres2net
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12640199
2023-05-16 22:28:20 +08:00
yuze.zyz
c6ef9024d7 Fix distributed hook to lazyimport; fix an import bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12638653
2023-05-16 21:37:12 +08:00
yuze.zyz
38fa4cceed fix transformer example and fix some bugs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12626375
2023-05-16 15:27:17 +08:00
zsl01670416
71a80173e5 modify examples text_classification, text_generation, token_classification for improved trainer
1.text_classification/run_train.sh
2.text_generation/run_train_mt5.sh, run_train_palm.sh
3.token_classification/finetune_token_classification.py, run_train_mgeo.sh, run_train_structbert.sh
above files were modified to adapt to improved trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12629010
2023-05-16 14:32:43 +08:00
hemu.zp
5804ad2dc1 update multi_modal_embedding example
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12626062
2023-05-16 14:31:26 +08:00
zhifu.gzf
6c8c3a53f8 fix bug in **kwargs duplicated
修复**kwargs中参数重复的bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12633542
2023-05-16 13:49:01 +08:00
wenmeng.zwm
3ac31290f2 add description for modelscope 2023-05-15 19:26:21 +08:00
yuze.zyz
e325862be8 add pop for base class parameters
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12622643
2023-05-15 17:46:32 +08:00
yeqinghao.yqh
b9c8c99776 Support mPLUG-Owl model.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12610417
2023-05-15 16:32:46 +08:00
hemu.zp
1d28c5b730 mv mmdet to cv
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12614719
2023-05-15 11:48:29 +08:00
wenmeng.zwm
a631c17353 Merge branch dev/merge_github_master_0512 into master
Title: Merge github master 

Merge github master 0512

1. https://github.com/modelscope/modelscope/pull/297
2. https://github.com/modelscope/modelscope/pull/289
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12609811
2023-05-15 09:39:28 +08:00
lingcai.wl
0aaaaa13ad [to #49275037] remove demo check and fix service decoder
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12432683
2023-05-14 23:41:40 +08:00
xingjun.wang
98e899b8c2 merge master 2023-05-14 02:09:02 +08:00
xingjun.wang
bf2cd23aa2 cancel a ut 2023-05-14 02:06:11 +08:00
yuze.zyz
febc0365de Support FlexTrain and update the structure of trainer
1. Refactor training_args
2. Refactor hooks
3. Add train_id for push_to_hub
4. Support both output_dir/output_sub_dir for checkpoint_hooks
5. Support copy when hardlink fails when checkpointing
6. Support mixed dataset config file as a CLI argument
7. Add eval txt in output folder
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12384253
* support the ignorance of file pattern
2023-05-13 12:12:04 +08:00
xingjun.wang
4d5b111b08 update readme 2023-05-12 19:54:16 +08:00
Xingjun.Wang
52aea36c12 Merge pull request #302 from modelscope/langgz-patch-1
add vad model and punc model in README.md
2023-05-12 19:52:44 +08:00
xingjun.wang
41a40edef3 ok Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 19:05:22 +08:00
xingjun.wang
7fdfb1cd5d change version 2023-05-12 19:05:12 +08:00
zhifu gao
34e6f76c80 add vad model and punc model in README.md
add vad model and punc model
2023-05-12 18:46:24 +08:00
Wang Qiang
9ba53ad3ba Correcting the lora stable diffusion example script (#300) 2023-05-12 18:15:53 +08:00
veelion
d88ec54500 fix: device arg not work, rename device to ngpu (#272) 2023-05-12 18:15:18 +08:00
xingjun.wang
9be87e6754 ok Merge branch 'dev/merge_github_master_0512' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 18:06:26 +08:00
tongmu.wh
ca0cf2b5cf merge master ,加入speaker change locating pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12601179
2023-05-12 17:53:56 +08:00
hejunjie.hjj
1cd67ef060 [to #42322933] add cvpr23 fastinst model 2023-05-12 17:51:00 +08:00
xingjun.wang
112466e069 update class ExtractiveSummarizationPipeline(Pipeline): 2023-05-12 17:37:58 +08:00
xingjun.wang
92270f5f23 ok Merge branch 'dev/merge_github_master_0512' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 17:32:46 +08:00
xingjun.wxj
e630621599 Virgo SDK supports odps data source
1. Support ODPS datasource for virgo sdk.
2. Adapt "inner_url" parser for single-modal and multi-modal datasets.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12583695

* add virgo sdk odps data

* refine virgo sdk args and odps fetch batch data pipeline

* add inner import for odps

* del import VirgoDataset in MsDataset

* fix import VirgoDataset

* support inner url downloading

* refine dataset.py and maxcompute_utils.py

* add ut for virgo odps data batch

* reset unifold ut level as 1

* refine virgo batch data
2023-05-12 17:27:19 +08:00
xingjun.wxj
cafc90da21 Fix master UT on level0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12599393

* reset ut level for test_run_with_model_name_for_unite_large and test_run_with_model_name_for_unite_base

* fix master UT for level0

* update EasyCVFace2DKeypointsPipelineTest skip info
2023-05-12 17:25:32 +08:00
xingjun.wang
0cf0ac2112 merge master 2023-05-12 17:13:10 +08:00
wangmeng.xwm
f0d519219f add clip_interrogator
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12388571

* init commit of clip_interrogator

* fix format

* fix environment dependencies

* fix backend.mps

* fix test image path

* add model introduction and paper link

* add comment example for pipeline, fix device control
2023-05-12 16:06:52 +08:00
Xingjun.Wang
72b617dab9 Merge pull request #289 from Restry/patch-1
修复 fid_dialogue_pipeline.py 在cpu下推理时的异常
2023-05-12 15:38:53 +08:00
Xingjun.Wang
75410651ba Merge pull request #297 from slin000111/master
add torch2 compile to nlp pipelines
2023-05-12 11:03:15 +08:00
zhifu.gzf
f2e197ba91 rm easrasr 2023-05-12 10:39:22 +08:00
zhifu.gzf
c16a3b847f audio funasr pipeline kwargs 2023-05-12 09:02:05 +08:00
wucong.lyb
4c0b13d157 fix func update_local_model; change funasr version
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12595406
2023-05-11 20:13:20 +08:00
hemu.zp
49339941df Add convert megatron ckpt script
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12555222

* add convert megatron ckpt script
2023-05-11 15:50:30 +08:00
Wang Qiang
63777b995d Fix bug: install taming error prompt (#296) 2023-05-11 15:23:22 +08:00