Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 20:49:37 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,701 Commits 263 Branches 106 Tags
c08b92496821c7fbc0b22dbd063d595b9ed024e2
Commit Graph

1701 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yuze.zyz
c08b924968 Fix ner tokenizer which won't accept kwargs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12664244
* fix slow tokenizer
 2023-05-25 18:55:47 +08:00
feiyu.gfy
f82361d71b 修正lineless_table_recognition功能遇到空白图片崩溃的bug 
用户反馈lineless_table_recognition功能遇到空白图片会发生崩溃。
增加处理机制以防止崩溃。

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12741201
* fix bug
 2023-05-25 18:28:05 +08:00
lee.lcy
a524e01e47 feat: support onnx export for domain_specific_object_detection 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12682688
 2023-05-25 10:44:09 +08:00
xingjun.wxj
f2640a5a12 fix private dataset auth issue 
1. Fix private datasets auth issue
2. Add arg: token (optional) in MsDataset.load() for FlexTrain
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12721569
 2023-05-24 19:48:20 +08:00
yuze.zyz
d38fa563a8 Re commit lossing files for flextrain 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12674746
 2023-05-19 10:48:33 +08:00
mulin.lyh
6abdce929d fix py38 issue 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12660340
 2023-05-17 22:11:23 +08:00
chenyafeng.cyf
f6ea3eadea eres2net 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12640199
 2023-05-16 22:28:20 +08:00
yuze.zyz
c6ef9024d7 Fix distributed hook to lazyimport; fix an import bug 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12638653
 2023-05-16 21:37:12 +08:00
yuze.zyz
38fa4cceed fix transformer example and fix some bugs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12626375
 2023-05-16 15:27:17 +08:00
zsl01670416
71a80173e5 modify examples text_classification, text_generation, token_classification for improved trainer 
1.text_classification/run_train.sh
2.text_generation/run_train_mt5.sh, run_train_palm.sh
3.token_classification/finetune_token_classification.py, run_train_mgeo.sh, run_train_structbert.sh
above files were modified to adapt to improved trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12629010
 2023-05-16 14:32:43 +08:00
hemu.zp
5804ad2dc1 update multi_modal_embedding example 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12626062
 2023-05-16 14:31:26 +08:00
zhifu.gzf
6c8c3a53f8 fix bug in **kwargs duplicated 
修复**kwargs中参数重复的bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12633542
 2023-05-16 13:49:01 +08:00
wenmeng.zwm
3ac31290f2 add description for modelscope 2023-05-15 19:26:21 +08:00
yuze.zyz
e325862be8 add pop for base class parameters 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12622643
 2023-05-15 17:46:32 +08:00
yeqinghao.yqh
b9c8c99776 Support mPLUG-Owl model. 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12610417
 2023-05-15 16:32:46 +08:00
hemu.zp
1d28c5b730 mv mmdet to cv 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12614719
 2023-05-15 11:48:29 +08:00
wenmeng.zwm
a631c17353 Merge branch dev/merge_github_master_0512 into master 
Title: Merge github master 

Merge github master 0512

1. https://github.com/modelscope/modelscope/pull/297
2. https://github.com/modelscope/modelscope/pull/289
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12609811
 2023-05-15 09:39:28 +08:00
lingcai.wl
0aaaaa13ad [to #49275037] remove demo check and fix service decoder 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12432683
 2023-05-14 23:41:40 +08:00
xingjun.wang
98e899b8c2 merge master 2023-05-14 02:09:02 +08:00
xingjun.wang
bf2cd23aa2 cancel a ut 2023-05-14 02:06:11 +08:00
yuze.zyz
febc0365de Support FlexTrain and update the structure of trainer 
1. Refactor training_args
2. Refactor hooks
3. Add train_id for push_to_hub
4. Support both output_dir/output_sub_dir for checkpoint_hooks
5. Support copy when hardlink fails when checkpointing
6. Support mixed dataset config file as a CLI argument
7. Add eval txt in output folder
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12384253
* support the ignorance of file pattern
 2023-05-13 12:12:04 +08:00
xingjun.wang
4d5b111b08 update readme 2023-05-12 19:54:16 +08:00
xingjun.wang
41a40edef3 ok Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 19:05:22 +08:00
xingjun.wang
7fdfb1cd5d change version 2023-05-12 19:05:12 +08:00
xingjun.wang
9be87e6754 ok Merge branch 'dev/merge_github_master_0512' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 18:06:26 +08:00
tongmu.wh
ca0cf2b5cf merge master ,加入speaker change locating pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12601179
 2023-05-12 17:53:56 +08:00
hejunjie.hjj
1cd67ef060 [to #42322933] add cvpr23 fastinst model 2023-05-12 17:51:00 +08:00
xingjun.wang
112466e069 update class ExtractiveSummarizationPipeline(Pipeline): 2023-05-12 17:37:58 +08:00
xingjun.wang
92270f5f23 ok Merge branch 'dev/merge_github_master_0512' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 17:32:46 +08:00
xingjun.wxj
e630621599 Virgo SDK supports odps data source 
1. Support ODPS datasource for virgo sdk.
2. Adapt "inner_url" parser for single-modal and multi-modal datasets.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12583695

* add virgo sdk odps data

* refine virgo sdk args and odps fetch batch data pipeline

* add inner import for odps

* del import VirgoDataset in MsDataset

* fix import VirgoDataset

* support inner url downloading

* refine dataset.py and maxcompute_utils.py

* add ut for virgo odps data batch

* reset unifold ut level as 1

* refine virgo batch data
 2023-05-12 17:27:19 +08:00
xingjun.wxj
cafc90da21 Fix master UT on level0 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12599393

* reset ut level for test_run_with_model_name_for_unite_large and test_run_with_model_name_for_unite_base

* fix master UT for level0

* update EasyCVFace2DKeypointsPipelineTest skip info
 2023-05-12 17:25:32 +08:00
xingjun.wang
0cf0ac2112 merge master 2023-05-12 17:13:10 +08:00
wangmeng.xwm
f0d519219f add clip_interrogator 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12388571

* init commit of clip_interrogator

* fix format

* fix environment dependencies

* fix backend.mps

* fix test image path

* add model introduction and paper link

* add comment example for pipeline, fix device control
 2023-05-12 16:06:52 +08:00
Xingjun.Wang
72b617dab9 Merge pull request #289 from Restry/patch-1 
修复 fid_dialogue_pipeline.py 在cpu下推理时的异常
 2023-05-12 15:38:53 +08:00
Xingjun.Wang
75410651ba Merge pull request #297 from slin000111/master 
add torch2 compile to nlp pipelines
 2023-05-12 11:03:15 +08:00
zhifu.gzf
f2e197ba91 rm easrasr 2023-05-12 10:39:22 +08:00
zhifu.gzf
c16a3b847f audio funasr pipeline kwargs 2023-05-12 09:02:05 +08:00
wucong.lyb
4c0b13d157 fix func update_local_model; change funasr version 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12595406
 2023-05-11 20:13:20 +08:00
hemu.zp
49339941df Add convert megatron ckpt script 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12555222

* add convert megatron ckpt script
 2023-05-11 15:50:30 +08:00
Wang Qiang
63777b995d Fix bug: install taming error prompt (#296) 2023-05-11 15:23:22 +08:00
slin000111
5a0e022133 Merge branch 'modelscope_dev' 
translation evaluation pipeline
 2023-05-11 15:16:46 +08:00
slin000111
d76303d324 translation evaluation pipeline 2023-05-11 15:11:22 +08:00
wanyu.wy
58df448182 Add trainer for UniTE 2023-05-11 14:41:08 +08:00
hemu.zp
ca85447363 remove pai-easycv requirement 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12564234
 2023-05-11 14:31:18 +08:00
mulin.lyh
7b14a0e11f Pipeline input, output and parameter normalization. 2023-05-11 11:20:01 +08:00
slin000111
76af9b70f5 Merge branch 'modelscope_dev' 
add argument compile to nlp pipelines
 2023-05-11 10:33:39 +08:00
slin000111
1c5222d6c1 add argument compile to nlp pipelines 2023-05-11 10:27:45 +08:00
mulin.lyh
ba646ef1d2 display hub error message 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12581373
 2023-05-10 20:58:44 +08:00
hehong.chh
b80c13036f fix bug: hypotheses did't init in cpu device、make fid_dialogue_test available 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12406082
 2023-05-10 11:10:31 +08:00
Li Tong
626b60e8c2 fix issue: Batch and single are not uniform #215 (#258) 
* fix issue: Batch and single are not uniform #215, https://github.com/modelscope/modelscope/issues/215

* remove extra code

* fix bug

* update test

---------

Co-authored-by: ezeli.lt <ezeli.lt@alibaba-inc.com>
Co-authored-by: hemu <hemu.zp@alibaba-inc.com>
 2023-05-10 10:49:54 +08:00