Commit Graph

673 Commits

Author SHA1 Message Date
mushenL
f77237b049 add llama2 pipeline (#399)
* Modify the parameter passing of the text_generation_pipeline class

* add llama2 pipeline

* add llama pipeline v1.1

* add llama pipeline v1.2

* add llama pipeline v1.3

* add llama pipeline v1.0.4
2023-07-22 21:53:04 +08:00
wenmeng.zwm
0271b9c256 Merge branch 'master-github' into merge_master_github_0628 2023-06-28 20:27:34 +08:00
Wang Qiang
a018cd6107 Dreambooth method for finetuning stable diffusions (#339)
* Copyright

* dreambooth

* dreambooth test trainer

* fix bugs

* pre-commit

---------

Co-authored-by: 翊靖 <yijing.wq@alibaba-inc.com>
2023-06-28 20:10:28 +08:00
mulin.lyh
1ea9b58447 fix torch2.0 compatible issue
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13086361

* fix face-aligment compatible

* fix torch2.0 compatible issue
2023-06-28 14:15:48 +08:00
wenmeng.zwm
9e51920fdb Merge branch 'master-github' into merge_master_github_0626 2023-06-26 21:04:05 +08:00
wenmeng zhou
6dea1d5646 Fix/citest timeout (#308)
* timeout for citest set to 240min

* update docker image

* fix ci template not packed in whl

* update docker image version to 1.6.1 and add python3.8 support

* randome choose a model for controlnet to avoid oom
2023-06-26 11:23:10 +08:00
chenyafeng.cyf
29062d9f94 eres2net_aug v2
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13046524

* eres2net_aug v2
2023-06-25 18:07:04 +08:00
tongmu.wh
f03c93cda5 add speaker diarization pipeline and improve some speaker pipelines
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12891685

* add new speaker diarization pipeline. improve the capability of speaker pipelines
2023-06-21 17:56:05 +08:00
xingjun.wxj
0db0ec5586 Merge code from github
1. Merge(add) daily regression from github PR (daily_regression.yaml)
2. Add lora stable diffusion from github PR
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13010802
* fix: device arg not work, rename device to ngpu (#272)

* Correcting the lora stable diffusion example script (#300)

* add vad model and punc model in README.md 

add vad model and punc model

* Merge pull request #302 from modelscope/langgz-patch-1

add vad model and punc model in README.md

* add 1.6

* modify ignore

* Merge pull request #307 from modelscope/dev_rs_16

Merge release 1.6

* undo datetime to 2099

* Merge pull request #311 from modelscope/fix_master_version

undo datetime to 2099

* add daily regression workflow

* modify workflow name

* fix cron format issue

* lora trainer

* Merge pull request #315 from liuyhwangyh/add_regression_workflow

add daily regression workflow
2023-06-21 10:22:06 +08:00
xingjun.wxj
cc3c384d5e Fix issues for downloading mplug-youku dataset
1. Optimize downloading meta-csv files for large-scale dataset like mPLUG-youku (> 1GB for meta csv mapping)
2. Add head and overall progress bar for NativeIterableDataset
3. Modify the try-catch info for oss_utils
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12952842
2023-06-15 15:42:21 +08:00
hemu.zp
96c2d42f09 Add StreamingMixin
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12445731
* StreamingMixin poc

* update design

* Merge branch 'master' into feat/StreamingMixin

* add dicstr

* make postprocessor input consistent
2023-06-08 19:40:14 +08:00
xixing.tj
1b7e0f50f4 add ocr detection new model db-nas
新增5M的DB-NAS ocr detection 文字检测模型
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12760623
* add ocr detection new model db-nas

* add comment
2023-05-31 21:32:46 +08:00
yuanzhi.zyz
10c39b5ce1 add new ocr recognition model (LightweightEdge) and some functions
1. 增加了新轻量化端侧识别模型 LightweightEdge,并把原来CRNN和ConvNextViT的代码整理了
2. 增加batch inference支持
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12787905
2023-05-31 21:16:22 +08:00
chenyafeng.cyf
f6ea3eadea eres2net
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12640199
2023-05-16 22:28:20 +08:00
yeqinghao.yqh
b9c8c99776 Support mPLUG-Owl model.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12610417
2023-05-15 16:32:46 +08:00
wenmeng.zwm
a631c17353 Merge branch dev/merge_github_master_0512 into master
Title: Merge github master 

Merge github master 0512

1. https://github.com/modelscope/modelscope/pull/297
2. https://github.com/modelscope/modelscope/pull/289
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12609811
2023-05-15 09:39:28 +08:00
lingcai.wl
0aaaaa13ad [to #49275037] remove demo check and fix service decoder
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12432683
2023-05-14 23:41:40 +08:00
xingjun.wang
bf2cd23aa2 cancel a ut 2023-05-14 02:06:11 +08:00
xingjun.wang
41a40edef3 ok Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 19:05:22 +08:00
xingjun.wang
9be87e6754 ok Merge branch 'dev/merge_github_master_0512' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 18:06:26 +08:00
tongmu.wh
ca0cf2b5cf merge master ,加入speaker change locating pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12601179
2023-05-12 17:53:56 +08:00
hejunjie.hjj
1cd67ef060 [to #42322933] add cvpr23 fastinst model 2023-05-12 17:51:00 +08:00
xingjun.wang
92270f5f23 ok Merge branch 'dev/merge_github_master_0512' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 17:32:46 +08:00
xingjun.wxj
cafc90da21 Fix master UT on level0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12599393

* reset ut level for test_run_with_model_name_for_unite_large and test_run_with_model_name_for_unite_base

* fix master UT for level0

* update EasyCVFace2DKeypointsPipelineTest skip info
2023-05-12 17:25:32 +08:00
xingjun.wang
0cf0ac2112 merge master 2023-05-12 17:13:10 +08:00
wangmeng.xwm
f0d519219f add clip_interrogator
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12388571

* init commit of clip_interrogator

* fix format

* fix environment dependencies

* fix backend.mps

* fix test image path

* add model introduction and paper link

* add comment example for pipeline, fix device control
2023-05-12 16:06:52 +08:00
wanyu.wy
58df448182 Add trainer for UniTE 2023-05-11 14:41:08 +08:00
mulin.lyh
7b14a0e11f Pipeline input, output and parameter normalization. 2023-05-11 11:20:01 +08:00
hehong.chh
b80c13036f fix bug: hypotheses did't init in cpu device、make fid_dialogue_test available
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12406082
2023-05-10 11:10:31 +08:00
Li Tong
626b60e8c2 fix issue: Batch and single are not uniform #215 (#258)
* fix issue: Batch and single are not uniform #215, https://github.com/modelscope/modelscope/issues/215

* remove extra code

* fix bug

* update test

---------

Co-authored-by: ezeli.lt <ezeli.lt@alibaba-inc.com>
Co-authored-by: hemu <hemu.zp@alibaba-inc.com>
2023-05-10 10:49:54 +08:00
ly261666
bdd282a127 [to #42322933] add transface model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12568301
2023-05-10 01:04:10 +08:00
jiangnana.jnn
46072898da remove easycv codes, plugin access
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11965727

* remove easycv codes

* fix custome msdatasets import and remove metainfo

* fix pipeline imports

* fix pre-check

* fix models import

* fix pre-check

* merge master
2023-05-09 17:58:01 +08:00
chenyafeng.cyf
93f73a26e7 add rdino model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12406691
2023-04-26 11:18:28 +08:00
yuanzhi.zyz
b19cc13ca7 update ocr_reco
1. 增加本地lmdb输入的接口;
2. finetune后模型的keys有prefix,导致不能直接读取,已在model初始化时统一替换;
3. 添加各个模型的cpu和gpu测试。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12256669
* add local_lmdb read
2023-04-21 15:05:16 +08:00
bin.xue
dd4299e0c8 [to #42322933] add DFSMN model to far field KWS
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12334627
* feat: set stream mode in constructor

* fix: commit model file

* doc: add more information about DFSMN

* fix: seperation model evaluate returns None in speechbrain whose version < 0.5.12
2023-04-20 22:45:07 +08:00
hemu.zp
4f300c8632 Fix generate for ModelForTextGeneration
Separate the `generate` function, no longer use the implementation in the transformers library to avoid error due to transformers version upgrades.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12340643
2023-04-16 02:05:41 +08:00
hehong.chh
10101e08aa skip FidDialogueTest temporarily, due to the model is set to non-public
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12315621
2023-04-13 13:27:25 +08:00
chaojie.mcj
283517de08 add efficient tunner modules 2023-04-11 22:26:13 +08:00
shouzhou.bx
467b782799 [to 4.15] add pedestrian attribute recognition model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12288506
2023-04-11 20:46:02 +08:00
ly261666
5f6cdf6814 [to #42322933] add damofd model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12261061
2023-04-11 11:08:59 +08:00
ly261666
509631ca3b fix face issue:
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12256380
2023-04-10 20:32:43 +08:00
hehong.chh
48fecacf61 fid_dialouge_pipeline新增3.7B模型,修复一些bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12270307
2023-04-10 20:30:44 +08:00
tongmu.wh
41da5d8e90 add speaker model cam++ for speaker verification task damo/speech_campplus_sv_en_voxceleb_16k
说话人识别的新模型,模型库已创建在https://modelscope.cn/models/damo/speech_campplus_sv_en_voxceleb_16k/summary
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12180950
2023-04-10 16:27:13 +08:00
yuze.zyz
1eb0786895 Merge branch 'master' into master-merge-github0406
* master:
  speech kws nearfield training add gradient accumulation config
  add canmt translation model  damo/nlp_canmt_translation_zh2en_large
  [to #41669377] fix import missing
2023-04-09 23:53:37 +08:00
xiaoyi.zp
63d5493962 add canmt translation model damo/nlp_canmt_translation_zh2en_large
* add canmt translation model
 * add args for decode
 * change nlp_canmt_translation_zh2en_large damo
 * merge master
 * set default model for canmt

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12079906
2023-04-07 14:37:18 +08:00
yuze.zyz
7b7e772a9f Merge branch 'master-github' into master-merge-github0406 2023-04-06 15:15:37 +08:00
biwen.lbw
9ec8f14f6f update face reconstruction to HRN(CVPR2023)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12161605

* update to HRN

* update test image

* update results format

* delete useless code & change header

* add comment

* reorganize code
2023-04-06 14:03:27 +08:00
Zhicheng Zhang
92acca0629 Feat/plugin update (#241)
* reload pkg resources after installed

* add version test in order to install correct version

* install only uninstalled package from requirements

* support get module name from distribution

* bug fixed

---------

Co-authored-by: Zhicheng Zhang <zhangzhicheng.zzc@alibaba-inc.com>
2023-03-30 09:00:49 +08:00
tastelikefeet
d3cec46655 Fix faq tests (#217) 2023-03-20 21:16:57 +08:00
james.wjg
1ce28bc4f9 cv/video_instance_segmentation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11891175
2023-03-10 10:04:03 +08:00