Commit Graph

1039 Commits

Author SHA1 Message Date
wenmeng.zwm
261cbb78ce Merge branch 'master-gitlab' into merge_master_github_1128 2022-11-28 22:57:44 +08:00
mulin.lyh
2a8e653169 [to #46408569]fix: pipeline and trainer user-agent add not replacement.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10890156

    * [to #46408569]fix: pipeline and trainer user-agent add not replacement.
2022-11-28 19:45:58 +08:00
wenmeng.zwm
3b78421236 fix: torch.concat compatibility with torch1.8
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10885659
2022-11-28 19:24:34 +08:00
qianmu.ywh
fc6d0c64bc add image_depth_estimation: model, pipeline, test
接入图像深度估计模型,新增model、pipeline、test
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10857764
2022-11-28 18:00:48 +08:00
shiyi.zxh
b386a4ee50 adapt to different wav input
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10886461
2022-11-28 17:48:10 +08:00
mulin.lyh
a4c36a2920 [to #46273042]feat: pipeline trainer stat information from snapshot_download
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10837490
2022-11-28 15:06:03 +08:00
Yingda Chen
d5ee8aa66d move long-running test to level 2 2022-11-28 13:50:28 +08:00
wenmeng.zwm
b2dd4af2ae fix conflict 2022-11-28 13:34:54 +08:00
Yingda Chen
a82dbb8f97 Merge pull request #33 from modelscope/codegeex_code_translation
CodeGeex code translation and generation

ut failed due to a known run.py environment setup issue that is being fixed. nothing to do with the change itself.
2022-11-28 11:55:42 +08:00
Yingda Chen
355b1f336e Merge pull request #35 from pengzhendong/master
[pipelines] support wenet

note: ut failed is due to a run.py enveironment setup issue that is being fixed. nothing to do with the change.
2022-11-28 11:52:32 +08:00
shichen.fsc
acb8d36699 [to #42322933] add extractive-summarization and topic-segmentation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10856839
2022-11-25 19:29:02 +08:00
jiangyu.xzy
2b62084146 add funasr based asr inference
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10868583
2022-11-25 17:49:24 +08:00
xingjun.wxj
7b167861a4 [to #42322933] add features for alimeeting competition dataset
1. add ExternalDataset methods for csv/txt/json/jsonl files on the oss storage
2. add user-define delimiter for csv in meta.
3. supports internal dataset
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib
2022-11-25 17:48:19 +08:00
bin.xue
1969c3a1db test: add new demo data
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10872422
2022-11-25 17:31:59 +08:00
shuaigezhu
028551cd62 add code_generation files 2022-11-25 16:41:44 +08:00
shuaigezhu
c9064caa58 add code_generation 2022-11-25 16:35:19 +08:00
pengzhendong
02d2469e55 check wenetruntime 2022-11-25 15:59:28 +08:00
shiyi.zxh
7661470350 ofa增加asr任务
ofa增加asr任务infer
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10761019
2022-11-25 12:16:33 +08:00
shuaigezhu
65adde14d8 remove uttest 2022-11-25 11:55:53 +08:00
pengzhendong
a2532210af fix wenetruntime version 2022-11-25 11:47:25 +08:00
Yingda Chen
f5e84a5149 modifiy copyright header 2022-11-25 09:44:01 +08:00
lulu.lcq
ff171500bb [to #42322933] add dpm-solver for diffusion models
为diffusion模型加入dpm solver支持,相比ddim scheduler快2~6倍。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10826722
2022-11-25 09:42:48 +08:00
pengzhendong
b0cf09d7b0 [ci] chang pypi url to tsinghua 2022-11-24 22:12:58 +08:00
pengzhendong
eb2ef3a1cf [lint] fix lint 2022-11-24 19:48:48 +08:00
pengzhendong
2605824dea [tests] add unittest 2022-11-24 16:42:01 +08:00
mulin.lyh
24b12698aa [to #46342279]fix: fix some time test_skin_retouching.py failed
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10851834

    * [to #46342279]fix: fix some time test_skin_retouching.py failed
2022-11-24 16:05:36 +08:00
mulin.lyh
70deb0190b [to #46289830]feat: hub sdk support retry and continue-download after error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10814720
2022-11-24 15:01:24 +08:00
zhangzhicheng.zzc
7fc49e5fa0 support table recognition task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10773667
2022-11-24 14:49:58 +08:00
wenmeng.zwm
7c0d7f872c [to 43878347] support batch inference in pipeline
It is recommented that each pipleine should implement `_batch`  to make a list of preprocessed data into a batched data dict.

Then  by paasing batch_size=n  we can use batch inference in pipline, for example
```python
img_captioning = pipeline(
            Tasks.image_captioning,
            model='damo/ofa_image-caption_coco_large_en')

results = img_captioning(
            [{
                'image': 'data/test/images/image_captioning.png'
            } for _ in range(6)],
            batch_size=2)
```

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10051193
2022-11-24 14:31:00 +08:00
shuaigezhu
1ab8a1f764 updated 2022-11-24 11:20:25 +08:00
shuaigezhu
f171552ee3 updated 2022-11-24 10:50:38 +08:00
wendi.hwd
ff55bd9436 support camouflaged-detection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10834768
2022-11-24 10:24:05 +08:00
liugao.lg
31689a0139 merge master& add multi-gpu for ofa
新增对ofa多GPU训练的支持
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10838906
2022-11-23 19:08:39 +08:00
pengzhendong
2e30caf1e6 [pipelines] add wenetruntime 2022-11-23 17:29:33 +08:00
xianzhe.xxz
9da5091d4d add damoyolo-t & damoyolo-m
1. add damoyolo-t & damoyolo-m models
2. fix the configuration overlap error
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10816561
2022-11-23 09:27:16 +08:00
shuaigezhu
db0f25a594 init 2022-11-22 10:10:34 +08:00
zhangzhicheng.zzc
5f719e542b [to #42322933] add nlp/addr/structure and update token classificaiton related method 2022-11-21 16:14:53 +08:00
Yingda Chen
c32c0e5cfe Merge pull request #30 from modelscope/merge_master_internal_1118
Merge master internal 1118
2022-11-18 16:04:26 +08:00
wenmeng.zwm
584fa8f586 merge internal master 2022-11-18 14:21:05 +08:00
Yingda Chen
0451b3d3cb rename some constants 2022-11-18 13:17:30 +08:00
yingda.chen
9ad831f5c1 revert stat collection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10780767
2022-11-17 23:54:32 +08:00
mulin.lyh
f1ef4d8d9f [to #46219277]fix pre-commit pycqa flake8 to github
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10778739

    * [to #46219277]fix pre-commit pycqa flake8 to github
2022-11-17 21:02:14 +08:00
leyuan.hjy
1a127ed997 fix outputs none
fix 输出为空的情况
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10725840
2022-11-17 18:11:40 +08:00
zhangzhicheng.zzc
ed9d2b5436 bug fixed in token classification postprecessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10763022

    * [fix sequence labeling postprocess bug]
2022-11-17 18:11:04 +08:00
Yingda Chen
2e41326849 Merge pull request #29 from modelscope/merge_master_internal_1116
Merge master internal  to master
2022-11-17 10:25:20 +08:00
mulin.lyh
90a5efa1c2 [to #46106568]feat: parallel run ci case 2022-11-17 08:51:23 +08:00
shuying.shu
10926a06d4 fix bug for downloading hugging face pretrained model http error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10750369
2022-11-16 20:30:03 +08:00
bin.xue
3798677395 [to #42322933] bug fix: deadlock when setting the thread number up to 90
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10743508

* fix: load model directly from .pth
2022-11-16 18:39:40 +08:00
wenmeng.zwm
f0e92bf5f2 upgrade flake8 precommit repo to fix linter test failed 2022-11-16 18:21:23 +08:00
wenmeng.zwm
9f2de967c5 merge master and fix conflict 2022-11-16 18:10:39 +08:00