Commit Graph

1053 Commits

Author SHA1 Message Date
yuze.zyz
fde8644883 Fix a bug that the logging file cannot save the correct lr, which is zero instead
This bug is a result of float rounding when saving key-value pairs to log files, which is reported by a user.
Now the solution is to remove the rounding operation of all values, instead of only the lr value, which I think may be too specific.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10684029
2022-11-30 21:59:02 +08:00
wenmeng.zwm
a4e6c5226c remove get_pipeline_by_model_name
* remove some logic which may result in strange error when get hub info failed

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10924091
2022-11-30 21:53:02 +08:00
wenmeng.zwm
4dd99b8f6e Revert "move opencv dependency from framwork to cv "
This reverts commit e970a6eb43.
2022-11-30 18:29:03 +08:00
xiangpeng.wxp
2c4dc8c660 [to #42322933] nlp csanmt translation fix finetuning bug
nlp csanmt translation fix finetuning bug
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10923166

    * [to #42322933] nlp csanmt translation fix finetuning bug
2022-11-30 17:49:55 +08:00
jiangyu.xzy
9bfc77c178 support asr new models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10919277

* support new asr paraformer model

* support asr conformer model
2022-11-30 17:08:35 +08:00
qianmu.ywh
cc27e3a25e update pipeline according to online demo requirements
按在线demo前端的要求,将输出改成单独一个numpy格式的图片
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10912907
2022-11-30 11:53:40 +08:00
hemu.zp
cdb485b554 [to #42322933] Fix bug for DistributedPipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10913762
2022-11-30 11:51:35 +08:00
jerry.lp
177d70829b add gpt-moe model for modelscope pipeline inference
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10836131
2022-11-29 20:54:32 +08:00
shuying.shu
9229a9b12b fix interpolate value error for vitadapter semantic segmentation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10894248
2022-11-29 17:46:03 +08:00
shuying.shu
6baf602bc2 adjust input and output format for demo service
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10873454
2022-11-29 13:57:09 +08:00
xiangpeng.wxp
2536f9ec9b [to #42322933] add en-zh en-es es-en base translation models
* add en-zh en-es es-en base translation models
 * add en-zh en-es es-en base translation models
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10895782

    * 新增英中/英西/西英-base机器翻译模型

* 新增英中/英西/西英-base机器翻译模型
2022-11-29 13:44:06 +08:00
wenmeng.zwm
64516eb734 Merge branch merge_master_github_1128 into master
Title: merge master github to gitlab 

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10884192
2022-11-29 11:55:54 +08:00
yichang.zyc
ebb9636179 fix 不必要的init和优化vqa的preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10868091
2022-11-28 23:12:23 +08:00
xingjun.wxj
1878500cb4 [to #42322933] fix log print and extensions issue for datasets==2.5.2
1. ExternalDataset的init部分中,引入datasets包自带的_EXTENSION_TO_MODULE会有版本兼容性的问题,比如2.5.2版本就修改了数据结构,与老版本不兼容;
2. 某些cv数据集跳过打印logger.error
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10893702
2022-11-28 23:09:49 +08:00
wenmeng.zwm
261cbb78ce Merge branch 'master-gitlab' into merge_master_github_1128 2022-11-28 22:57:44 +08:00
mulin.lyh
2a8e653169 [to #46408569]fix: pipeline and trainer user-agent add not replacement.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10890156

    * [to #46408569]fix: pipeline and trainer user-agent add not replacement.
2022-11-28 19:45:58 +08:00
wenmeng.zwm
3b78421236 fix: torch.concat compatibility with torch1.8
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10885659
2022-11-28 19:24:34 +08:00
qianmu.ywh
fc6d0c64bc add image_depth_estimation: model, pipeline, test
接入图像深度估计模型,新增model、pipeline、test
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10857764
2022-11-28 18:00:48 +08:00
shiyi.zxh
b386a4ee50 adapt to different wav input
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10886461
2022-11-28 17:48:10 +08:00
mulin.lyh
a4c36a2920 [to #46273042]feat: pipeline trainer stat information from snapshot_download
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10837490
2022-11-28 15:06:03 +08:00
Yingda Chen
d5ee8aa66d move long-running test to level 2 2022-11-28 13:50:28 +08:00
wenmeng.zwm
b2dd4af2ae fix conflict 2022-11-28 13:34:54 +08:00
Yingda Chen
a82dbb8f97 Merge pull request #33 from modelscope/codegeex_code_translation
CodeGeex code translation and generation

ut failed due to a known run.py environment setup issue that is being fixed. nothing to do with the change itself.
2022-11-28 11:55:42 +08:00
Yingda Chen
355b1f336e Merge pull request #35 from pengzhendong/master
[pipelines] support wenet

note: ut failed is due to a run.py enveironment setup issue that is being fixed. nothing to do with the change.
2022-11-28 11:52:32 +08:00
shichen.fsc
acb8d36699 [to #42322933] add extractive-summarization and topic-segmentation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10856839
2022-11-25 19:29:02 +08:00
jiangyu.xzy
2b62084146 add funasr based asr inference
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10868583
2022-11-25 17:49:24 +08:00
xingjun.wxj
7b167861a4 [to #42322933] add features for alimeeting competition dataset
1. add ExternalDataset methods for csv/txt/json/jsonl files on the oss storage
2. add user-define delimiter for csv in meta.
3. supports internal dataset
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib
2022-11-25 17:48:19 +08:00
bin.xue
1969c3a1db test: add new demo data
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10872422
2022-11-25 17:31:59 +08:00
shuaigezhu
028551cd62 add code_generation files 2022-11-25 16:41:44 +08:00
shuaigezhu
c9064caa58 add code_generation 2022-11-25 16:35:19 +08:00
pengzhendong
02d2469e55 check wenetruntime 2022-11-25 15:59:28 +08:00
shiyi.zxh
7661470350 ofa增加asr任务
ofa增加asr任务infer
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10761019
2022-11-25 12:16:33 +08:00
shuaigezhu
65adde14d8 remove uttest 2022-11-25 11:55:53 +08:00
pengzhendong
a2532210af fix wenetruntime version 2022-11-25 11:47:25 +08:00
Yingda Chen
f5e84a5149 modifiy copyright header 2022-11-25 09:44:01 +08:00
lulu.lcq
ff171500bb [to #42322933] add dpm-solver for diffusion models
为diffusion模型加入dpm solver支持,相比ddim scheduler快2~6倍。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10826722
2022-11-25 09:42:48 +08:00
pengzhendong
b0cf09d7b0 [ci] chang pypi url to tsinghua 2022-11-24 22:12:58 +08:00
pengzhendong
eb2ef3a1cf [lint] fix lint 2022-11-24 19:48:48 +08:00
pengzhendong
2605824dea [tests] add unittest 2022-11-24 16:42:01 +08:00
mulin.lyh
24b12698aa [to #46342279]fix: fix some time test_skin_retouching.py failed
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10851834

    * [to #46342279]fix: fix some time test_skin_retouching.py failed
2022-11-24 16:05:36 +08:00
mulin.lyh
70deb0190b [to #46289830]feat: hub sdk support retry and continue-download after error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10814720
2022-11-24 15:01:24 +08:00
zhangzhicheng.zzc
7fc49e5fa0 support table recognition task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10773667
2022-11-24 14:49:58 +08:00
wenmeng.zwm
7c0d7f872c [to 43878347] support batch inference in pipeline
It is recommented that each pipleine should implement `_batch`  to make a list of preprocessed data into a batched data dict.

Then  by paasing batch_size=n  we can use batch inference in pipline, for example
```python
img_captioning = pipeline(
            Tasks.image_captioning,
            model='damo/ofa_image-caption_coco_large_en')

results = img_captioning(
            [{
                'image': 'data/test/images/image_captioning.png'
            } for _ in range(6)],
            batch_size=2)
```

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10051193
2022-11-24 14:31:00 +08:00
shuaigezhu
1ab8a1f764 updated 2022-11-24 11:20:25 +08:00
shuaigezhu
f171552ee3 updated 2022-11-24 10:50:38 +08:00
wendi.hwd
ff55bd9436 support camouflaged-detection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10834768
2022-11-24 10:24:05 +08:00
liugao.lg
31689a0139 merge master& add multi-gpu for ofa
新增对ofa多GPU训练的支持
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10838906
2022-11-23 19:08:39 +08:00
pengzhendong
2e30caf1e6 [pipelines] add wenetruntime 2022-11-23 17:29:33 +08:00
xianzhe.xxz
9da5091d4d add damoyolo-t & damoyolo-m
1. add damoyolo-t & damoyolo-m models
2. fix the configuration overlap error
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10816561
2022-11-23 09:27:16 +08:00
shuaigezhu
db0f25a594 init 2022-11-22 10:10:34 +08:00