Commit Graph

2825 Commits

Author SHA1 Message Date
shuaigezhu
028551cd62 add code_generation files 2022-11-25 16:41:44 +08:00
shuaigezhu
c9064caa58 add code_generation 2022-11-25 16:35:19 +08:00
pengzhendong
02d2469e55 check wenetruntime 2022-11-25 15:59:28 +08:00
shiyi.zxh
7661470350 ofa增加asr任务
ofa增加asr任务infer
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10761019
2022-11-25 12:16:33 +08:00
shuaigezhu
65adde14d8 remove uttest 2022-11-25 11:55:53 +08:00
pengzhendong
a2532210af fix wenetruntime version 2022-11-25 11:47:25 +08:00
Yingda Chen
f5e84a5149 modifiy copyright header 2022-11-25 09:44:01 +08:00
lulu.lcq
ff171500bb [to #42322933] add dpm-solver for diffusion models
为diffusion模型加入dpm solver支持,相比ddim scheduler快2~6倍。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10826722
2022-11-25 09:42:48 +08:00
pengzhendong
b0cf09d7b0 [ci] chang pypi url to tsinghua 2022-11-24 22:12:58 +08:00
pengzhendong
eb2ef3a1cf [lint] fix lint 2022-11-24 19:48:48 +08:00
pengzhendong
2605824dea [tests] add unittest 2022-11-24 16:42:01 +08:00
mulin.lyh
24b12698aa [to #46342279]fix: fix some time test_skin_retouching.py failed
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10851834

    * [to #46342279]fix: fix some time test_skin_retouching.py failed
2022-11-24 16:05:36 +08:00
mulin.lyh
70deb0190b [to #46289830]feat: hub sdk support retry and continue-download after error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10814720
2022-11-24 15:01:24 +08:00
zhangzhicheng.zzc
7fc49e5fa0 support table recognition task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10773667
2022-11-24 14:49:58 +08:00
wenmeng.zwm
7c0d7f872c [to 43878347] support batch inference in pipeline
It is recommented that each pipleine should implement `_batch`  to make a list of preprocessed data into a batched data dict.

Then  by paasing batch_size=n  we can use batch inference in pipline, for example
```python
img_captioning = pipeline(
            Tasks.image_captioning,
            model='damo/ofa_image-caption_coco_large_en')

results = img_captioning(
            [{
                'image': 'data/test/images/image_captioning.png'
            } for _ in range(6)],
            batch_size=2)
```

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10051193
2022-11-24 14:31:00 +08:00
shuaigezhu
1ab8a1f764 updated 2022-11-24 11:20:25 +08:00
shuaigezhu
f171552ee3 updated 2022-11-24 10:50:38 +08:00
wendi.hwd
ff55bd9436 support camouflaged-detection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10834768
2022-11-24 10:24:05 +08:00
liugao.lg
31689a0139 merge master& add multi-gpu for ofa
新增对ofa多GPU训练的支持
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10838906
2022-11-23 19:08:39 +08:00
pengzhendong
2e30caf1e6 [pipelines] add wenetruntime 2022-11-23 17:29:33 +08:00
xianzhe.xxz
9da5091d4d add damoyolo-t & damoyolo-m
1. add damoyolo-t & damoyolo-m models
2. fix the configuration overlap error
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10816561
2022-11-23 09:27:16 +08:00
shuaigezhu
db0f25a594 init 2022-11-22 10:10:34 +08:00
zhangzhicheng.zzc
5f719e542b [to #42322933] add nlp/addr/structure and update token classificaiton related method 2022-11-21 16:14:53 +08:00
Yingda Chen
c32c0e5cfe Merge pull request #30 from modelscope/merge_master_internal_1118
Merge master internal 1118
2022-11-18 16:04:26 +08:00
wenmeng.zwm
584fa8f586 merge internal master 2022-11-18 14:21:05 +08:00
Yingda Chen
0451b3d3cb rename some constants 2022-11-18 13:17:30 +08:00
yingda.chen
9ad831f5c1 revert stat collection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10780767
2022-11-17 23:54:32 +08:00
mulin.lyh
f1ef4d8d9f [to #46219277]fix pre-commit pycqa flake8 to github
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10778739

    * [to #46219277]fix pre-commit pycqa flake8 to github
2022-11-17 21:02:14 +08:00
leyuan.hjy
1a127ed997 fix outputs none
fix 输出为空的情况
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10725840
2022-11-17 18:11:40 +08:00
zhangzhicheng.zzc
ed9d2b5436 bug fixed in token classification postprecessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10763022

    * [fix sequence labeling postprocess bug]
2022-11-17 18:11:04 +08:00
Yingda Chen
2e41326849 Merge pull request #29 from modelscope/merge_master_internal_1116
Merge master internal  to master
2022-11-17 10:25:20 +08:00
mulin.lyh
90a5efa1c2 [to #46106568]feat: parallel run ci case 2022-11-17 08:51:23 +08:00
shuying.shu
10926a06d4 fix bug for downloading hugging face pretrained model http error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10750369
2022-11-16 20:30:03 +08:00
bin.xue
3798677395 [to #42322933] bug fix: deadlock when setting the thread number up to 90
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10743508

* fix: load model directly from .pth
2022-11-16 18:39:40 +08:00
wenmeng.zwm
f0e92bf5f2 upgrade flake8 precommit repo to fix linter test failed 2022-11-16 18:21:23 +08:00
wenmeng.zwm
9f2de967c5 merge master and fix conflict 2022-11-16 18:10:39 +08:00
james.wjg
541e460f8b add support for cv/language_guided_video_summarization
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10636269
2022-11-16 15:20:26 +08:00
wenmeng.zwm
e5980492a1 make mglm isolated test because mpu init problem
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10728515

    * make mglm isolated test because mpu init problem
2022-11-15 13:39:41 +08:00
xiangpeng.wxp
d6ea41fb70 [to #42322933] solve memory error for translation finetune
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10713843

    * [to #42322933] solve memory error for translation finetune
2022-11-14 20:31:29 +08:00
yingda.chen
4e4faa9a30 specifiy file encoding when open text for read
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10708723
2022-11-14 14:16:08 +08:00
huizheng.hz
2fe5203571 reduce image denoising test time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10712244
2022-11-14 12:30:36 +08:00
yingda.chen
e970a6eb43 move opencv dependency from framwork to cv
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10708368
2022-11-12 20:09:48 +08:00
mulin.lyh
c6e575458a [to #45878116]feat: run linter test first
提高ci效率,先跑linter,linter错误先报漏出来,不用合并release
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10596907

    * [to #45878116]feat: run linter test first
2022-11-11 16:19:14 +08:00
mulin.lyh
eb37921ad6 [to #45915958]feat: v1.0.2 docker file update, add deepspeed, apex, uncore
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10617428
2022-11-11 11:03:00 +08:00
zfm104435
08327d5af9 在modelscope 基础镜像中添加 jupyter lab 插件,支持静默关闭功能
在modelscope 基础镜像中添加 jupyter lab 插件,用于收集用户在notebook 中的鼠标、键盘事件,来支持静默关闭功能。
主要改变如下:
1. 新增jupyterlab_active_log 插件的源码和编译后的文件
2. 修改Dockerfile.ubuntu 文件,将上述源码文件拷贝的jupyter的插件目录中。
3. 修改pip和conda 的镜像地址为阿里云的
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10690152
2022-11-10 22:10:13 +08:00
shuying.shu
085acc64c8 fix bug and change unittest mode
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10680402
2022-11-10 13:09:56 +08:00
caorongyu.cry
e2a9695f93 [to #42322933] add synonym
主要做了如下修改:
1. 加入了同义词词典
2. 对SQL进行后处理,如果包含排序,则将空列转化成Primary列
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10670121
2022-11-08 22:20:03 +08:00
wenmeng.zwm
266851bbbb Merge branch 'master-gitlab' into master-github 2022-11-08 18:06:20 +08:00
hemu.zp
0f0fdcae6f [to #42322933] Fix bug for mplug evaluation
修复了 mplug evaluation 使用了错误的 metrics 的问题,将部分中文处理代码独立到 utils 中,为 mplug 添加 trainer
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10612875
2022-11-08 17:58:03 +08:00
Yingda Chen
57499c248c [to #42322933] update readme 2022-11-08 16:06:03 +08:00