Commit Graph

1020 Commits

Author SHA1 Message Date
Yingda Chen
33934fccf7 Merge pull request #40 from co63oc/patch-2
Update develop.md

no code change, gated tests not required.
2022-12-03 11:34:09 +08:00
Yingda Chen
22417100c7 Merge pull request #41 from co63oc/patch-3
Update faq.md

no code change, merge without gated tests.
2022-12-03 11:26:25 +08:00
chenxujun
ea5c2a2155 Update faq.md
Fix typo
2022-12-03 08:53:55 +08:00
chenxujun
79da49e078 Update develop.md
Fix typo
2022-12-03 08:50:51 +08:00
Yingda Chen
a82dbb8f97 Merge pull request #33 from modelscope/codegeex_code_translation
CodeGeex code translation and generation

ut failed due to a known run.py environment setup issue that is being fixed. nothing to do with the change itself.
2022-11-28 11:55:42 +08:00
Yingda Chen
355b1f336e Merge pull request #35 from pengzhendong/master
[pipelines] support wenet

note: ut failed is due to a run.py enveironment setup issue that is being fixed. nothing to do with the change.
2022-11-28 11:52:32 +08:00
shuaigezhu
028551cd62 add code_generation files 2022-11-25 16:41:44 +08:00
shuaigezhu
c9064caa58 add code_generation 2022-11-25 16:35:19 +08:00
pengzhendong
02d2469e55 check wenetruntime 2022-11-25 15:59:28 +08:00
shuaigezhu
65adde14d8 remove uttest 2022-11-25 11:55:53 +08:00
pengzhendong
a2532210af fix wenetruntime version 2022-11-25 11:47:25 +08:00
pengzhendong
b0cf09d7b0 [ci] chang pypi url to tsinghua 2022-11-24 22:12:58 +08:00
pengzhendong
eb2ef3a1cf [lint] fix lint 2022-11-24 19:48:48 +08:00
pengzhendong
2605824dea [tests] add unittest 2022-11-24 16:42:01 +08:00
shuaigezhu
1ab8a1f764 updated 2022-11-24 11:20:25 +08:00
shuaigezhu
f171552ee3 updated 2022-11-24 10:50:38 +08:00
pengzhendong
2e30caf1e6 [pipelines] add wenetruntime 2022-11-23 17:29:33 +08:00
shuaigezhu
db0f25a594 init 2022-11-22 10:10:34 +08:00
Yingda Chen
c32c0e5cfe Merge pull request #30 from modelscope/merge_master_internal_1118
Merge master internal 1118
2022-11-18 16:04:26 +08:00
wenmeng.zwm
584fa8f586 merge internal master 2022-11-18 14:21:05 +08:00
Yingda Chen
0451b3d3cb rename some constants 2022-11-18 13:17:30 +08:00
yingda.chen
9ad831f5c1 revert stat collection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10780767
2022-11-17 23:54:32 +08:00
mulin.lyh
f1ef4d8d9f [to #46219277]fix pre-commit pycqa flake8 to github
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10778739

    * [to #46219277]fix pre-commit pycqa flake8 to github
2022-11-17 21:02:14 +08:00
leyuan.hjy
1a127ed997 fix outputs none
fix 输出为空的情况
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10725840
2022-11-17 18:11:40 +08:00
zhangzhicheng.zzc
ed9d2b5436 bug fixed in token classification postprecessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10763022

    * [fix sequence labeling postprocess bug]
2022-11-17 18:11:04 +08:00
Yingda Chen
2e41326849 Merge pull request #29 from modelscope/merge_master_internal_1116
Merge master internal  to master
2022-11-17 10:25:20 +08:00
mulin.lyh
90a5efa1c2 [to #46106568]feat: parallel run ci case 2022-11-17 08:51:23 +08:00
shuying.shu
10926a06d4 fix bug for downloading hugging face pretrained model http error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10750369
2022-11-16 20:30:03 +08:00
bin.xue
3798677395 [to #42322933] bug fix: deadlock when setting the thread number up to 90
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10743508

* fix: load model directly from .pth
2022-11-16 18:39:40 +08:00
wenmeng.zwm
f0e92bf5f2 upgrade flake8 precommit repo to fix linter test failed 2022-11-16 18:21:23 +08:00
wenmeng.zwm
9f2de967c5 merge master and fix conflict 2022-11-16 18:10:39 +08:00
james.wjg
541e460f8b add support for cv/language_guided_video_summarization
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10636269
2022-11-16 15:20:26 +08:00
wenmeng.zwm
e5980492a1 make mglm isolated test because mpu init problem
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10728515

    * make mglm isolated test because mpu init problem
2022-11-15 13:39:41 +08:00
xiangpeng.wxp
d6ea41fb70 [to #42322933] solve memory error for translation finetune
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10713843

    * [to #42322933] solve memory error for translation finetune
2022-11-14 20:31:29 +08:00
yingda.chen
4e4faa9a30 specifiy file encoding when open text for read
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10708723
2022-11-14 14:16:08 +08:00
huizheng.hz
2fe5203571 reduce image denoising test time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10712244
2022-11-14 12:30:36 +08:00
yingda.chen
e970a6eb43 move opencv dependency from framwork to cv
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10708368
2022-11-12 20:09:48 +08:00
mulin.lyh
c6e575458a [to #45878116]feat: run linter test first
提高ci效率,先跑linter,linter错误先报漏出来,不用合并release
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10596907

    * [to #45878116]feat: run linter test first
2022-11-11 16:19:14 +08:00
mulin.lyh
eb37921ad6 [to #45915958]feat: v1.0.2 docker file update, add deepspeed, apex, uncore
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10617428
2022-11-11 11:03:00 +08:00
zfm104435
08327d5af9 在modelscope 基础镜像中添加 jupyter lab 插件,支持静默关闭功能
在modelscope 基础镜像中添加 jupyter lab 插件,用于收集用户在notebook 中的鼠标、键盘事件,来支持静默关闭功能。
主要改变如下:
1. 新增jupyterlab_active_log 插件的源码和编译后的文件
2. 修改Dockerfile.ubuntu 文件,将上述源码文件拷贝的jupyter的插件目录中。
3. 修改pip和conda 的镜像地址为阿里云的
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10690152
2022-11-10 22:10:13 +08:00
shuying.shu
085acc64c8 fix bug and change unittest mode
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10680402
2022-11-10 13:09:56 +08:00
caorongyu.cry
e2a9695f93 [to #42322933] add synonym
主要做了如下修改:
1. 加入了同义词词典
2. 对SQL进行后处理,如果包含排序,则将空列转化成Primary列
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10670121
2022-11-08 22:20:03 +08:00
wenmeng.zwm
266851bbbb Merge branch 'master-gitlab' into master-github 2022-11-08 18:06:20 +08:00
hemu.zp
0f0fdcae6f [to #42322933] Fix bug for mplug evaluation
修复了 mplug evaluation 使用了错误的 metrics 的问题,将部分中文处理代码独立到 utils 中,为 mplug 添加 trainer
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10612875
2022-11-08 17:58:03 +08:00
Yingda Chen
57499c248c [to #42322933] update readme 2022-11-08 16:06:03 +08:00
zhangzhicheng.zzc
d3519bcbca [to #42322933]token preprocess bug fix
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10608664
2022-11-08 15:42:08 +08:00
hemu.zp
dc1b88b396 [to #42322933] Fix bug for distributed gpt3
修复 Pipeline 更新后 DistributedGPT3Pipeline 出现的报错
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10614071
2022-11-08 14:05:01 +08:00
yingda.chen
fa974fdc27 Merge branch ofa/task_finetune into master
Title: [to #42322933]add finetune & merge master 

新增ofa其它任务的finetune能力
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10656541
2022-11-08 13:01:22 +08:00
翎航
fd4276ad1a add five finetune task & merge master 2022-11-08 10:57:22 +08:00
翎航
3534970709 add five finetune task & merge master 2022-11-08 10:39:59 +08:00