Commit Graph

732 Commits

Author SHA1 Message Date
yuze.zyz
06787d66d8 [to #42322933] fix forward input in token classification
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10103632
2022-09-13 18:48:55 +08:00
yingda.chen
e9eeb05bcd [to #42322933] specify ast scan file open encoding
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10090797

    * [to #42322933] specify ast scan file open encoding
2022-09-13 18:04:01 +08:00
zhangzhicheng.zzc
c35f8cb42b [to #42322933] remove deepspeed and fariseq from requirments 2022-09-13 16:09:35 +08:00
wenmeng.zwm
269faa8bce [to #43878396] bump version to 0.4.0 v0.4.0 2022-09-13 10:37:59 +08:00
dingkun.ldk
54e1a6d88b [to #42322933]830NLP 篇章排序/文本表示模型代码check
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9856179
2022-09-10 15:59:56 +08:00
hejunjie.hjj
f4a47d006a [to #42322933] format boxes output [x, y, w, h] to [x1, y1, x2, y2]
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10090172

    * fix bug when pipeline input is Image.Image or numpy.ndarray
2022-09-10 12:57:32 +08:00
Yingda Chen
e0ef60ca9b [to #42322933] skip demo test by default 2022-09-09 14:56:33 +08:00
hemu.zp
a4cfbaa0dd [to #42322933] revert mplug batch inference
由于之前实现的 batch 化 inference 与 pipelines/base.py 中输入 List[Input] 的情况存在冲突,移除了此处之前实现的 batch 化 inference 代码。mplug 模型在 pipeline 中推理时输入只接受 Image.Image,str,tuple,dict 类型,对于 List[Input] 的情况由 pipelines/base.py 中的代码进行处理
2022-09-09 14:56:05 +08:00
zhangzhicheng.zzc
937d3ca67b [to #42322933] bugs:circular dependency fixed/ word_segmentation output 2022-09-09 14:52:35 +08:00
ly119399
b41b10f897 [to #42322933] space finetune on generation task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10061562
2022-09-09 14:27:08 +08:00
bin.xue
4be7737122 [to #42322933] audio pipelines accept url as input 2022-09-09 13:51:09 +08:00
shichen.fsc
84c384cc57 [to #42322933] add httpurl support for KWS
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10078262
2022-09-09 10:06:20 +08:00
jiangnana.jnn
5e176da3a1 adapt to msdataset for EasyCV
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9935664

    * adapt to msdataset for EasyCV
2022-09-09 10:01:51 +08:00
jiangnana.jnn
652ec697b7 refactor inputs format of model forward
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9673243

    * refactor inputs format of model forward
2022-09-08 20:16:14 +08:00
hemu.zp
be2f31fc15 [to #42322933] Fix mplug model interface
1. 修复 mplug 模型接口问题
2. 修复 mplug inference 不支持 batch 输入问题
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10052321
2022-09-08 16:07:34 +08:00
lingcai.wl
7a49fa1cc6 [to #44657982] add unittest for demo and demotest utils
unittest for demo service
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006180
2022-09-08 14:08:51 +08:00
cyc385202
d4759e4c24 [to #42322933] 加入space模型在banking数据集上的finetune代码
加入space模型在banking数据集上的微调代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006792
2022-09-08 13:45:14 +08:00
shichen.fsc
6fd5f671fa [to #42322933] add httpurl support for ASR
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10043608
2022-09-08 11:00:35 +08:00
tingwei.gtw
7b23c41748 [to #42322933] Add video-inpainting files
视频编辑的cr
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10026166
2022-09-07 21:06:25 +08:00
mulin.lyh
ad6bb1e7d9 [to #44790143]fix: add ipythonkernel to image for dsw
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10049527

    * add ipykernel to image for dsw
2022-09-07 20:51:15 +08:00
shichen.fsc
a8fd9c4afe [to #42322933] add new pipeline - PoNet for fill-mask
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10019083
2022-09-07 20:12:44 +08:00
dingkun.ldk
7ed4015bdc [to #42322933]支持词性标注
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9980774
2022-09-07 11:57:30 +08:00
wenmeng.zwm
f96c4a5ea2 [to #44742129] skip commit result when MODEL_TAG_URL is empty str
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10045468
2022-09-07 11:12:18 +08:00
ly261666
8f05fa8cf1 [to #42322933] 新增MogFace人脸检测器
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9921926
2022-09-07 09:35:59 +08:00
ly261666
c12957a9eb [to #42322933] 新增Mtcnn人脸检测器
1. 完成Maas-cv CR标准 自查
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9951519

    * [to #42322933] 新增Mtcnn人脸检测器
2022-09-06 22:53:55 +08:00
eniac.xcw
d38076b072 makes test code clear
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10041992
2022-09-06 22:18:51 +08:00
wenmeng.zwm
fabb4716d4 [to #44610931] fix: add device usage when device is None or empty
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10039848

    * add device usage when device is None or empty

    * update docker env
2022-09-06 21:47:59 +08:00
xuangen.hlh
f7f29ed1ff DALL-E 2: 修复dev/dalle2_1分支问题,增加测试代码,本地测试通过
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10037492
2022-09-06 20:47:23 +08:00
wenmeng.zwm
cd8ac57fdd [to #44742129] support model tag for integration
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10035056

* support model tag for integration
2022-09-06 19:06:49 +08:00
yuze.zyz
01e768503c [to #42322933] Fix random seed for trainer
1. Fix random seed for trainer and init it at the first line of init
2. Add a regress test for fixed training
3. Change the dataset 'dureader_robust_qg' to 'DuReader_robust-QG'
4. Change some datasets from loading hf.datasets to loading msdataset.load
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10029509
2022-09-06 15:13:14 +08:00
suluyan.sly
4c5afd22d4 [to #42322933]fix: rm plug_for_text_generation in nlp/__init__.py
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10029585
2022-09-06 14:55:56 +08:00
ly261666
9cbf246a8c [to #42322933] 新增ULFD人脸检测器
1. 完成Maas-cv CR标准 自查
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9957634
2022-09-06 10:02:49 +08:00
suluyan.sly
904374d329 [to #42322933] feat: plug inference
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9931748
2022-09-05 20:58:08 +08:00
feiwu.yfw
e365023862 修复processor输出torch.tensor时被转为numpy的异常
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10021802

    * fix to_torch_dataset
2022-09-05 19:36:46 +08:00
hemu.zp
3d3f9b4537 [to #42322933] fix checkpoint format
1. 修复 palm,gpt3,mplug 模型存在的 finetune 后保存 checkpoint 与原有 checkpoint key 字段存在区别无法使用 from_pretrained 导入的问题
2. 调整 test_finetune_mplug.py 为只保存训练结束时的 checkpoint,减少 ci 耗时
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10016517
2022-09-05 17:51:22 +08:00
mulin.lyh
83dbf71302 [to #44702084]fix: ci pip install domain in single commands, find with requirement install failed is complicated.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10019738

    * [to #44702084]fix: ci pip install domain in single commands, find with requirement install failed is complicated.
2022-09-05 17:38:05 +08:00
liangting.zl
4484dcaa04 [to #42322933] feat: add hand keypoints pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9961906

    * feat: add hand keypoints pipeline
2022-09-05 16:42:40 +08:00
xingjun.wxj
f660a119f0 [to #42322933]Add resumable and large data upload.
CR Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9995250

1. add resumable dataset upload
2. add large data upload (up to 48.8TB)
2022-09-05 16:19:45 +08:00
mulin.lyh
042cff7d68 [to #44702084]fix: ci pip install domain in single commands, find with requirement install failed is complicated.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10014958

    * [to #44702084]fix: ci pip install domain in single commands, find with requirement install failed is complicated.
2022-09-05 16:08:50 +08:00
ly261666
f4ca0b8aab [to #42322933]add lazy import
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10012143
2022-09-05 15:54:57 +08:00
ly261666
c25e60c67d [to #42322933]add lazy load
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10011795

    * [to #42322933] 新增FER人脸属性识别
2022-09-05 13:52:54 +08:00
bin.xue
b870e4eed5 [to #42322933] test: use custom config to reduce test time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10011826
2022-09-05 13:26:30 +08:00
yuze.zyz
a9c14e4ead [to #42322933] Support saving the best checkpoint for inference
1. Support saving the best checkpoint for inference
2. Fix a bug that _max_iters field does not exist in trainer
3. Fix a bug that function in lambda_lr field cannot be saved to file
4. Fix a bug that save_pretrained would not be called by iterating
5. Fix a bug that interval is not passed from BestCkptHook's init
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9972765
2022-09-05 11:07:48 +08:00
zhangzhicheng.zzc
3e92dac328 [to #42322933]lazy load activate for shop segmentation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10009052
2022-09-05 09:55:26 +08:00
ly261666
adab7d3391 [to #42322933] 新增FER人脸属性识别
完成Maas-cv CR自查;
新增个Task,已经跟产品确认可以增加,正在走流程中,目前还不在https://aone.alibaba-inc.com/v2/project/1181559/req#viewIdentifier=d7f112f9d023e2108fa1b0d8这里,后续会增加过来
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9976346
2022-09-05 09:53:58 +08:00
ly261666
f508be8918 [to #42322933] 新增RetinaFace人脸检测器
1. 新增人脸检测RetinaFace模型;
2. 完成Maas-cv CR标准自查
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9945188
2022-09-03 23:48:42 +08:00
xingguang.zxg
0451627626 [to #42322933]商品显著性分割v1.0
商品显著性检测模型,依赖opencv,mmcv-full
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9909897
2022-09-03 13:21:31 +08:00
Yingda Chen
39a309b655 [to #42322933] reduce train epoch from 3 to w 2022-09-03 12:18:52 +08:00
wenmeng.zwm
ba74cdf97e [to #43878347] Rename runtime.txt to framework.txt
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10000642

    * rename runtime.txt  to framework.txt
2022-09-03 12:10:16 +08:00
shuying.shu
4f72134adf [to #42322933]update test video for movie scene segmentation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10007852

    * update test video for movie scene segmentation
2022-09-03 11:50:01 +08:00