hemu.zp
271e2a2a99
[to #42322933 ] Add gpt_neo model
...
1. 添加 gpt_neo 模型，因 checkpoint 归属于 Langboat 还未上传到模型库，已线下完成测试
2. 添加 text-generation task models 与 head，后续会将 gpt3，palm 等已上线文本生成模型统一为 backbone + head 结构的 task models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10404249
2022-10-17 20:54:29 +08:00
zhangzhicheng.zzc
d721fabb34
[to #42322933 ]bert with sequence classification / token classification/ fill mask refactor
...
1.新增支持原始bert模型（非easynlp的 backbone prefix版本）
2.支持bert的在sequence classification/fill mask /token classification上的backbone head形式
3.统一了sequence classification几个任务的pipeline到一个类
4.fill mask 支持backbone head形式
5.token classification的几个子任务（ner，word seg， part of speech）的preprocessor 统一到了一起TokenClassificationPreprocessor
6. sequence classification的几个子任务（single classification， pair classification）的preprocessor 统一到了一起SequenceClassificationPreprocessor
7. 改动register中 cls的group_key 赋值位置，之前的group_key在多个decorators的情况下，会被覆盖，obj_cls的group_key信息不正确
8. 基于backbone head形式将 原本group_key和 module同名的情况尝试做调整，如下在modelscope/pipelines/nlp/sequence_classification_pipeline.py 中
原本
@PIPELINES.register_module(
Tasks.sentiment_classification, module_name=Pipelines.sentiment_classification)
改成
@PIPELINES.register_module(
Tasks.text_classification, module_name=Pipelines.sentiment_classification)
相应的configuration.json也有改动，这样的改动更符合任务和pipline（子任务）的关系。
8. 其他相应改动为支持上述功能
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10041463
2022-09-27 23:08:33 +08:00
wenmeng.zwm
6808e9a301
[to #44902099 ] add license for framework files
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10189613
2022-09-20 17:49:31 +08:00
wenmeng.zwm
fabb4716d4
[to #44610931 ] fix: add device usage when device is None or empty
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10039848
* add device usage when device is None or empty
* update docker env
2022-09-06 21:47:59 +08:00
jiangnana.jnn
930d55d9ad
support EasyCV framework and add Segformer model
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9781849
* support EasyCV
2022-08-26 13:58:50 +08:00
wenmeng.zwm
c72e5f4ae8
[to #43878347 ] skip device placement test
...
skip this test which will result in too much debug log for placement although debug level is canceled after this test case
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9875987
2022-08-24 15:08:22 +08:00
zhangzhicheng.zzc
5b0b54633b
[to #42322933 ]compatible with windows path on only core parts
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9855254
2022-08-24 13:35:42 +08:00
wenmeng.zwm
aaa604cb16
[to #43878347 ] device placement support certain gpu
...
1. add device util to verify, create and place device
2. pipeline and trainer support update
3. fix pipeline which use tf models does not place model to the right device
usage
```python
pipe = pipeline('damo/xxx', device='cpu')
pipe = pipeline('damo/xxx', device='gpu')
pipe = pipeline('damo/xxx', device='gpu:0')
pipe = pipeline('damo/xxx', device='gpu:2')
pipe = pipeline('damo/xxx', device='cuda')
pipe = pipeline('damo/xxx', device='cuda:1')
```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9800672
2022-08-22 15:32:00 +08:00
wenmeng.zwm
7798a6250a
[to #43112692 ] stardarized task name and output
...
1. task name and output definition: [link](https://alidocs.dingtalk.com/i/nodes/KOEmgBoGwD78vd2bAry3VndLerP9b30a?nav=spaces&navQuery=spaceId%3Dnb9XJNlZxbgrOXyA&iframeQuery=utm_source%3Dportal%26utm_medium%3Dportal_space_file_tree )
2. rearrange task definition and add more outputs definition for tasks
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9585469
2022-08-02 20:21:05 +08:00
wenmeng.zwm
d55525bfb6
[to #43112771 ] requirements check and lazy import support
2022-07-27 17:29:16 +08:00
wenmeng.zwm
4814b198f0
[to #43112534 ] taskdataset refine and auto placement for data and model
...
* refine taskdataset interface
* add device placement for trainer
* add device placement for pipeline
* add config checker and fix model placement bug
* fix cycling import
* refactor model init for translation_pipeline
* cv pipelines support kwargs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9463076
2022-07-23 11:08:43 +08:00
jiangnana.jnn
f3d739bea7
[to #43105545 ] add default config and new hooks
2022-07-19 17:41:25 +08:00
zhangzhicheng.zzc
407337fbf3
[to #42322933 ] add model profiling
2022-07-07 20:21:52 +08:00
wenmeng.zwm
8e51a073a6
[to #42966122 ] requirements enchanment and self-host repo support
...
* add self-hosted repo:
* add extra requirements for different field and reduce necessary requirements
* update docker file with so required by audio
* add requirements checker which will be used later when implement lazy import
* remove repeated requirements and replace opencv-python-headless with opencv-python
example usage:
```shell
pip install model_scope[all] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[cv] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[nlp] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[audio] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[multi-modal] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9211383
2022-07-01 16:38:06 +08:00
mulin.lyh
76c6ff6329
[to #42675838 ]merge model hub code
...
合并model hub 代码
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9096493
2022-06-21 20:04:25 +08:00
yingda.chen
5786b9a0a1
[to #42322933 ]formalize image matting
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9019685
2022-06-15 14:06:53 +08:00
wenmeng.zwm
8a030ead72
[to #42362853 ] feat: rename config to configuration and remove repeated task fileds
...
1. rename maas_config to configuration
2. remove task field image and video, using cv instead
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9010802
2022-06-13 19:44:34 +08:00
yingda.chen
3c1ec035fd
[to #42322933 ] refine cartoon model and add model op utitlity
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8993758
2022-06-10 12:56:44 +08:00
wenmeng.zwm
1f6b376599
[to #42373878 ] refactor maaslib to modelscope
...
1. refactor maaslib to modelscope
2. fix UT error
3. support pipeline which does not register default model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8988388
2022-06-09 20:16:26 +08:00
Yingda Chen
3cbdcb1d3e
fix typo
2022-05-20 06:24:18 +08:00
wenmeng.zwm
5e469008fd
[to #41401401 ] add preprocessor, model and pipeline
...
* add preprocessor module
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
* fix UT failed
* add test for Compose
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8769235
* add preprocessor module
* add test for Compose
* fix citest error
* fix abs class error
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* refine models and pipeline interface
* add pipeline folder structure
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
1.add preprossor model pipeline for nlp text classification
2. add corresponding test
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8757371
* new nlp pipeline
* format pre-commit code
* update easynlp pipeline
* update model_name for easynlp pipeline; add test for maas_lib/utils/typeassert.py
* update test_typeassert.py
* refactor code
1. rename typeassert to type_assert
2. use lazy import to make easynlp dependency optional
3. refine image matting UT
* fix linter test failed
* update requirements.txt
* fix UT failed
* fix citest script to update requirements
2022-05-19 22:18:35 +08:00
wenmeng.zwm
0a756f6a0d
[to #41402703 ] add basic modules
...
* add constant
* add logger module
* add registry and builder module
* add fileio module
* add requirements and setup.cfg
* add config module and tests
* add citest script
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8718998
2022-05-17 10:15:00 +08:00
