Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-23 03:29:27 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,822 Commits 263 Branches 106 Tags
update/list_datasets
Commit Graph

1195 Commits

Author SHA1 Message Date
fubang.zfb
48da1619a7 [to #42322933] init 2022-06-15 17:07:04 +08:00
ly119399
b1948cd81c modify forward 2022-06-15 16:23:57 +08:00
wenmeng.zwm
c59833c7ee [to #42461396] feat: test_level support 
* add test level support
* update develop doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9021354
 2022-06-15 14:53:49 +08:00
yingda.chen
5786b9a0a1 [to #42322933]formalize image matting 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9019685
 2022-06-15 14:06:53 +08:00
wenmeng.zwm
b4fc38e1b9 [to #42461396] add Pillow version constraint and update hub version 
1.  use Pillow >= 6.2.0
2. change skip test msg for image caption
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9041194
 2022-06-15 11:43:52 +08:00
思宏
7140cdb670 [to #42322933] init 2022-06-14 13:58:43 +08:00
智丞
46fca87f2a Merge remote-tracking branch 'origin/master' into feat/nli 2022-06-14 09:28:11 +08:00
智丞
753b98f526 update pipeline registry info 2022-06-14 09:27:38 +08:00
思宏
314082810e [to #42322933] init 2022-06-13 20:24:31 +08:00
wenmeng.zwm
8a030ead72 [to #42362853] feat: rename config to configuration and remove repeated task fileds 
1. rename maas_config to configuration
2. remove task field image and video, using cv instead

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9010802
 2022-06-13 19:44:34 +08:00
wenmeng.zwm
3a78e32eb2 Revert "[to #42322933]formalize image matting" 
This reverts commit de3ea0db54.
 2022-06-13 18:30:29 +08:00
ly119399
a09fec6c56 delete file about gen 2022-06-13 16:46:59 +08:00
ly119399
ccbbd959a7 Merge branch 'master' into nlp/space/gen 2022-06-13 16:43:48 +08:00
Yingda Chen
de3ea0db54 [to #42322933]formalize image matting 2022-06-13 15:19:30 +08:00
yingda.chen
b31c86aa0e [to #42409340] add hub specifier 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9005038
 2022-06-13 14:15:54 +08:00
ly119399
c400684327 update 2022-06-12 23:31:45 +08:00
ly119399
46c2dcc27d test with model hub 2022-06-12 23:27:26 +08:00
ly119399
e683a2d4cd merge master 2022-06-12 14:55:32 +08:00
ly119399
c6ec7f2fa4 intent success 2022-06-12 14:14:26 +08:00
wenmeng.zwm
76bc51eadd [to #42362853] support multimodel in pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8997599
 2022-06-10 16:22:28 +08:00
yingda.chen
3c1ec035fd [to #42322933] refine cartoon model and add model op utitlity 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8993758
 2022-06-10 12:56:44 +08:00
ly119399
01cb0b4f72 intent preprocessor ready 2022-06-10 12:45:57 +08:00
ly119399
aaba95e726 add intent 2022-06-10 10:17:27 +08:00
wenmeng.zwm
1f6b376599 [to #42373878] refactor maaslib to modelscope 
1.  refactor maaslib to modelscope
2.  fix UT error
3.  support pipeline which does not register default model

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8988388
 2022-06-09 20:16:26 +08:00
wenmeng.zwm
dd00195814 [to #42362853] add default model support and fix circular import 
1. add default model support
2. fix circular import
3. temporarily skip ofa and palm test which costs too much time

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8981076
 2022-06-09 16:57:33 +08:00
myf272609
0f5b214ce0 [to #42322933] Add cv-person-image-cartoon-pipeline to maas lib 
mass lib 接入人像卡通化算法
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8925552

    * update

* fix style issues

* fix style issues

* fix style issues

* fix style issues

* add requirements

* fix bug

* adapt class init

* fix

* fix tf2 issue

* feat: Fix confilct, auto commit by WebIDE

* fix commit issues

* fix
 2022-06-09 15:18:38 +08:00
yingda.chen
0d840d519c [to #42339763] move pydataset into maas_lib 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8974892
 2022-06-09 10:14:48 +08:00
ly119399
b698506a2c model forward ready 2022-06-08 23:12:59 +08:00
yingda.chen
e3b8ec3bf1 [to #42339559] support multiple models 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8972440

    * [to #42339559] support multiple models
 2022-06-08 21:27:14 +08:00
menrui.mr
68e64a90d4 [to #42322933] add image_caption_pipeline with OFA 
1. add OFA whl for image caption pipeline
2. fix a bug in pipelines/builder.py
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8930942

    * [to #41669377] docs and tools refinement and release 

1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307

* [to #41669377] add pipeline tutorial and fix bugs 

1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301

* refine doc

* refine doc

* upload ofa for caption(with source code but not whl)

* remove data in gitignore

* append uncommitted data dir in ofa

* remove ofa_dir , use ofa.whl instead.

* update BPE

* rollback changes used in debugging.

* Merge branch 'master' into ofa/image_caption

# Conflicts:
#	docs/README.md
#	docs/source/conf.py
#	docs/source/index.rst
#	docs/source/tutorials/pipeline.md
#	maas_lib/models/nlp/sequence_classification_model.py
#	maas_lib/pipelines/builder.py
#	maas_lib/version.py
#	setup.py
#	tests/pipelines/test_text_classification.py

* 1. fix a bug in pipelines/builder.py.
2. modify model_path to model in image_captioning.py.

* 1. rename test_image_captioning.py.

* format all files using pre-commit.

* add fairseq in requirements.txt

* add fairseq in requirements.txt

* change fairseq path to git repo to a whl on oss in ofa.txt.

* change module_name to 'ofa'

* Merge remote-tracking branch 'origin/master' into ofa/image_caption

# Conflicts:
#	maas_lib/pipelines/builder.py

* optim requirements for ofa / refine image_captioning.py

* uncommited change.

* feat: Fix confilct, auto commit by WebIDE
 2022-06-08 18:38:19 +08:00
feiwu.yfw
235880f300 [to #42339763] merge pydataset into maas-lib 
* merge pydataset to the repo
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8955999
 2022-06-08 18:29:39 +08:00
hemu.zp
8a76f40754 [to #42322933]Add text-generation-pipeline with Palm model. 
将 Palm 中文模型接入 MaaS，添加了文本生成 pipeline
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8934393

    * add text_generation model and pipeline

* fix bug

* fix bug

* add TextGenerator in pipeline

* fix bug

* update checkpoint and test inputs

* remove magic number..

* fix bug

* adjust code with AutoModel

* clear comments and tidy up the code

* move model.eval() into generator

* update master interface and lint code

* replace 'palm-text-generation' with 'palm'

* add text_generation model and pipeline

* fix bug

* fix bug

* add TextGenerator in pipeline

* fix bug

* fix conflict of pipeline.txt

* remove magic number..

* fix bug

* adjust code with AutoModel

* clear comments and tidy up the code

* move model.eval() into generator

* fix conflict

* replace 'palm-text-generation' with 'palm'

* fix conflict

* add test_run_modelhub

* update sofa version

* modify sofa version

* add test_run_with_model_name

* fix bug
 2022-06-08 17:11:04 +08:00
ly119399
a1600a65a0 add model 2022-06-08 15:17:21 +08:00
yingda.chen
d6868ddffe [to #42323743] retain local cached model files by default 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8963687
 2022-06-08 14:22:23 +08:00
yingda.chen
e075ad2245 [to #42322515]support plain pipeline for bert 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8945177

    * support plain pipeline for bert
 2022-06-08 11:29:25 +08:00
ly119399
4a244abbf1 token to ids 2022-06-08 00:38:50 +08:00
ly119399
1c1edae8b0 init 2022-06-07 13:29:13 +08:00
yingda.chen
f8eb699f7f refine tests and examples 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8898823
 2022-06-01 10:20:53 +08:00
wenmeng.zwm
1d01a78c2b fix: UT error 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8899458

    * fix: UT error
 2022-06-01 09:16:39 +08:00
yingda.chen
5995cc4607 add PyDataset support 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8868644
 2022-05-31 18:27:19 +08:00
wenmeng.zwm
25a2028b54 [to #41401401] modelhub and Trainer support 
* add trainer interface
 * add trainer script
 * add model init support for pipelineadd pipeline tutorial and fix bugs 
 * add text classification evaluation to maas lib 
 * add quickstart and prepare env doc
 * relax requirements for torch and sentencepiece
 * merge release/0.1 and fix conflict
 * modelhub support for model and pipeline

 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8868339
 2022-05-30 11:53:53 +08:00
wenmeng.zwm
cb416edc2a [to #41669377] add pipeline tutorial and fix bugs 
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8810524
 2022-05-24 17:14:58 +08:00
Yingda Chen
3cbdcb1d3e fix typo 2022-05-20 06:24:18 +08:00
wenmeng.zwm
5e469008fd [to #41401401] add preprocessor, model and pipeline 
* add preprocessor module
 * add model base and builder
 * update task constant
 * add load image preprocessor and its dependency
 * add pipeline interface and UT covered
 * support default pipeline for task
 * add image matting pipeline
 * refine nlp tokenize interface
 * add nlp pipeline 
 * fix UT failed
 * add test for Compose

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8769235

* add preprocessor module

* add test for Compose

* fix citest error

* fix abs class error

* add model base and builder

* update task constant

* add load image preprocessor and its dependency

* add pipeline interface and UT covered

* support default pipeline for task

* refine models and pipeline interface

* add pipeline folder structure

* add image matting pipeline

* refine nlp tokenize interface

* add nlp pipeline 

1.add preprossor model pipeline for nlp text classification
2. add corresponding test

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8757371

* new nlp pipeline

* format pre-commit code

* update easynlp pipeline

* update model_name for easynlp pipeline; add test for maas_lib/utils/typeassert.py

* update test_typeassert.py

* refactor code

1. rename typeassert to type_assert
2. use lazy import to make easynlp dependency optional
3. refine image matting UT

* fix linter test failed

* update requirements.txt

* fix UT failed

* fix citest script to update requirements
 2022-05-19 22:18:35 +08:00
wenmeng.zwm
0a756f6a0d [to #41402703] add basic modules 
* add constant
 * add logger module
 * add registry and builder module
 * add fileio module
 * add requirements and setup.cfg
 * add config module and tests
 * add citest script

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8718998
 2022-05-17 10:15:00 +08:00