Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 04:29:22 +01:00
Code Issues Packages Projects Releases Wiki Activity
41 Commits 263 Branches 106 Tags
ad8e080e37ef29dae1bc54255bb267a0b3993bb2
Commit Graph

41 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yingda.chen
ad8e080e37 [to #42322933] refactor model name 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9068994
 2022-06-17 10:25:54 +08:00
wenmeng.zwm
4f7928bb6e [to #42362853] formalize the output of pipeline and make pipeline reusable 
* format pipeline output and check it
* fix UT
* add docstr to clarify the difference between model.postprocess and pipeline.postprocess

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9051405
 2022-06-16 11:15:09 +08:00
zhangzhicheng.zzc
ba471d4492 [to #42322933]sentence-similarity 
Adding the new task of sentence_similarity, in which the model is the sofa version of structbert
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9016402

    * sbert-sentence-similarity

* [to #42322933] pip8

* merge with master for file dirs  update

* add test cases

* pre-commit lint check

* remove useless file

* download models again~

* skip time consuming test case

* update for pr reviews

* merge with master

* add test level

* reset test level to env level

* [to #42322933] init

* [to #42322933] init

* adding purge logic in test

* merge with head

* change test level

* using sequence classification processor for similarity
 2022-06-15 23:35:12 +08:00
lingcai.wl
d983bdfc8e [to #42463204] support Pil.Image for image_captioning 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9049211
 2022-06-15 18:37:40 +08:00
wenmeng.zwm
c59833c7ee [to #42461396] feat: test_level support 
* add test level support
* update develop doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9021354
 2022-06-15 14:53:49 +08:00
yingda.chen
d7112be056 [to #42510875]use sphinx book theme 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9042850
 2022-06-15 14:07:57 +08:00
yingda.chen
5786b9a0a1 [to #42322933]formalize image matting 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9019685
 2022-06-15 14:06:53 +08:00
wenmeng.zwm
b4fc38e1b9 [to #42461396] add Pillow version constraint and update hub version 
1.  use Pillow >= 6.2.0
2. change skip test msg for image caption
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9041194
 2022-06-15 11:43:52 +08:00
wenmeng.zwm
67086e26f9 [to #42362932] feat: docker_support 
* add dockerfile
* uninstall opencv-python-headless
* update develop doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9020302
 2022-06-14 16:29:12 +08:00
wenmeng.zwm
8a030ead72 [to #42362853] feat: rename config to configuration and remove repeated task fileds 
1. rename maas_config to configuration
2. remove task field image and video, using cv instead

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9010802
 2022-06-13 19:44:34 +08:00
wenmeng.zwm
3a78e32eb2 Revert "[to #42322933]formalize image matting" 
This reverts commit de3ea0db54.
 2022-06-13 18:30:29 +08:00
Yingda Chen
de3ea0db54 [to #42322933]formalize image matting 2022-06-13 15:19:30 +08:00
yingda.chen
b31c86aa0e [to #42409340] add hub specifier 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9005038
 2022-06-13 14:15:54 +08:00
wenmeng.zwm
76bc51eadd [to #42362853] support multimodel in pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8997599
 2022-06-10 16:22:28 +08:00
yingda.chen
3c1ec035fd [to #42322933] refine cartoon model and add model op utitlity 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8993758
 2022-06-10 12:56:44 +08:00
wenmeng.zwm
1f6b376599 [to #42373878] refactor maaslib to modelscope 
1.  refactor maaslib to modelscope
2.  fix UT error
3.  support pipeline which does not register default model

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8988388
 2022-06-09 20:16:26 +08:00
wenmeng.zwm
dd00195814 [to #42362853] add default model support and fix circular import 
1. add default model support
2. fix circular import
3. temporarily skip ofa and palm test which costs too much time

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8981076
 2022-06-09 16:57:33 +08:00
myf272609
0f5b214ce0 [to #42322933] Add cv-person-image-cartoon-pipeline to maas lib 
mass lib 接入人像卡通化算法
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8925552

    * update

* fix style issues

* fix style issues

* fix style issues

* fix style issues

* add requirements

* fix bug

* adapt class init

* fix

* fix tf2 issue

* feat: Fix confilct, auto commit by WebIDE

* fix commit issues

* fix
 2022-06-09 15:18:38 +08:00
yingda.chen
0d840d519c [to #42339763] move pydataset into maas_lib 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8974892
 2022-06-09 10:14:48 +08:00
yingda.chen
e3b8ec3bf1 [to #42339559] support multiple models 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8972440

    * [to #42339559] support multiple models
 2022-06-08 21:27:14 +08:00
menrui.mr
68e64a90d4 [to #42322933] add image_caption_pipeline with OFA 
1. add OFA whl for image caption pipeline
2. fix a bug in pipelines/builder.py
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8930942

    * [to #41669377] docs and tools refinement and release 

1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307

* [to #41669377] add pipeline tutorial and fix bugs 

1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301

* refine doc

* refine doc

* upload ofa for caption(with source code but not whl)

* remove data in gitignore

* append uncommitted data dir in ofa

* remove ofa_dir , use ofa.whl instead.

* update BPE

* rollback changes used in debugging.

* Merge branch 'master' into ofa/image_caption

# Conflicts:
#	docs/README.md
#	docs/source/conf.py
#	docs/source/index.rst
#	docs/source/tutorials/pipeline.md
#	maas_lib/models/nlp/sequence_classification_model.py
#	maas_lib/pipelines/builder.py
#	maas_lib/version.py
#	setup.py
#	tests/pipelines/test_text_classification.py

* 1. fix a bug in pipelines/builder.py.
2. modify model_path to model in image_captioning.py.

* 1. rename test_image_captioning.py.

* format all files using pre-commit.

* add fairseq in requirements.txt

* add fairseq in requirements.txt

* change fairseq path to git repo to a whl on oss in ofa.txt.

* change module_name to 'ofa'

* Merge remote-tracking branch 'origin/master' into ofa/image_caption

# Conflicts:
#	maas_lib/pipelines/builder.py

* optim requirements for ofa / refine image_captioning.py

* uncommited change.

* feat: Fix confilct, auto commit by WebIDE
 2022-06-08 18:38:19 +08:00
feiwu.yfw
235880f300 [to #42339763] merge pydataset into maas-lib 
* merge pydataset to the repo
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8955999
 2022-06-08 18:29:39 +08:00
hemu.zp
8a76f40754 [to #42322933]Add text-generation-pipeline with Palm model. 
将 Palm 中文模型接入 MaaS，添加了文本生成 pipeline
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8934393

    * add text_generation model and pipeline

* fix bug

* fix bug

* add TextGenerator in pipeline

* fix bug

* update checkpoint and test inputs

* remove magic number..

* fix bug

* adjust code with AutoModel

* clear comments and tidy up the code

* move model.eval() into generator

* update master interface and lint code

* replace 'palm-text-generation' with 'palm'

* add text_generation model and pipeline

* fix bug

* fix bug

* add TextGenerator in pipeline

* fix bug

* fix conflict of pipeline.txt

* remove magic number..

* fix bug

* adjust code with AutoModel

* clear comments and tidy up the code

* move model.eval() into generator

* fix conflict

* replace 'palm-text-generation' with 'palm'

* fix conflict

* add test_run_modelhub

* update sofa version

* modify sofa version

* add test_run_with_model_name

* fix bug
 2022-06-08 17:11:04 +08:00
yingda.chen
d6868ddffe [to #42323743] retain local cached model files by default 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8963687
 2022-06-08 14:22:23 +08:00
yingda.chen
e075ad2245 [to #42322515]support plain pipeline for bert 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8945177

    * support plain pipeline for bert
 2022-06-08 11:29:25 +08:00
wenmeng.zwm
d395e9abc2 [to #42281043] support kwargs in pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8949062
* support kwargs in pipeline

* update develop doc with CR instruction
 2022-06-07 14:49:57 +08:00
huangjun.hj
cdacbfb476 refine pipeline doc v0.1.1 2022-06-01 11:55:14 +08:00
yingda.chen
f8eb699f7f refine tests and examples 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8898823
 2022-06-01 10:20:53 +08:00
wenmeng.zwm
1d01a78c2b fix: UT error 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8899458

    * fix: UT error
 2022-06-01 09:16:39 +08:00
yingda.chen
5995cc4607 add PyDataset support 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8868644
 2022-05-31 18:27:19 +08:00
wenmeng.zwm
c4bfd6cced [to #41999503] refine doc and requirements for linux and mac 
1. refine quick start and pipeline doc
2. remove tf pytorch easynlp from requirements
3. lazy import for torch and tensorflow
4. test successfully on linux and mac intel cpu
5. update api doc

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8882373
 2022-05-31 11:49:46 +08:00
dongjunwei.djw
0703798fc2 fix the model evaluation error 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8872484
 2022-05-31 11:44:11 +08:00
wenmeng.zwm
25a2028b54 [to #41401401] modelhub and Trainer support 
* add trainer interface
 * add trainer script
 * add model init support for pipelineadd pipeline tutorial and fix bugs 
 * add text classification evaluation to maas lib 
 * add quickstart and prepare env doc
 * relax requirements for torch and sentencepiece
 * merge release/0.1 and fix conflict
 * modelhub support for model and pipeline

 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8868339
 2022-05-30 11:53:53 +08:00
yingda.chen
043e498e01 refactor doc build and fix some typos 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8819462
 2022-05-25 12:15:38 +08:00
wenmeng.zwm
cb416edc2a [to #41669377] add pipeline tutorial and fix bugs 
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8810524
 2022-05-24 17:14:58 +08:00
wenmeng.zwm
db4a8be9c5 [to #41669377] docs and tools refinement and release 
1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
 2022-05-20 16:51:34 +08:00
Yingda Chen
3cbdcb1d3e fix typo 2022-05-20 06:24:18 +08:00
wenmeng.zwm
5e469008fd [to #41401401] add preprocessor, model and pipeline 
* add preprocessor module
 * add model base and builder
 * update task constant
 * add load image preprocessor and its dependency
 * add pipeline interface and UT covered
 * support default pipeline for task
 * add image matting pipeline
 * refine nlp tokenize interface
 * add nlp pipeline 
 * fix UT failed
 * add test for Compose

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8769235

* add preprocessor module

* add test for Compose

* fix citest error

* fix abs class error

* add model base and builder

* update task constant

* add load image preprocessor and its dependency

* add pipeline interface and UT covered

* support default pipeline for task

* refine models and pipeline interface

* add pipeline folder structure

* add image matting pipeline

* refine nlp tokenize interface

* add nlp pipeline 

1.add preprossor model pipeline for nlp text classification
2. add corresponding test

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8757371

* new nlp pipeline

* format pre-commit code

* update easynlp pipeline

* update model_name for easynlp pipeline; add test for maas_lib/utils/typeassert.py

* update test_typeassert.py

* refactor code

1. rename typeassert to type_assert
2. use lazy import to make easynlp dependency optional
3. refine image matting UT

* fix linter test failed

* update requirements.txt

* fix UT failed

* fix citest script to update requirements
 2022-05-19 22:18:35 +08:00
wenmeng.zwm
0a756f6a0d [to #41402703] add basic modules 
* add constant
 * add logger module
 * add registry and builder module
 * add fileio module
 * add requirements and setup.cfg
 * add config module and tests
 * add citest script

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8718998
 2022-05-17 10:15:00 +08:00
wenmeng.zwm
02492e2bff [to #41401401] init project 
* add license
* add folder structure

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8682838
 2022-05-12 16:05:23 +08:00
wenmeng.zwm
92d3f2cd7f initial commit 2022-05-12 15:33:28 +08:00