Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-20 01:59:23 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,825 Commits 263 Branches 106 Tags
fix/patch_dynamic_module
Commit Graph

39 Commits

Author SHA1 Message Date
xingjun.wang
48c0d2a9af add 1.6 2023-05-22 10:53:18 +08:00
Yingda Chen
e0ef60ca9b [to #42322933] skip demo test by default 2022-09-09 14:56:33 +08:00
lingcai.wl
7a49fa1cc6 [to #44657982] add unittest for demo and demotest utils 
unittest for demo service
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10006180
 2022-09-08 14:08:51 +08:00
yingda.chen
04bb8061e6 [to #42322933]move postprocess helper into utilities 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9856286
 2022-08-23 14:27:19 +08:00
Yingda Chen
63233c2122 Revert "[to #42322933]move postprocess helper into utilities" 
This reverts commit 4cc0395ac5.
 2022-08-23 12:13:15 +08:00
Yingda Chen
4cc0395ac5 [to #42322933]move postprocess helper into utilities 2022-08-23 12:11:49 +08:00
Yingda Chen
b854303c25 [to #42322933] fix typo 2022-08-04 14:59:14 +08:00
wenmeng.zwm
7798a6250a [to #43112692] stardarized task name and output 
1. task name and output definition: [link](https://alidocs.dingtalk.com/i/nodes/KOEmgBoGwD78vd2bAry3VndLerP9b30a?nav=spaces&navQuery=spaceId%3Dnb9XJNlZxbgrOXyA&iframeQuery=utm_source%3Dportal%26utm_medium%3Dportal_space_file_tree)

2. rearrange task definition and add more outputs definition for tasks

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9585469
 2022-08-02 20:21:05 +08:00
wenmeng.zwm
b3f4ac8acc [to #43115042] add trainer usage doc 
1. add trainer doc
2. support local configuration file for trainer
3. update nlp trainer test

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9541239
 2022-07-29 10:28:50 +08:00
feiwu.yfw
2c3875c0e1 [to #43299989] Fix msdataset 
* fix msdataset
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9436292

    * fix msdataset
 2022-07-20 16:38:15 +08:00
wenmeng.zwm
231f400133 [to #43112534] finetune support and first case 
co-contributed with 夕陌&雨泓

 * add torch epoch based trainer and dis utils
 * add hooks including optimizer, lrscheduler, logging, checkpoint, evaluation, time profiling
 * add torch mdoel base and test
 * add optimizer and lrscheduler module
 * add sbert for text classification example
 * add task_dataset for dataset-level processor

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9338412
 2022-07-14 16:25:55 +08:00
yingda.chen
2e88a995ca [to #42322933]support model revision 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9300163
 2022-07-07 23:00:14 +08:00
yingda.chen
0260b89431 [to #42322933] unified output keys 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9240440
 2022-07-01 18:29:34 +08:00
feiwu.yfw
5da470fd5d [to #42791465, #42779255, #42777959, #42757844, #42756050, #42746916, #42743595, #42791863] fix: fix msdataset 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9174075

* fix msdataset
 2022-06-28 20:40:57 +08:00
yingda.chen
6702b29e21 [to #42794773]rename pydataset to msdataset 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9165402
 2022-06-27 11:09:38 +08:00
Yingda Chen
b6e3fd80b0 Revert "[to #42794773] rename pydataset to msdataset" 
This reverts commit c8e2e6de0e.
 2022-06-25 08:50:28 +08:00
Yingda Chen
c8e2e6de0e [to #42794773] rename pydataset to msdataset 2022-06-25 08:36:48 +08:00
yingda.chen
e7571a566f [to #42322933] skip dataset test for now 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9155405
 2022-06-24 11:47:28 +08:00
yingda.chen
1a0d4af55a [to #42322933] test level check 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9143809
 2022-06-23 16:55:48 +08:00
feiwu.yfw
b8ba35bd27 [to #42670107] restore pydataset test 
* pydataset unitest
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9132896
 2022-06-22 22:01:25 +08:00
wenmeng.zwm
e288cf076e [to #42362853] refactor pipeline and standardize module_name 
* using get_model to validate hub path 
* support reading pipeline info from configuration file
* add metainfo const
* update model type and pipeline type and fix UT
* relax requimrent for protobuf
* skip two dataset tests due to temporal failure
 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9118154
 2022-06-22 14:15:32 +08:00
mulin.lyh
76c6ff6329 [to #42675838]merge model hub code 
合并model hub 代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9096493
 2022-06-21 20:04:25 +08:00
feiwu.yfw
c7238a470b [to #42670107]pydataset fetch data from datahub 
* pydataset fetch data from datahub
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9060856
 2022-06-21 11:10:28 +08:00
wenmeng.zwm
201922d33d [to #42461396] add git-lfs support and mv test data to git-lfs 2022-06-17 19:33:15 +08:00
yingda.chen
ad8e080e37 [to #42322933] refactor model name 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9068994
 2022-06-17 10:25:54 +08:00
wenmeng.zwm
c59833c7ee [to #42461396] feat: test_level support 
* add test level support
* update develop doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9021354
 2022-06-15 14:53:49 +08:00
yingda.chen
5786b9a0a1 [to #42322933]formalize image matting 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9019685
 2022-06-15 14:06:53 +08:00
wenmeng.zwm
3a78e32eb2 Revert "[to #42322933]formalize image matting" 
This reverts commit de3ea0db54.
 2022-06-13 18:30:29 +08:00
Yingda Chen
de3ea0db54 [to #42322933]formalize image matting 2022-06-13 15:19:30 +08:00
wenmeng.zwm
1f6b376599 [to #42373878] refactor maaslib to modelscope 
1.  refactor maaslib to modelscope
2.  fix UT error
3.  support pipeline which does not register default model

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8988388
 2022-06-09 20:16:26 +08:00
wenmeng.zwm
dd00195814 [to #42362853] add default model support and fix circular import 
1. add default model support
2. fix circular import
3. temporarily skip ofa and palm test which costs too much time

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8981076
 2022-06-09 16:57:33 +08:00
yingda.chen
0d840d519c [to #42339763] move pydataset into maas_lib 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8974892
 2022-06-09 10:14:48 +08:00
yingda.chen
e3b8ec3bf1 [to #42339559] support multiple models 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8972440

    * [to #42339559] support multiple models
 2022-06-08 21:27:14 +08:00
feiwu.yfw
235880f300 [to #42339763] merge pydataset into maas-lib 
* merge pydataset to the repo
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8955999
 2022-06-08 18:29:39 +08:00
yingda.chen
d6868ddffe [to #42323743] retain local cached model files by default 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8963687
 2022-06-08 14:22:23 +08:00
yingda.chen
f8eb699f7f refine tests and examples 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8898823
 2022-06-01 10:20:53 +08:00
yingda.chen
5995cc4607 add PyDataset support 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8868644
 2022-05-31 18:27:19 +08:00
wenmeng.zwm
25a2028b54 [to #41401401] modelhub and Trainer support 
* add trainer interface
 * add trainer script
 * add model init support for pipelineadd pipeline tutorial and fix bugs 
 * add text classification evaluation to maas lib 
 * add quickstart and prepare env doc
 * relax requirements for torch and sentencepiece
 * merge release/0.1 and fix conflict
 * modelhub support for model and pipeline

 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8868339
 2022-05-30 11:53:53 +08:00
wenmeng.zwm
5e469008fd [to #41401401] add preprocessor, model and pipeline 
* add preprocessor module
 * add model base and builder
 * update task constant
 * add load image preprocessor and its dependency
 * add pipeline interface and UT covered
 * support default pipeline for task
 * add image matting pipeline
 * refine nlp tokenize interface
 * add nlp pipeline 
 * fix UT failed
 * add test for Compose

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8769235

* add preprocessor module

* add test for Compose

* fix citest error

* fix abs class error

* add model base and builder

* update task constant

* add load image preprocessor and its dependency

* add pipeline interface and UT covered

* support default pipeline for task

* refine models and pipeline interface

* add pipeline folder structure

* add image matting pipeline

* refine nlp tokenize interface

* add nlp pipeline 

1.add preprossor model pipeline for nlp text classification
2. add corresponding test

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8757371

* new nlp pipeline

* format pre-commit code

* update easynlp pipeline

* update model_name for easynlp pipeline; add test for maas_lib/utils/typeassert.py

* update test_typeassert.py

* refactor code

1. rename typeassert to type_assert
2. use lazy import to make easynlp dependency optional
3. refine image matting UT

* fix linter test failed

* update requirements.txt

* fix UT failed

* fix citest script to update requirements
 2022-05-19 22:18:35 +08:00