zhangzhicheng.zzc
d721fabb34
[to #42322933 ]bert with sequence classification / token classification/ fill mask refactor
...
1.新增支持原始bert模型（非easynlp的 backbone prefix版本）
2.支持bert的在sequence classification/fill mask /token classification上的backbone head形式
3.统一了sequence classification几个任务的pipeline到一个类
4.fill mask 支持backbone head形式
5.token classification的几个子任务（ner，word seg， part of speech）的preprocessor 统一到了一起TokenClassificationPreprocessor
6. sequence classification的几个子任务（single classification， pair classification）的preprocessor 统一到了一起SequenceClassificationPreprocessor
7. 改动register中 cls的group_key 赋值位置，之前的group_key在多个decorators的情况下，会被覆盖，obj_cls的group_key信息不正确
8. 基于backbone head形式将 原本group_key和 module同名的情况尝试做调整，如下在modelscope/pipelines/nlp/sequence_classification_pipeline.py 中
原本
@PIPELINES.register_module(
Tasks.sentiment_classification, module_name=Pipelines.sentiment_classification)
改成
@PIPELINES.register_module(
Tasks.text_classification, module_name=Pipelines.sentiment_classification)
相应的configuration.json也有改动，这样的改动更符合任务和pipline（子任务）的关系。
8. 其他相应改动为支持上述功能
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10041463
2022-09-27 23:08:33 +08:00
wenmeng.zwm
e85b27107e
[to #44236829 ] import nlp preprocessor to make UT run successfully while igoring ast scanning error
2022-08-19 10:24:21 +08:00
jiangnana.jnn
76482cc3ea
[to #43850241 ] fix processor and collate_fn
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9644184
* fix ditributed training and eval
2022-08-16 12:04:07 +08:00
wenmeng.zwm
d55525bfb6
[to #43112771 ] requirements check and lazy import support
2022-07-27 17:29:16 +08:00
jiaqi.sjq
d313c440c4
[to #9303837 ] Merge frontend am and vocoder into one model card
...
Merge frontend, am and vocoder model card into one model card.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9303837
2022-07-08 14:26:18 +08:00
yingda.chen
1a0d4af55a
[to #42322933 ] test level check
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9143809
2022-06-23 16:55:48 +08:00
wenmeng.zwm
e288cf076e
[to #42362853 ] refactor pipeline and standardize module_name
...
* using get_model to validate hub path
* support reading pipeline info from configuration file
* add metainfo const
* update model type and pipeline type and fix UT
* relax requimrent for protobuf
* skip two dataset tests due to temporal failure
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9118154
2022-06-22 14:15:32 +08:00
jiaqi.sjq
b1490bfd7f
[to #9061073 ] feat: merge tts to master
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9061073
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9061073
* [to #41669377 ] docs and tools refinement and release
1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
* [to #41669377 ] add pipeline tutorial and fix bugs
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301
* refine doc
* refine doc
* merge remote release/0.1 and fix conflict
* Merge branch 'release/0.1' into 'nls/tts'
Release/0.1
See merge request !1700968
* [Add] add tts preprocessor without requirements. finish requirements build later
* [Add] add requirements and frd submodule
* [Fix] remove models submodule
* [Add] add am module
* [Update] update am and vocoder
* [Update] remove submodule
* [Update] add models
* [Fix] fix init error
* [Fix] fix bugs with tts pipeline
* merge master
* [Update] merge from master
* remove frd subdmoule and using wheel from oss
* change scripts
* [Fix] fix bugs in am and vocoder
* [Merge] merge from master
* Merge branch 'master' into nls/tts
* [Fix] fix bugs
* [Fix] fix pep8
* Merge branch 'master' into nls/tts
* [Update] remove hparams and import configuration from kwargs
* Merge branch 'master' into nls/tts
* upgrade tf113 to tf115
* Merge branch 'nls/tts' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into nls/tts
* add multiple versions of ttsfrd
* merge master
* [Fix] fix cr comments
* Merge branch 'master' into nls/tts
* [Fix] fix cr comments 0617
* Merge branch 'master' into nls/tts
* [Fix] remove comment out codes
* [Merge] merge from master
* [Fix] fix crash for incompatible tf and pytorch version, and frd using zip file resource
* Merge branch 'master' into nls/tts
* [Add] add cuda support
2022-06-20 17:23:11 +08:00
wenmeng.zwm
201922d33d
[to #42461396 ] add git-lfs support and mv test data to git-lfs
2022-06-17 19:33:15 +08:00
wenmeng.zwm
b4fc38e1b9
[to #42461396 ] add Pillow version constraint and update hub version
...
1. use Pillow >= 6.2.0
2. change skip test msg for image caption
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9041194
2022-06-15 11:43:52 +08:00
wenmeng.zwm
1f6b376599
[to #42373878 ] refactor maaslib to modelscope
...
1. refactor maaslib to modelscope
2. fix UT error
3. support pipeline which does not register default model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8988388
2022-06-09 20:16:26 +08:00
wenmeng.zwm
5e469008fd
[to #41401401 ] add preprocessor, model and pipeline
...
* add preprocessor module
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
* fix UT failed
* add test for Compose
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8769235
* add preprocessor module
* add test for Compose
* fix citest error
* fix abs class error
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* refine models and pipeline interface
* add pipeline folder structure
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
1.add preprossor model pipeline for nlp text classification
2. add corresponding test
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8757371
* new nlp pipeline
* format pre-commit code
* update easynlp pipeline
* update model_name for easynlp pipeline; add test for maas_lib/utils/typeassert.py
* update test_typeassert.py
* refactor code
1. rename typeassert to type_assert
2. use lazy import to make easynlp dependency optional
3. refine image matting UT
* fix linter test failed
* update requirements.txt
* fix UT failed
* fix citest script to update requirements
2022-05-19 22:18:35 +08:00
