liuyhwangyh
672c32e7bd
fix ci compatible issues，fix llmpipeline lazy import issue ( #725 )
...
* fix ci issue
* fix case issue
* modify lint to python3.10
* fix case issue
---------
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com >
2024-01-17 22:19:05 +08:00
Firmament-cyou
a3ae55577f
Support swift in llm_pipeline. ( #595 )
...
* support swift in llm_pipeline
* adjust function name
2023-10-24 14:31:24 +08:00
wenmeng zhou
74d8317bb0
fix pipeline check error ( #455 )
...
* fix pipeline check error
* update
2023-08-11 15:52:53 +08:00
Li Tong
626b60e8c2
fix issue: Batch and single are not uniform #215 ( #258 )
...
* fix issue: Batch and single are not uniform #215 , https://github.com/modelscope/modelscope/issues/215
* remove extra code
* fix bug
* update test
---------
Co-authored-by: ezeli.lt <ezeli.lt@alibaba-inc.com >
Co-authored-by: hemu <hemu.zp@alibaba-inc.com >
2023-05-10 10:49:54 +08:00
mulin.lyh
62f769877f
[to #48291018 ]fix: fix data releate case failed bug
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11925637
2023-03-09 15:18:50 +08:00
wenmeng.zwm
82f10f73aa
[to #42322933 ] fix: pipeline base potential bug
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11645650
* test batched inference and no auto collate logic
2023-02-13 13:49:42 +00:00
wenmeng.zwm
a1688f5775
enhance interface standard and refactor card_detection and face detection pipeline
...
1. build preprocessor for pipeline automatically if preprocessor is configed in configuration.json
2. refactor scrfd_detect.py as a standard cv model code
3. refacotr card_detection_pipeline face_detection_pipeline as standard pipeline code
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11057557
2022-12-15 14:31:50 +08:00
yingda.chen
45620dbc7f
[to #42322933 ]clean up test level
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9662182
* clean up test level
2022-08-06 12:22:17 +08:00
wenmeng.zwm
d55525bfb6
[to #43112771 ] requirements check and lazy import support
2022-07-27 17:29:16 +08:00
wenmeng.zwm
231f400133
[to #43112534 ] finetune support and first case
...
co-contributed with 夕陌&雨泓
* add torch epoch based trainer and dis utils
* add hooks including optimizer, lrscheduler, logging, checkpoint, evaluation, time profiling
* add torch mdoel base and test
* add optimizer and lrscheduler module
* add sbert for text classification example
* add task_dataset for dataset-level processor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9338412
2022-07-14 16:25:55 +08:00
yingda.chen
a60d675d25
[to #42322933 ]formalize test data storage
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9251871
2022-07-04 12:11:12 +08:00
yingda.chen
0260b89431
[to #42322933 ] unified output keys
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9240440
2022-07-01 18:29:34 +08:00
wenmeng.zwm
bb57020daa
[to #42362425 ] remove add module to default group
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9229852
2022-07-01 17:27:55 +08:00
wenmeng.zwm
201922d33d
[to #42461396 ] add git-lfs support and mv test data to git-lfs
2022-06-17 19:33:15 +08:00
wenmeng.zwm
4f7928bb6e
[to #42362853 ] formalize the output of pipeline and make pipeline reusable
...
* format pipeline output and check it
* fix UT
* add docstr to clarify the difference between model.postprocess and pipeline.postprocess
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9051405
2022-06-16 11:15:09 +08:00
wenmeng.zwm
1f6b376599
[to #42373878 ] refactor maaslib to modelscope
...
1. refactor maaslib to modelscope
2. fix UT error
3. support pipeline which does not register default model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8988388
2022-06-09 20:16:26 +08:00
wenmeng.zwm
dd00195814
[to #42362853 ] add default model support and fix circular import
...
1. add default model support
2. fix circular import
3. temporarily skip ofa and palm test which costs too much time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8981076
2022-06-09 16:57:33 +08:00
wenmeng.zwm
5e469008fd
[to #41401401 ] add preprocessor, model and pipeline
...
* add preprocessor module
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
* fix UT failed
* add test for Compose
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8769235
* add preprocessor module
* add test for Compose
* fix citest error
* fix abs class error
* add model base and builder
* update task constant
* add load image preprocessor and its dependency
* add pipeline interface and UT covered
* support default pipeline for task
* refine models and pipeline interface
* add pipeline folder structure
* add image matting pipeline
* refine nlp tokenize interface
* add nlp pipeline
1.add preprossor model pipeline for nlp text classification
2. add corresponding test
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8757371
* new nlp pipeline
* format pre-commit code
* update easynlp pipeline
* update model_name for easynlp pipeline; add test for maas_lib/utils/typeassert.py
* update test_typeassert.py
* refactor code
1. rename typeassert to type_assert
2. use lazy import to make easynlp dependency optional
3. refine image matting UT
* fix linter test failed
* update requirements.txt
* fix UT failed
* fix citest script to update requirements
2022-05-19 22:18:35 +08:00
