Commit Graph

2526 Commits

Author SHA1 Message Date
wenmeng zhou
71ed5e7598 Merge pull request #667 from modelscope/master-merge-internal20231208
Master merge internal20231208
2023-12-18 19:38:14 +08:00
slin000111
262e0d6df0 fix embedding and inference device in faq question answering pipeline 2023-12-12 19:54:02 +08:00
mulin.lyh
b16e24440e build whl with py310 2023-12-08 22:25:28 +08:00
mulin.lyh
86fcbb8fbf Merge branch 'master-gitlab' into master-merge-internal20231208 2023-12-08 21:24:27 +08:00
mulin.lyh
75ce66f824 fix exception when there is a version after sdk release
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14949463
* fix exception when there is a version after sdk release
2023-12-08 14:16:37 +08:00
xingjun.wxj
2a991a5c6b update datasets version
Update datasets version.
compatibility check: 2.14.5, 2.14.6, 2.15.0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14916111
2023-12-06 16:25:20 +08:00
Firmament-cyou
8f0f9d4a33 Register llm format map (#659)
* add LLMAdapterRegistry

* fix bug

* replace traceback with cache
2023-12-06 16:22:50 +08:00
suluyana
b21afc3424 set vllm backend default when build llm_pipeline from pipeline() (#662)
* set vllm backend default when build llm_pipeline from pipeline()

* fix logger info

---------

Co-authored-by: suluyan.sly <suluyan.sly@alibaba-inc.com>
2023-12-06 10:27:36 +08:00
suluyana
864fb48872 fix vllm gen cfg & set default to llm-ppl (#658)
* fix vllm gen cfg & set default to llm-ppl

* fix code style

* reset llm_framework default value

* fix pre-commit

---------

Co-authored-by: suluyan.sly <suluyan.sly@alibaba-inc.com>
2023-12-04 16:51:35 +08:00
xingjun.wxj
a8e9e0a48f set datasets==2.14.6 2023-12-01 17:33:07 +08:00
tastelikefeet
05e1069219 Fix _set_gradient_checkpointing bug (#660)
* add logic
2023-12-01 15:29:28 +08:00
liuyhwangyh
a28f7aa96c fix test reliability issue (#657)
* fix test reliability issue

* fix lint issue
2023-12-01 15:14:35 +08:00
mushenL
1b6723ea24 hf_tool add AutoImageProcessor and BatchFeature (#650)
* add AutoImageProcessor and BatchFeature
2023-12-01 15:14:06 +08:00
wenmeng zhou
7b80a87b5a fix: DocumentGroundedDialogRetrievalModel qry_encoder.encoder.embeddings.position_ids error (#647) 2023-12-01 15:12:31 +08:00
mulin.lyh
51a1b76e91 fix python3.10 compatible issue
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14678226
* modify librosa version

* fix python3.10 compatible issue

* remove healpy in requirements for windowns compatible
2023-11-29 17:41:44 +08:00
mulin.lyh
fe8bfa9219 when build force install funasr pai-eacv etc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14812168
* when build force install funasr pai-eacv etc
2023-11-29 17:40:09 +08:00
mulin.lyh
6c7fca8307 支持modelscope直接拉起推理服务
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14702876

* add inference server code

* add server requirement

* fix import issue

* debug

* add command line

* add llmpipeline support

* modify port to int

* add serer usage

* remove unused code

* fix lint issue

* add inference server code

* upgrade env to VLLM_USE_MODELSCOPE
2023-11-29 17:37:56 +08:00
chenyafeng.cyf
ae42543389 fix_gpu_bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14822269
2023-11-29 10:03:52 +08:00
biwen.lbw
a19fe73afb fix numpy bug
修复numpy版本导致的bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14816762
* fix numpy bug
2023-11-28 17:17:29 +08:00
mulin.lyh
5ba9fd2307 modify auto gptq and vllm env
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14790283
* upgrade to python3.10

* modify auto gptq and vllm env

* fix lint issue

* Merge remote-tracking branch 'origin/master' into python10_support

* python310 support

* build from repo

* add commit id force install modelscope every build

* add commit id force install modelscope every build

* fix cpu build issue

* fix datahub error message

* Merge branch 'python10_support' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into python10_support

* add --no-cache-dir install auto_gptq
2023-11-27 20:21:00 +08:00
mulin.lyh
b8e86060f5 numpy version unrestrict
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13398805
* numpy version unrestrict
2023-11-27 13:56:33 +08:00
xingjun.wxj
6833bdabfc set datasets==2.14.6
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14593950
2023-11-17 10:46:58 +08:00
wenmeng zhou
d9b76330fe fix logger: remove file handler for original user logging (#645) 2023-11-15 19:31:42 +08:00
wenmeng zhou
5b67c02cef Feat/llmriddle update (#640)
* format chatglm output

* format code and add one problem to llm riddle

* fix app warning

* refine app.py and add test fn for validate fn
2023-11-13 23:29:25 +08:00
Yorick He
a831e3a85c add 5 problems (#638)
---------

Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
Co-authored-by: YorickHe <yongyi.hyy@alibaba-inc.com>
2023-11-13 21:11:54 +08:00
tastelikefeet
69d784f26d Support transformers==4.35.0 (#633)
* fix _set_gradient_checkpointing
2023-11-13 20:41:10 +08:00
wenmeng zhou
2d387e6a2a Update README_zh.md (#614) 2023-11-13 19:55:30 +08:00
wenmeng zhou
1b46d52b23 Update README.md (#615) 2023-11-13 19:55:21 +08:00
wenmeng zhou
0eb3c7a452 Update README.md 2023-11-13 19:54:45 +08:00
wenmeng zhou
6b8f0ac5b8 add chatglm support for llm-riddle (#634)
* add chatglm-turbo 

* update readme

* format code
2023-11-10 19:23:21 +08:00
Yorick He
b3e8fd0609 add 3 problems to llm-riddle and fix some bugs (#632)
* add 3 problems


---------

Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
Co-authored-by: YorickHe <yongyi.hyy@alibaba-inc.com>
2023-11-10 17:47:56 +08:00
wenmeng zhou
0e9f21decf update riddles (#631)
* fix challenges

* add share function

* update readme
2023-11-10 12:24:49 +08:00
wenmeng zhou
c2e900ee54 update llm riddles (#624)
* add multi online support

* add readme and requirements.txt

* refactor code to llm and challenges and update readme

* handle llm exception and return empty str

* update error handling

* fix gradio version and add concurrency control

* remove concurrency_limit

* update reame
2023-11-09 20:04:16 +08:00
zhifu gao
29b7f16339 Merge pull request #627 from Lizerui9926/master
Fix asr paraformer finetune bug
2023-11-09 12:41:17 +08:00
Lizerui9926
9324fb4422 Merge branch 'master' into master 2023-11-09 11:13:45 +08:00
北念
c0b36f0e91 fix asr paraformer finetune bug 2023-11-09 11:10:21 +08:00
myf272609
00eb4219a0 [to #42322933] fix issues for 3dhuman models
- 角色驱动:添加自定义blender路径支持;移除模型位置标准化
- 角色渲染:添加自定义渲染分辨率支持;添加模型位置标准化
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14459360
* fix some issues

* fix
2023-11-08 21:11:21 +08:00
suluyan.sly
ea324b4841 feat: deploy checker for swingdeploy
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14575909
* feat: deploy checker for swingdeploy

* fix: configuration.json mismatch the revision.
2023-11-08 16:10:02 +08:00
wenmeng zhou
069b271436 Update README_CN.md 2023-11-08 12:19:53 +08:00
wenmeng zhou
02ce95d5b8 add llm riddles (#621)
* add multi online support

* add readme and requirements.txt
2023-11-08 00:51:10 +08:00
Firmament-cyou
fafb0fe013 llm pipeline support chatglm3 (#618) 2023-11-04 20:44:55 +08:00
tastelikefeet
5f0fcd7bfd fix uie trainer: eval failed (#617)
* fix uie trainer

* merge master
2023-11-04 12:11:13 +08:00
wenmeng zhou
f7238b3515 Merge pull request #609 from modelscope/merge_master_gitlab_1026
Merge master gitlab 1026
2023-11-03 12:11:41 +08:00
zhifu gao
cfba0b0b7e Merge pull request #613 from Lizerui9926/master
add bpemodel path in asr_trainer to support paraformer-16k-en finetune
2023-11-02 16:07:01 +08:00
北念
60155a0f7b add bpemodel path in asr_trainer 2023-11-02 15:56:40 +08:00
tastelikefeet
eff11817a0 Fix vllm: change if condition (#607) 2023-10-30 19:25:24 +08:00
wenmeng.zwm
4fd55ffccc Merge branch 'master' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into master-gitlab 2023-10-30 19:18:01 +08:00
wenmeng.zwm
a874fa5f7d Merge branch 'master-gitlab' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into master-gitlab 2023-10-30 19:17:11 +08:00
tastelikefeet
cb0a44eda5 Support VLLM in LLMPipeline (#604) 2023-10-27 18:20:53 +08:00
rujiao.lrj
acc61da91c Fix the numpy bug for card correction
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14461396
* fix the numpy bug for card detection correction

* add output(score, angle, print type)
2023-10-27 16:51:50 +08:00