1699 Commits

Author SHA1 Message Date
ly119399
9720d46650 update version 2024-01-04 20:01:59 +08:00
ly119399
ec07a9919a fix flake8 2024-01-03 00:05:04 +08:00
ly119399
19cb79ae6c Merge branch 'master-github' into master-merge-github231228 2023-12-28 19:15:06 +08:00
mulin.lyh
385486daf2 upgrade cuda to 12.1.0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/15183132
* upgrade cuda to 12.1.0

* remove tb-nightly, remove dup compile megatron util

* uninstall tb-nightly reinstall tensorboard
2023-12-28 17:47:58 +08:00
wenmeng.zwm
39562dc555 merge master 2023-12-27 00:08:20 +08:00
Firmament-cyou
1120b76ea4 Fix anydoor init and support url input (#698)
* fix init

* fix bug
2023-12-27 00:06:30 +08:00
wenmeng zhou
1839bfbd64 add __init__.py for anydorr 2023-12-26 22:18:46 +08:00
wenmeng zhou
212a70dea7 add __init__.py for anydoor 2023-12-26 21:49:31 +08:00
neo.dzh
e7f86a751e add audio codec and codec-based TTS model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/15128959
2023-12-26 20:54:59 +08:00
Firmament-cyou
b473decba0 update ckpt to general_v0.1 (#696) 2023-12-26 16:59:47 +08:00
Firmament-cyou
b3c6eebdf3 Add AnyDoor support (#688)
* support anydoor

* add dinov2

* fix bug

* convert rgb

* update anydoor_pipeline and add docstr
2023-12-25 19:01:50 +08:00
hitsz-zuoqi
2ef12d1e88 add syncdreamer as a image-to-3d pipeline (#679)
* add syncdreamer

* delete demo_output

* remove useless files and hide clip install

* update pipeline

* update clip package

* update unitest
2023-12-21 22:12:32 +08:00
wenmeng zhou
c12323572a Merge pull request #676 from slin000111/master
fix embedding and inference device in faq question answering pipeline
2023-12-19 21:44:43 +08:00
slin000111
262e0d6df0 fix embedding and inference device in faq question answering pipeline 2023-12-12 19:54:02 +08:00
mulin.lyh
86fcbb8fbf Merge branch 'master-gitlab' into master-merge-internal20231208 2023-12-08 21:24:27 +08:00
mulin.lyh
75ce66f824 fix exception when there is a version after sdk release
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14949463
* fix exception when there is a version after sdk release
2023-12-08 14:16:37 +08:00
Firmament-cyou
8f0f9d4a33 Register llm format map (#659)
* add LLMAdapterRegistry

* fix bug

* replace traceback with cache
2023-12-06 16:22:50 +08:00
suluyana
b21afc3424 set vllm backend default when build llm_pipeline from pipeline() (#662)
* set vllm backend default when build llm_pipeline from pipeline()

* fix logger info

---------

Co-authored-by: suluyan.sly <suluyan.sly@alibaba-inc.com>
2023-12-06 10:27:36 +08:00
suluyana
864fb48872 fix vllm gen cfg & set default to llm-ppl (#658)
* fix vllm gen cfg & set default to llm-ppl

* fix code style

* reset llm_framework default value

* fix pre-commit

---------

Co-authored-by: suluyan.sly <suluyan.sly@alibaba-inc.com>
2023-12-04 16:51:35 +08:00
tastelikefeet
05e1069219 Fix _set_gradient_checkpointing bug (#660)
* add logic
2023-12-01 15:29:28 +08:00
liuyhwangyh
a28f7aa96c fix test reliability issue (#657)
* fix test reliability issue

* fix lint issue
2023-12-01 15:14:35 +08:00
mushenL
1b6723ea24 hf_tool add AutoImageProcessor and BatchFeature (#650)
* add AutoImageProcessor and BatchFeature
2023-12-01 15:14:06 +08:00
wenmeng zhou
7b80a87b5a fix: DocumentGroundedDialogRetrievalModel qry_encoder.encoder.embeddings.position_ids error (#647) 2023-12-01 15:12:31 +08:00
mulin.lyh
51a1b76e91 fix python3.10 compatible issue
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14678226
* modify librosa version

* fix python3.10 compatible issue

* remove healpy in requirements for windowns compatible
2023-11-29 17:41:44 +08:00
mulin.lyh
fe8bfa9219 when build force install funasr pai-eacv etc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14812168
* when build force install funasr pai-eacv etc
2023-11-29 17:40:09 +08:00
mulin.lyh
6c7fca8307 支持modelscope直接拉起推理服务
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14702876

* add inference server code

* add server requirement

* fix import issue

* debug

* add command line

* add llmpipeline support

* modify port to int

* add serer usage

* remove unused code

* fix lint issue

* add inference server code

* upgrade env to VLLM_USE_MODELSCOPE
2023-11-29 17:37:56 +08:00
chenyafeng.cyf
ae42543389 fix_gpu_bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14822269
2023-11-29 10:03:52 +08:00
biwen.lbw
a19fe73afb fix numpy bug
修复numpy版本导致的bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14816762
* fix numpy bug
2023-11-28 17:17:29 +08:00
mulin.lyh
5ba9fd2307 modify auto gptq and vllm env
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14790283
* upgrade to python3.10

* modify auto gptq and vllm env

* fix lint issue

* Merge remote-tracking branch 'origin/master' into python10_support

* python310 support

* build from repo

* add commit id force install modelscope every build

* add commit id force install modelscope every build

* fix cpu build issue

* fix datahub error message

* Merge branch 'python10_support' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into python10_support

* add --no-cache-dir install auto_gptq
2023-11-27 20:21:00 +08:00
wenmeng zhou
d9b76330fe fix logger: remove file handler for original user logging (#645) 2023-11-15 19:31:42 +08:00
tastelikefeet
69d784f26d Support transformers==4.35.0 (#633)
* fix _set_gradient_checkpointing
2023-11-13 20:41:10 +08:00
Lizerui9926
9324fb4422 Merge branch 'master' into master 2023-11-09 11:13:45 +08:00
北念
c0b36f0e91 fix asr paraformer finetune bug 2023-11-09 11:10:21 +08:00
myf272609
00eb4219a0 [to #42322933] fix issues for 3dhuman models
- 角色驱动:添加自定义blender路径支持;移除模型位置标准化
- 角色渲染:添加自定义渲染分辨率支持;添加模型位置标准化
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14459360
* fix some issues

* fix
2023-11-08 21:11:21 +08:00
suluyan.sly
ea324b4841 feat: deploy checker for swingdeploy
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14575909
* feat: deploy checker for swingdeploy

* fix: configuration.json mismatch the revision.
2023-11-08 16:10:02 +08:00
Firmament-cyou
fafb0fe013 llm pipeline support chatglm3 (#618) 2023-11-04 20:44:55 +08:00
tastelikefeet
5f0fcd7bfd fix uie trainer: eval failed (#617)
* fix uie trainer

* merge master
2023-11-04 12:11:13 +08:00
wenmeng zhou
f7238b3515 Merge pull request #609 from modelscope/merge_master_gitlab_1026
Merge master gitlab 1026
2023-11-03 12:11:41 +08:00
北念
60155a0f7b add bpemodel path in asr_trainer 2023-11-02 15:56:40 +08:00
tastelikefeet
eff11817a0 Fix vllm: change if condition (#607) 2023-10-30 19:25:24 +08:00
tastelikefeet
cb0a44eda5 Support VLLM in LLMPipeline (#604) 2023-10-27 18:20:53 +08:00
rujiao.lrj
acc61da91c Fix the numpy bug for card correction
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14461396
* fix the numpy bug for card detection correction

* add output(score, angle, print type)
2023-10-27 16:51:50 +08:00
wenmeng.zwm
3b4a7b48ef fix shop_segmentation to use old timm lib and bump version to 1.9.4rc2 2023-10-26 19:23:38 +08:00
wenmeng.zwm
ae00f39b44 fix shop_segmentation to use old timm lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14443535
* fix shop_segmentation to use old timm lib
2023-10-26 13:24:06 +08:00
chenyafeng.cyf
e8b34a3bcd add_eres2net_speaker_diarization
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14412468
* add_eres2net_speaker_diarization

* fix lint issue

* update code

* update pipeline
2023-10-25 20:36:36 +08:00
wenmeng.zwm
1079756205 bump version to 1.9.4 2023-10-24 20:13:05 +08:00
wenmeng.zwm
881c98d751 feat: Resolve conflict, auto committed by Code 2023-10-24 19:31:23 +08:00
zhangyanzhao.zyz
ebd6ddb530 更新sentence embedding model,支持gte,bloom sentence embedding
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14375781

* fix linter

* bloom embedding
2023-10-24 15:23:50 +08:00
huizheng.hz
0911283dde add freeU model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14307648


* support sd21, sdxl
2023-10-24 15:23:50 +08:00
mulin.lyh
d30ef8b202 fix huggingface position_ids compatible issue
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14406558
* fix compatible issues

* fix transformer compatible issue

* skip case for huggingface link issue

* fix hf autotokenlizer case

* Merge branch 'fix_ci_issue' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into fix_ci_issue
2023-10-24 15:18:55 +08:00