Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-07-11 04:50:39 +02:00
Code Issues Packages Projects Releases Wiki Activity
2,527 Commits 275 Branches 121 Tags
handle-error
Commit Graph

2527 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
shuli.cly
526e1371f5 Merge the speaker-turn-detection codes, local test finished 
# Speaker Diarization Speaker-Turn Detection CR

和Dialogue-Detection一样，本模型是Speaker Diarization（`audio/speaker diarization`，语音/说话人日志）任务下的一个子模块。

本次提交的是基于文本进行判断的模型，本地模型的初始模型基于huggingface训练的，此提交中复用了部分 `nlp/token-classification` 模型的代码。为了方便后续维护以及与nlp方面代码解耦，在model、pipeline以及preprocessor中 **单独** 创建了相应模块并重新register。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13364720
* std first commit

* local test pass for speaker-turn-detection

* update speaker-turn-detection pipeline task outputs format; update pipeline outputs; update test scripts
 2023-07-25 18:57:47 +08:00
hemu.zp
80f76ca475 Support stream output for transformers model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13271136
* support stream for transformers model

* set test_level >= 2

* support hf model and chatglm2

* remove streaming_output for chatglm2
 2023-07-25 17:41:32 +08:00
hemu.zp
ed6e139759 Support llama & lora finetune without deepspeed 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13131145
* support llama + lora without deepspeed

* feat: Fix conflict, auto commit by WebIDE
 2023-07-25 17:32:46 +08:00
mulin.lyh
fb644002fa python build in type, return directly 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13380943
* python build in type, return directly

* fix output images bug

* compatible with demo service
 2023-07-25 16:56:01 +08:00
XDUWQ
3412a074c5 precommit 2023-07-25 15:00:28 +08:00
XDUWQ
ffbf77fcf2 update 2023-07-25 14:47:45 +08:00
wenmeng zhou
7b249400d9 refine class wrapper (#409) 2023-07-25 10:13:02 +08:00
zsl01670416
1e5e363235 fix issue of using cuda device in document segmentation pipeline inference 
Fix issue of using cuda device in document segmentation pipeline inference.Time cost will be reduced when prediction is implemented.
 2023-07-25 10:01:20 +08:00
Wang Qiang
0f551d3983 Merge pull request #408 from XDUWQ/lora_rank 
Add lora_rank parameter for lora stable diffusion
 2023-07-24 22:57:06 +08:00
XDUWQ
8e157cfa15 precommit 2023-07-24 22:10:52 +08:00
wenmeng zhou
64203e89ee Compatibility for huggingface transformers (#391) 2023-07-24 20:53:27 +08:00
XDUWQ
8e00d85317 fix bugs 2023-07-24 19:46:22 +08:00
XDUWQ
426f55d57b add lora_rank for lora stable diffusion 2023-07-24 19:43:20 +08:00
XDUWQ
bc93e2dc96 add lora_rank for lora stable diffusion 2023-07-24 19:32:04 +08:00
XDUWQ
eb24e23d19 add lora_rank for lora stable diffusion 2023-07-24 19:24:52 +08:00
XDUWQ
6fb340e7f8 add lora_rank for lora stable diffusion 2023-07-24 19:17:49 +08:00
Jintao
ba4b9fc43f Added full parameter sft to llm (#402) 
* Optimized code

* update parse_args

* fix get_logger bug

* update parse_args

* Added full parameter fine-tuning

* Add support_bf16 warning

* Modify the code format and fix bugs
 2023-07-24 15:52:09 +08:00
lylalala
f805d86aed llama2 support chat (#404) 
* support chat

* update llama2 chat testcase

* add gen kwargs and devices

* update unittest and support max_length in multi-turn dialogue
 2023-07-24 15:38:01 +08:00
Ikko Eltociear Ashimine
9dedac31fd Add Japanese README (#405) 2023-07-24 11:14:16 +08:00
tingwei.gtw
d16522723a [to #42322933] add files 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13158565
* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* update test data

* [to #42322933] add files

* Merge remote-tracking branch 'origin' into feature/sal_try_on

* [to #42322933] add files

* Merge remote-tracking branch 'origin' into feature/sal_try_on
 2023-07-24 10:16:29 +08:00
mushenL
f77237b049 add llama2 pipeline (#399) 
* Modify the parameter passing of the text_generation_pipeline class

* add llama2 pipeline

* add llama pipeline v1.1

* add llama pipeline v1.2

* add llama pipeline v1.3

* add llama pipeline v1.0.4
 2023-07-22 21:53:04 +08:00
Xingjun.Wang
7608868290 Merge pull request #403 from modelscope/dev/check_lint 
fix yapf error
v1.7.2 		2023-07-22 00:01:01 +08:00
xingjun.wang
5a49093422 fix yapf 2023-07-21 23:37:17 +08:00
xingjun.wang
96a5282021 check format 2023-07-21 23:09:24 +08:00
LingFeng.Chen.Cn
9c4d9cdb68 fix file not found cause TypeError (#385) 
* fix file not found cause TypeError

* fix linter test

* fix linter test

* format code

---------

Co-authored-by: Krasus <chen@krasus.red>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
 2023-07-21 15:34:19 +08:00
shuli.cly
13e345f6d9 add sv/speaker_diarization_dialogue_detection to branch sv/semantic-dialogue-detection 
# Speaker Diarization Dialogue Detection CR

本模型是Speaker Diarization（`audio/speaker diarization`，语音/说话人日志）任务下的一个子模块。

本次提交的是基于文本进行判断的模型，其IO和中间过程和 `nlp/text-classification` 很像，且本地模型的初始模型也是基于huggingface训练的，因此此提交中复用了部分 `nlp/text-classification` 模型的代码。为了方便后续维护以及与nlp方面代码解耦，在model、pipeline以及preprocessor中 **单独** 创建了相应模块并重新register。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13269649
* start to add speaker_diarization_dialogue_detection files; Need to change constant and test

* add sv/speaker_diarization_dialogue_detection to branch sv/semantic-dialogue-detection

* update test case

* add comments for speaker diarization dialogue detection pipelines

* add outputs type and inputs type for speaker_diarization_dialogue_detection
 2023-07-20 19:29:59 +08:00
shenweichao.swc
05c65ba225 add s2net for panorama_depth_estimation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13310819
* add s2net codes

* fix sphdecoder

* Merge branch 'master' into dev/cv_s2net_panorama_depth_estimation

* revise comments in the pipeline

* revise the code
 2023-07-20 19:28:03 +08:00
xiangpeng.wxp
4085d821f3 [to #42322933] add polylm, a polyglot large language model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13339595
 2023-07-20 18:21:07 +08:00
tongmu.wh
c859bea022 fix vad time stamp in sd pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13316765
* fix details of speaker models

* Merge branch 'master' into speaker-fix

* fix vad time stamp in sd pipeline
 2023-07-20 17:32:51 +08:00
LingFeng.Chen.Cn
19ea082fec Update speaker_verification_pipeline.py (#364) 
* Update speaker_verification_pipeline.py

* fix log too long when input tuple(bytes,bytes)

* Update speaker_verification_pipeline.py

* fix when bytes print too much

* Update speaker_verification_pipeline forward log

* pre-commit linter format


---------

Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
 2023-07-20 09:28:55 +08:00
tastelikefeet
78b3e74fd8 pre-commit passed (#395) 2023-07-19 20:59:58 +08:00
Jintao
2f7c669f33 support llama2 (#393) 
* Unify sft and infer code into a single file

* update llama2 sft infer
 2023-07-19 17:34:27 +08:00
tastelikefeet
3283a46c52 Add Llama2 from hf (#394) 
* update llama code

* add llama2

* revert llama code

* add llama2 registry

* fix bug
 2023-07-19 17:22:03 +08:00
XDUWQ
66795aa3ff change tests level 2023-07-19 09:41:21 +08:00
mulin.lyh
247ae5f637 default aliyuncs pip 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13320919
* default aliyuncs pip

* pip to aliyun source
 2023-07-18 19:59:23 +08:00
mulin.lyh
bb9163f71a remove hard code tsinghua 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13314592
* remove hard code tsinghua
 2023-07-18 14:51:18 +08:00
tastelikefeet
12bc1603a9 Fix amp + device_map (#386) 
1. Fix the amp + device_map bug in chatglm2 finetune code 
2. Optional to save optimizer state 
3. Fix the logger double print problem
 2023-07-16 08:45:20 +08:00
Wang Qiang
21d64f4518 Merge pull request #387 from XDUWQ/chinese_bug 
Fix bugs of chinese stable diffusion pipeline getting an unexpected keyword argument 'lora_scale'
 2023-07-16 00:05:47 +08:00
XDUWQ
fc85b57a3e fix bugs of chinese stable diffusion pipeline lora_scale 2023-07-15 23:16:16 +08:00
Jintao
c6189d68a0 Fix/chatglm2 (#384) 2023-07-15 09:59:53 +08:00
mulin.lyh
104cb93d50 [to #50841229]feat: precompile pai-easycv in image 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13225347
* [to #50841229]feat: precompile pai-easycv in image
 2023-07-14 19:11:49 +08:00
Wang Qiang
442bdc74a4 Use more compatible DiffusionPipeline (#383) 2023-07-14 19:04:29 +08:00
Wang Qiang
0b85979f2e Update diffusers version to 0.18.0 (#377) 
* update diffusers to 0.18.0

* fix bugs
 2023-07-14 19:02:52 +08:00
baiguan.yt
ceac129c6b add parameters height and width for text-to-video 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13171907
 2023-07-14 16:22:10 +08:00
XDUWQ
34ab717393 custom_diffusion 2023-07-12 19:47:32 +08:00
XDUWQ
cfa363d433 custom diffusion 2023-07-12 17:35:57 +08:00
XDUWQ
c1aa120029 custom diffusion 2023-07-12 17:15:10 +08:00
XDUWQ
d18cf31dfa custom diffusion 2023-07-12 16:00:18 +08:00
XDUWQ
73fe5d5d65 precommit 2023-07-12 15:52:36 +08:00
XDUWQ
bcf443c672 custom diffusion 2023-07-12 15:32:48 +08:00