Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 12:39:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,825 Commits 263 Branches 106 Tags
fix/patch_dynamic_module
Commit Graph

2825 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
kangzhao2
90f7a5c6c0 update files 2023-08-16 11:35:15 +08:00
kangzhao2
037e73fe6e baishao 2023-08-15 21:32:30 +08:00
kangzhao2
e6404f29a2 baishao 2023-08-15 21:17:00 +08:00
Wang Qiang
a67d339e3b support float16 training and pipeline for stable diffusion (#447) 
* support float16 traing and pipeline for stable diffusion

* pre commit

* fix bugs

* add torch type example

* fix bugs of torch type

* support type float16

* fix bugs of load pipeline

* change type to fp16

* lora rank

---------

Co-authored-by: 翊靖 <yijing.wq@alibaba-inc.com>
 2023-08-15 20:04:32 +08:00
Zhicheng Zhang
d212ced3f3 Update qwen QA example (#470) 2023-08-15 17:25:25 +08:00
wenmeng.zwm
8db088d2cb fix virtural tryon ut error 2023-08-15 16:49:15 +08:00
Wang Qiang
ee8afd2d62 VideoComposer: Compositional Video Synthesis with Motion Controllability (#431) 
* VideoComposer: Compositional Video Synthesis with Motion Controllability

* videocomposer pipeline

* pre commit

* delete xformers
 2023-08-15 12:01:03 +08:00
xiangpeng.wxp
344d2a2e5b [to #42322933] add truct remote code for polylm 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13628684
* add truct remote code for polylm

* [to #42322933] add truct remote code for polylm

* [to #42322933] add truct remote code for polylm
 2023-08-14 15:37:42 +08:00
Jintao
18d33a4825 fix copytree python37 bug (#464) 
* fix copytree python37 bug

* add copytree_py37 function
 2023-08-14 11:45:33 +08:00
Yingda Chen
b18288cd6b update example 2023-08-13 11:06:41 +08:00
wenmeng zhou
74d8317bb0 fix pipeline check error (#455) 
* fix pipeline check error

* update
 2023-08-11 15:52:53 +08:00
Jintao
c06f47f384 add readme and warning (#462) 
* add readme and warning

* fix bug

* update

* update readme
 2023-08-11 14:55:24 +08:00
Ran Zhou
026a9ef227 Add machine reading comprehension model, preprocessor and pipeline (#451) 
* Add machine reading comprehension model, preprocessor and pipeline

* fix precommit errors

* Optimize mrc preprocessor, add mrc input output definition, add mrc pipeline docstr

---------

Co-authored-by: seadamo <ran.zhou@alibaba-inc.com>
 2023-08-11 13:47:26 +08:00
Zhicheng Zhang
0e8be51fef add qwen qa example with langchain 2023-08-11 11:53:17 +08:00
xiangpeng.wxp
5e83523c9a [to #42322933] Add polylm lora trainer to modelscope 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13509769
* [to #42322933] Add polylm lora trainer to modelscope
 2023-08-10 20:57:47 +08:00
Zhicheng Zhang
ad5b134bfe update qwen qa example 2023-08-10 19:34:39 +08:00
Zhicheng Zhang
2baef2110d update QA example 2023-08-10 19:03:20 +08:00
chenyafeng.cyf
33605de759 eres2net_lre_v2 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13602081

* add eres2net_base_large_lre

* eres2net_language_identification

* eres2net_lre_v2
 2023-08-10 17:44:43 +08:00
liuyhwangyh
75a14a36ba get github diff files (#446) 
* get github diff files

* add github environment

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2023-08-10 16:22:37 +08:00
wenmeng zhou
e3abfe0564 Update framework.txt (#453) 
remove version restrict for numpy and pandas
 2023-08-09 18:00:44 +08:00
wenmeng zhou
6f371a2d29 bumpy version to 1.8.2 (#449) 2023-08-09 17:50:26 +08:00
mushenL
75dd355ad7 llama2 max_length change (#452) 
default max_length set to 2048
 2023-08-09 11:07:09 +08:00
wenmeng.zwm
725521a2af skip test_text_to_360panorama_image test 2023-08-08 16:41:19 +08:00
Zhicheng Zhang
a36c25dbd3 Merge remote-tracking branch 'github/master' into master-github 2023-08-08 15:11:02 +08:00
Zhicheng Zhang
9854759a55 add doc search QA with dashscope 2023-08-08 15:05:50 +08:00
wenmeng zhou
cba1156f0d fix chatglm2b rope_ratio config is missing (#440) 2023-08-08 14:53:29 +08:00
zsl01670416
43a57fe110 support load dataset for llama 
support loading dataset for llama:
1.load dataset by MsDataset when parameters train dataset name and val dataset name were set. but there is no suitable dataset in hub.
2.load dataset by MsDataset when only parameter train dataset name was set, and then split into train dataset and validation dataset . 
3.load dataset by MsDataset when user set parameter src_txt, which is a file path such as 'alpaca_data.json', and then split into training dataset and validation dataset.
4.load dataset by build dataset from file in flex training.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13505335
 2023-08-07 19:48:36 +08:00
lingcai.wl
7757f3c64a [to #51336898] support eas deploy, fix minor problems 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13541904
* [to #51336898] support eas deploy

* [to #51336898] support eas deploy, fix minor problems
 2023-08-07 19:48:07 +08:00
zsl01670416
b0699fd8e2 support llama2 inputs to device in function generate 
fix error inputs and model were not on the same device. if they are not on the same device, inputs will be implemented function to model device.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13546989
* support llama inputs to device in function generate

* modify test qwen text generation according to github code
 2023-08-07 15:41:28 +08:00
liuyhwangyh
18bf0b4c47 ci to us host (#443) 2023-08-07 10:28:51 +08:00
wenmeng zhou
1e580e212e update qwen with cpu infer/tokenization utils/other configs 
update qwen with cpu infer/tokenization utils/other configs
 2023-08-04 16:32:52 +08:00
lukeming.lkm
3c400cbeda update qwen with cpu infer/tokenization utils/other configs 2023-08-04 14:22:53 +08:00
wenmeng.zwm
63747824fa upgrade to 1.8.1 2023-08-03 16:01:41 +08:00
lukeming.lkm
9e033104af change use_fast_att and fix bfloat loading 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13522792

* check flash att is installed even if  use_fast_att is set True and fix bfloat loading

* skip pipeline model placement for quantization

* update unittest for qwen
 2023-08-03 15:59:51 +08:00
yuze.zyz
deda508acc fix streamer arg 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13520666
* fix streamer arg
 2023-08-03 14:34:52 +08:00
wenmeng zhou
7b8bb091a5 Merge pull request #437 from modelscope/merge_gitlab_0803 
Merge gitlab 0803
 2023-08-03 12:25:11 +08:00
wenmeng.zwm
2796b0eecc Merge branch 'master-gitlab' into merge_gitlab_0803 2023-08-03 12:14:27 +08:00
liuyhwangyh
0fff03d640 modify gpu/cpu binding (#436) 2023-08-03 11:27:37 +08:00
lukeming.lkm
b3a61ef6f4 update LICENSE 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13516119
 2023-08-03 11:07:34 +08:00
lukeming.lkm
914e9af3ad add LICENSE and related snippets 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13513677
 2023-08-03 09:39:20 +08:00
lukeming.lkm
561fbe9eb2 reformat stop_words_ids to sync QWen7b HF 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13510247
 2023-08-02 18:46:12 +08:00
liuyhwangyh
11832f9246 daily regression to us host (#435) 2023-08-02 18:32:53 +08:00
lukeming.lkm
1ce78d648d add kwargs for save_vocabulary 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13508568
 2023-08-02 18:12:11 +08:00
lukeming.lkm
dece963ad5 resolve stopword logits processor 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13504522

* resolve stopword logits processor
 2023-08-02 16:14:48 +08:00
hejunjie.hjj
0c679d2e09 fix bug: referring_video-object-segmentation兼容Pillow10 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13479152
* fix bug: referring_video-object-segmentation兼容Pillow10
 2023-08-02 16:08:26 +08:00
lukeming.lkm
bd2f70a6eb add quantization in qwen pipelines and relevant unittests 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13499600

* add quant features

* resolve import

* resolve format

* fix save vocab
 2023-08-02 14:05:13 +08:00
lukeming.lkm
33bd74a7be add qwen 7b base and chat 
添加QWen 7b base模型和chat模型及相关pipelines
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235

* add qwen 7b base and chat

* fix logger

* update examples, lint test

* add unittest for qwen base and chat

* rename qwen to qwen-7b

* resolve imports and add a registry to text-generation

* reset load model from pretrained

* fix precheck

* skip qwen test case now

* remove strange file
 2023-08-02 09:25:21 +08:00
wenmeng zhou
1a6583eee2 Feat/chatglm2 32k support (#433) 
* add support for chatglm2 32k

* fix
 2023-08-01 23:22:09 +08:00
suluyan.sly
f080603802 remove requirement realesrgan for basicsr 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13488773
* remove requirement realesrgan for basicsr
 2023-08-01 16:55:47 +08:00
mulin.lyh
c1df82acd8 init pip to aliyuncs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13487845

* init pip to aliyuncs
 2023-08-01 16:55:33 +08:00