Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-02-25 04:30:48 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,977 Commits 267 Branches 107 Tags
bbde919a64dbcf1d8a8ebb7dddc3f52e469b2e53
Commit Graph

1977 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Yingda Chen
bbde919a64 update example 2023-08-15 14:04:20 +08:00
wenmeng zhou
54fdc76fdb fix pipeline check error (#455) 
* fix pipeline check error

* update
 2023-08-15 14:04:20 +08:00
Jintao
0e7ae942d7 add readme and warning (#462) 
* add readme and warning

* fix bug

* update

* update readme
 2023-08-15 14:04:20 +08:00
Zhicheng Zhang
f517dc3261 add qwen qa example with langchain 2023-08-15 14:04:20 +08:00
Zhicheng Zhang
9dd811b10d update qwen qa example 2023-08-15 14:04:20 +08:00
Zhicheng Zhang
348d6d04e4 update QA example 2023-08-15 14:04:17 +08:00
zsl01670416
c6df118593 support load dataset for llama 
support loading dataset for llama:
1.load dataset by MsDataset when parameters train dataset name and val dataset name were set. but there is no suitable dataset in hub.
2.load dataset by MsDataset when only parameter train dataset name was set, and then split into train dataset and validation dataset . 
3.load dataset by MsDataset when user set parameter src_txt, which is a file path such as 'alpaca_data.json', and then split into training dataset and validation dataset.
4.load dataset by build dataset from file in flex training.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13505335
 2023-08-09 20:18:23 +08:00
zsl01670416
e87d04e869 support llama2 inputs to device in function generate 
fix error inputs and model were not on the same device. if they are not on the same device, inputs will be implemented function to model device.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13546989
* support llama inputs to device in function generate

* modify test qwen text generation according to github code
 2023-08-09 20:18:23 +08:00
wenmeng zhou
d6e77ebf0f Update framework.txt (#453) 
remove version restrict for numpy and pandas
 2023-08-09 18:14:57 +08:00
mushenL
9a489b13fe llama2 max_length change (#452) 
default max_length set to 2048
 2023-08-09 18:14:38 +08:00
wenmeng zhou
8dff0bfe19 fix chatglm2b rope_ratio config is missing (#440) 2023-08-09 18:14:26 +08:00
lukeming.lkm
65d4f07841 change use_fast_att and fix bfloat loading 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13522792

* check flash att is installed even if  use_fast_att is set True and fix bfloat loading

* skip pipeline model placement for quantization

* update unittest for qwen
v1.8.1 		2023-08-03 16:01:14 +08:00
yuze.zyz
fe7f7d6725 fix streamer arg 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13520666
* fix streamer arg
 2023-08-03 14:35:35 +08:00
wenmeng.zwm
0501dfc388 upgrade version to 1.8.1 2023-08-03 14:20:56 +08:00
wenmeng.zwm
40501c7e01 Merge branch 'release/1.8' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into release/1.8 v1.8.0 2023-08-03 12:02:22 +08:00
lukeming.lkm
33e754632f update LICENSE 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13516119
 2023-08-03 12:01:48 +08:00
lukeming.lkm
74d6f13587 add LICENSE and related snippets 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13513677
 2023-08-03 12:01:48 +08:00
lukeming.lkm
610ee7dea0 reformat stop_words_ids to sync QWen7b HF 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13510247
 2023-08-03 12:01:48 +08:00
lukeming.lkm
366db40f80 add kwargs for save_vocabulary 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13508568
 2023-08-03 12:01:48 +08:00
lukeming.lkm
2b27144384 add quantization in qwen pipelines and relevant unittests 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13499600

* add quant features

* resolve import

* resolve format

* fix save vocab
 2023-08-03 12:01:48 +08:00
hejunjie.hjj
d160ff1e8b fix bug: referring_video-object-segmentation兼容Pillow10 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13479152
* fix bug: referring_video-object-segmentation兼容Pillow10
 2023-08-03 12:01:48 +08:00
lukeming.lkm
3a83f6fc35 resolve stopword logits processor 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13504522

* resolve stopword logits processor
 2023-08-03 12:01:48 +08:00
suluyan.sly
15bc9e5769 update release date 2023-08-03 12:01:48 +08:00
suluyan.sly
2e9401c0b0 v1.8 2023-08-03 12:01:48 +08:00
lukeming.lkm
4f4a15c169 add qwen 7b base and chat 
添加QWen 7b base模型和chat模型及相关pipelines
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235

* add qwen 7b base and chat

* fix logger

* update examples, lint test

* add unittest for qwen base and chat

* rename qwen to qwen-7b

* resolve imports and add a registry to text-generation

* reset load model from pretrained

* fix precheck

* skip qwen test case now

* remove strange file
 2023-08-03 12:01:48 +08:00
wenmeng zhou
33ac4b3c3b Feat/chatglm2 32k support (#433) 
* add support for chatglm2 32k

* fix
 2023-08-03 12:01:48 +08:00
suluyan.sly
2f7afe505d remove requirement realesrgan for basicsr 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13488773
* remove requirement realesrgan for basicsr
 2023-08-03 12:01:48 +08:00
mulin.lyh
5ff213aadf init pip to aliyuncs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13487845

* init pip to aliyuncs
 2023-08-03 12:01:48 +08:00
lukeming.lkm
1366ca97df update LICENSE 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13516119
 2023-08-03 11:23:40 +08:00
lukeming.lkm
16e0dbef2a add LICENSE and related snippets 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13513677
 2023-08-03 09:40:01 +08:00
lukeming.lkm
4e00e607ac reformat stop_words_ids to sync QWen7b HF 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13510247
 2023-08-02 18:46:46 +08:00
lukeming.lkm
74659be7d0 add kwargs for save_vocabulary 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13508568
 2023-08-02 18:12:44 +08:00
lukeming.lkm
a69b32609c add quantization in qwen pipelines and relevant unittests 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13499600

* add quant features

* resolve import

* resolve format

* fix save vocab
 2023-08-02 16:28:31 +08:00
hejunjie.hjj
cd3f5d659e fix bug: referring_video-object-segmentation兼容Pillow10 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13479152
* fix bug: referring_video-object-segmentation兼容Pillow10
 2023-08-02 16:28:31 +08:00
lukeming.lkm
e2c19e89e6 resolve stopword logits processor 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13504522

* resolve stopword logits processor
 2023-08-02 16:28:31 +08:00
suluyan.sly
903c5690ed update release date 2023-08-02 10:24:03 +08:00
suluyan.sly
3096ac226f v1.8 2023-08-02 10:18:24 +08:00
lukeming.lkm
fc0a0bcf60 add qwen 7b base and chat 
添加QWen 7b base模型和chat模型及相关pipelines
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235

* add qwen 7b base and chat

* fix logger

* update examples, lint test

* add unittest for qwen base and chat

* rename qwen to qwen-7b

* resolve imports and add a registry to text-generation

* reset load model from pretrained

* fix precheck

* skip qwen test case now

* remove strange file
 2023-08-02 09:47:30 +08:00
wenmeng zhou
54e65b034d Feat/chatglm2 32k support (#433) 
* add support for chatglm2 32k

* fix
 2023-08-01 23:22:49 +08:00
suluyan.sly
e38f67d747 remove requirement realesrgan for basicsr 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13488773
* remove requirement realesrgan for basicsr
 2023-08-01 16:58:38 +08:00
mulin.lyh
70e205a54a init pip to aliyuncs 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13487845

* init pip to aliyuncs
 2023-08-01 16:58:30 +08:00
suluyana
30e11d159d Merge branch 'release/1.8' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into master-github 2023-07-31 20:33:05 +08:00
suluyan.sly
63ffe65859 remove cv requirements: basicsr 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13471366
* rm req basicsr
 2023-07-31 19:36:29 +08:00
mulin.lyh
6f467de8e3 [to #51274424]fix: easycv extension and tinycudann conflict 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13471150
* fix easycv extension and tinycudann conflict
 2023-07-31 18:35:42 +08:00
yuze.zyz
18fe67c814 Ignore http error 
忽略log打印，防止在check_model_is_latest时打出信息使用户不明所以。
将log改为Error栈
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13463005
 2023-07-31 18:35:32 +08:00
wenmeng zhou
f2396ddb6a Merge pull request #432 from modelscope/merge_master-gitlab_0731 
Merge master gitlab 0731
 2023-07-31 17:14:41 +08:00
wenmeng.zwm
7fbd6ecc40 Merge branch 'master-gitlab' into merge_master-gitlab_0731 2023-07-31 16:16:16 +08:00
wenmeng.zwm
48a39244f1 Merge branch master-merge-github-230728 into master 
Title: Merge branch 'master-github' into master-merge-github-230728 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13456249
 2023-07-31 16:09:07 +08:00
Xingjun.Wang
ef1b429bef Merge pull request #430 from XDUWQ/delete_nerf_log 
delete unuseful logs
 2023-07-31 14:48:39 +08:00
XDUWQ
4233916867 delete unuseful logs 2023-07-31 14:36:12 +08:00