lukeming.lkm
bd2f70a6eb
add quantization in qwen pipelines and relevant unittests
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13499600
* add quant features
* resolve import
* resolve format
* fix save vocab
2023-08-02 14:05:13 +08:00
lukeming.lkm
33bd74a7be
add qwen 7b base and chat
...
添加QWen 7b base模型和chat模型及相关pipelines
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235
* add qwen 7b base and chat
* fix logger
* update examples, lint test
* add unittest for qwen base and chat
* rename qwen to qwen-7b
* resolve imports and add a registry to text-generation
* reset load model from pretrained
* fix precheck
* skip qwen test case now
* remove strange file
2023-08-02 09:25:21 +08:00
Jintao
312b63fe06
fix checkpoint, same device bug ( #427 )
2023-07-29 00:06:27 +08:00
Jintao
4ca937d2ba
support openbuddy-llama2-13b ( #416 )
2023-07-26 18:12:55 +08:00
Jintao
f03898626e
ckpt output directory ignore *.safetensors ( #410 )
...
* ckpt output file ignore *.safetensors
* update
2023-07-25 19:27:11 +08:00
Jintao
ba4b9fc43f
Added full parameter sft to llm ( #402 )
...
* Optimized code
* update parse_args
* fix get_logger bug
* update parse_args
* Added full parameter fine-tuning
* Add support_bf16 warning
* Modify the code format and fix bugs
2023-07-24 15:52:09 +08:00
xingjun.wang
96a5282021
check format
2023-07-21 23:09:24 +08:00
Jintao
2f7c669f33
support llama2 ( #393 )
...
* Unify sft and infer code into a single file
* update llama2 sft infer
2023-07-19 17:34:27 +08:00
Jintao
c6189d68a0
Fix/chatglm2 ( #384 )
2023-07-15 09:59:53 +08:00
Jintao
d20d033e07
add example/llm ( #372 )
...
* add example/llm
* fix lint test
2023-07-11 17:35:11 +08:00
