tastelikefeet
f2e9ea4199
Replace code with swift wheel ( #467 )
2023-08-29 17:27:18 +08:00
Jintao
18d33a4825
fix copytree python37 bug ( #464 )
...
* fix copytree python37 bug
* add copytree_py37 function
2023-08-14 11:45:33 +08:00
Jintao
c06f47f384
add readme and warning ( #462 )
...
* add readme and warning
* fix bug
* update
* update readme
2023-08-11 14:55:24 +08:00
lukeming.lkm
bd2f70a6eb
add quantization in qwen pipelines and relevant unittests
...
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13499600
* add quant features
* resolve import
* resolve format
* fix save vocab
2023-08-02 14:05:13 +08:00
lukeming.lkm
33bd74a7be
add qwen 7b base and chat
...
添加QWen 7b base模型和chat模型及相关pipelines
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235
* add qwen 7b base and chat
* fix logger
* update examples, lint test
* add unittest for qwen base and chat
* rename qwen to qwen-7b
* resolve imports and add a registry to text-generation
* reset load model from pretrained
* fix precheck
* skip qwen test case now
* remove strange file
2023-08-02 09:25:21 +08:00
Jintao
312b63fe06
fix checkpoint, same device bug ( #427 )
2023-07-29 00:06:27 +08:00
Jintao
4ca937d2ba
support openbuddy-llama2-13b ( #416 )
2023-07-26 18:12:55 +08:00
Jintao
f03898626e
ckpt output directory ignore *.safetensors ( #410 )
...
* ckpt output file ignore *.safetensors
* update
2023-07-25 19:27:11 +08:00
Jintao
ba4b9fc43f
Added full parameter sft to llm ( #402 )
...
* Optimized code
* update parse_args
* fix get_logger bug
* update parse_args
* Added full parameter fine-tuning
* Add support_bf16 warning
* Modify the code format and fix bugs
2023-07-24 15:52:09 +08:00
Jintao
2f7c669f33
support llama2 ( #393 )
...
* Unify sft and infer code into a single file
* update llama2 sft infer
2023-07-19 17:34:27 +08:00