Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-21 18:49:23 +01:00
Code Issues Packages Projects Releases Wiki Activity

[to #42322933] Add polylm lora trainer to modelscope

Browse Source 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13509769
* [to #42322933] Add polylm lora trainer to modelscope
This commit is contained in:
xiangpeng.wxp
2023-08-10 20:57:47 +08:00
committed by wenmeng.zwm
parent 33605de759
commit 5e83523c9a
4 changed files with 32 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/pytorch/llm/llm_infer.py
View File

@@ -93,6 +93,7 @@ def llm_infer(args: InferArguments) -> None:
top_k=args.top_k,
top_p=args.top_p,
do_sample=True,
eos_token_id=tokenizer.eos_token_id,
pad_token_id=tokenizer.eos_token_id)
logger.info(f'generation_config: {generation_config}')