Mirrors/talemate
1
0
Fork 0
mirror of https://github.com/vegu-ai/talemate.git synced 2025-12-25 16:09:32 +01:00
Code Issues Packages Projects Releases Wiki Activity

Comment out 'repetition_penalty_range' in TabbyAPIClient to prevent unexpected "<unk><unk> .." responses. Further investigation needed.

Browse Source
This commit is contained in:
vegu-ai-tools
2025-10-01 00:34:37 +03:00
parent 0463fd37e5
commit 4dbc824c07
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
src/talemate/client/tabbyapi.py
View File

@@ -74,7 +74,10 @@ class TabbyAPIClient(ClientBase):
"max_tokens",
"presence_penalty",
"frequency_penalty",
"repetition_penalty_range",
# sending this leads to odd "<unk><unk> .." responses
# unclear what is happening there, will need to revisit.
# https://github.com/theroyallab/tabbyAPI/blob/main/backends/exllamav3/model.py#L912 - related?
#"repetition_penalty_range",
"min_p",
"top_p",
"xtc_threshold",