5 Commits

Author SHA1 Message Date
Georg Kucsko
009ff7cb62 make kv caching default in inference 2023-04-22 15:42:30 -04:00
Zygimantas Straznickas
15606ed12f Add k/v caching for autoregressive generation 2023-04-22 12:00:23 -07:00
Georg Kucsko
7d39f48c7a allow using unconditional as prompts 2023-04-21 16:14:10 -04:00
Georg Kucsko
9751cfbfc4 small updates 2023-04-21 15:13:18 -04:00
Georg Kucsko
ea9a687004 first commit 2023-04-09 13:21:02 -04:00