-
-
Notifications
You must be signed in to change notification settings - Fork 115
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Hello, I love this program. I am using Windows, and it works beautifully local with Kobodcpp.
However, I encountered a hard limit: when the input is very long, and I know it is correctly processed in the terminal in the background, the generated output is limited to just 512 tokens.
This happens whether I swap the old text in place with the output or use the option of opening a new window in the widget, especially when generating longer output.
What I would like is an option to change the maximum number of tokens, perhaps up to 2048 or more. I find the 512-token limit too restrictive. Thanks.
Example
Now: Generating (233 / 512 tokens)
Hoped: Generating (233 / 2048 tokens)
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request