Skip to content

Request option: Change maximum output #220

@Sarrusha

Description

@Sarrusha

Hello, I love this program. I am using Windows, and it works beautifully local with Kobodcpp.
However, I encountered a hard limit: when the input is very long, and I know it is correctly processed in the terminal in the background, the generated output is limited to just 512 tokens.
This happens whether I swap the old text in place with the output or use the option of opening a new window in the widget, especially when generating longer output.

What I would like is an option to change the maximum number of tokens, perhaps up to 2048 or more. I find the 512-token limit too restrictive. Thanks.

Example
Now: Generating (233 / 512 tokens)
Hoped: Generating (233 / 2048 tokens)

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions