-
Notifications
You must be signed in to change notification settings - Fork 424
feat(chutes): update Kimi K2.5 TEE model capabilities #736
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(chutes): update Kimi K2.5 TEE model capabilities #736
Conversation
Enable reasoning, tool calling, and multimodal input support for the Kimi K2.5 TEE model. Increase context limit from 32k to 262k tokens and output limit from 8k to 65k tokens. Add support for image and video inputs alongside text. Configure interleaved reasoning content field.
pkarecki
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1
|
Please merge. Obviously current values are wrong. The worst part is context limit triggering auto-compact every few messages. |
Corrections made based on chutes API source: - Updated name from 'Kimi K2.5 TEE' to 'moonshotai/Kimi-K2.5-TEE' - Added family field: 'kimi' - Fixed reasoning capability from false to true - Added reasoning_content interleaved field - Fixed tool_call capability from false to true - Fixed structured_output capability from false to true - Added knowledge cutoff: 2024-10 - Corrected context window from 32,768 to 262,144 - Corrected output window from 8,192 to 65,535 - Expanded input modalities to include text, image, and video This PR supersedes anomalyco#736 which contains errors in model specifications.
|
+1 i wonder how it got wrong in the first place, following specs returned from https://llm.chutes.ai/v1/models it should not be that 32k |
|
Great work! I have 3 critical corrections needed for this PR:
These corrections were included in PR #738 which I just closed to avoid duplication. Please update before merging. |
|
I think name is correct here, you are citing the model id, a name field shouldnt need "/" in it |
Enable reasoning, tool calling, and multimodal input support for the Kimi K2.5 TEE model. Increase context limit from 32k to 262k tokens and output limit from 8k to 65k tokens. Add support for image and video inputs alongside text. Configure interleaved reasoning content field.