Skip to content

Conversation

@alissonlauffer
Copy link
Contributor

Enable reasoning, tool calling, and multimodal input support for the Kimi K2.5 TEE model. Increase context limit from 32k to 262k tokens and output limit from 8k to 65k tokens. Add support for image and video inputs alongside text. Configure interleaved reasoning content field.

Enable reasoning, tool calling, and multimodal input support for the
Kimi K2.5 TEE model. Increase context limit from 32k to 262k tokens and
output limit from 8k to 65k tokens. Add support for image and video
inputs alongside text. Configure interleaved reasoning content field.
Copy link

@pkarecki pkarecki left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@pkarecki
Copy link

Please merge. Obviously current values are wrong. The worst part is context limit triggering auto-compact every few messages.

mugnimaestra added a commit to mugnimaestra/models.dev that referenced this pull request Jan 28, 2026
Corrections made based on chutes API source:
- Updated name from 'Kimi K2.5 TEE' to 'moonshotai/Kimi-K2.5-TEE'
- Added family field: 'kimi'
- Fixed reasoning capability from false to true
- Added reasoning_content interleaved field
- Fixed tool_call capability from false to true
- Fixed structured_output capability from false to true
- Added knowledge cutoff: 2024-10
- Corrected context window from 32,768 to 262,144
- Corrected output window from 8,192 to 65,535
- Expanded input modalities to include text, image, and video

This PR supersedes anomalyco#736 which contains errors in model specifications.
@mugnimaestra
Copy link

mugnimaestra commented Jan 28, 2026

+1

i wonder how it got wrong in the first place, following specs returned from https://llm.chutes.ai/v1/models it should not be that 32k

{
      "id": "moonshotai/Kimi-K2.5-TEE",
      "root": "moonshotai/Kimi-K2.5",
      "price": {
        "input": {
          "tao": 0.00252314883928846,
          "usd": 0.6
        },
        "output": {
          "tao": 0.0126157441964423,
          "usd": 3
        }
      },
      "object": "model",
      "parent": null,
      "created": 1769568145,
      "pricing": {
        "prompt": 0.6,
        "completion": 3
      },
      "chute_id": "2ff25e81-4586-5ec8-b892-3a6f342693d7",
      "owned_by": "vllm",
      "permission": [
        {
          "id": "modelperm-9a5e0f31d83dbb85",
          "group": null,
          "object": "model_permission",
          "created": 1769568145,
          "allow_view": true,
          "is_blocking": false,
          "organization": "*",
          "allow_logprobs": true,
          "allow_sampling": true,
          "allow_fine_tuning": false,
          "allow_create_engine": false,
          "allow_search_indices": false
        }
      ],
      "quantization": "int4",
      "max_model_len": 262144,
      "context_length": 262144,
      "input_modalities": [
        "text",
        "image",
        "video"
      ],
      "max_output_length": 65535,
      "output_modalities": [
        "text"
      ],
      "supported_features": [
        "json_mode",
        "structured_outputs",
        "tools",
        "reasoning"
      ],
      "confidential_compute": true,
      "supported_sampling_parameters": [
        "temperature",
        "top_p",
        "top_k",
        "repetition_penalty",
        "frequency_penalty",
        "presence_penalty",
        "stop",
        "seed"
      ]
    },

@mugnimaestra
Copy link

mugnimaestra commented Jan 28, 2026

Great work! I have 3 critical corrections needed for this PR:

1. name: Should be "moonshotai/Kimi-K2.5-TEE" (not "Kimi K2.5 TEE")
2. output limit: Should be 65_535 (not 65,536)
3. structured_output: Should be true (added, not removed/unchanged)

These corrections were included in PR #738 which I just closed to avoid duplication. Please update before merging.

@rekram1-node
Copy link
Contributor

I think name is correct here, you are citing the model id, a name field shouldnt need "/" in it

@rekram1-node rekram1-node merged commit 5233270 into anomalyco:dev Jan 28, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants