Kimi K2 0905 is degraded

Forum
1

I am facing JSON parsing issues with Kimi K2 0905 (using OpenRouter), and sometimes I get this error

Failed to call a function. Please adjust your prompt. See failed_generation for more details.

Attaching the response it is producing.

image
image974×382 104 KB

2

Hi there! Thanks for this report! Do you have an example prompts that are resulting in this issue?

This can sometimes happen when you set tool_choice to required but the model doesn’t actually call a tool. We aren’t able to actually force the model to call a tool - this is something that it decides to do. But with the right prompting, we can help steer it to call a tool.

We’ve got a lot of great information in our docs that might help you too: Local Tool Calling - GroqDocs

3

Hi @benank. Actually this behaviour is one thing, but I am seeing a lot of random HTML tags in my responses too, like a lot of \n’s randomly

Someone else also reported the same issue as me. I hope this is helpful?

4

Thanks - we are actively looking into the random HTML degradation right now.