WebSearch Tool Stops with "Request too large" Error for Non-English Queries

Forum
1

Hello, I’d like to ask a question about an issue I encountered in the Playground.

For example, when I query in English like “What marketing automation tools suit Japanese start-ups?”, I can use the WebSearch Tool with the Combine model without any problems.

However, when I ask in Japanese, such as “日本語でおすすめのMarketingAutomationツールを調査してください” the thinking process and tool output also switch to Japanese, which seems to trigger a “Request too large” error and halts the execution.

スクリーンショット 2025-11-12 003333
スクリーンショット 2025-11-12 0033331920×1232 257 KB

I suspect this might be due to insufficient context length adjustments during the Combine model’s internal thinking or when processing tool outputs. Could you please advise on any solutions, or tips for tweaking parameters or prompts to work around this?

Thanks!

2

Thank you for reporting this! Sometimes the model unfortunately does think a bit too hard — how often / what % of your requests are getting these?

I’m trying your prompt in Playground but I’m having a hard time reproducing, but it might just come down to me not having run this enough times.

3

Thanks! In my case, it’s happening 100% of the time—even when I bump max_completion_tokens to 1024 or 8192. For reference, here are an other reproducible words/phrases I’ve tested below. Let me know if that helps with repro!

:ng_button: 山梨県の絶景スポットを5つ調査して教えてください

Even in Japanese, it doesn’t always trigger an error—there’s a risk of overflow when search results include high-character elements like tables. Below are examples of queries that don’t cause errors:

:white_check_mark: 狭いベッドルームにおすすめの収納家具を調査して教えてください。

:white_check_mark: 日本の最新のテクノロジーニュースを調査して教えてください。

Thanks!

{
 "messages": [
   {
     "role": "user",
     "content": "山梨県の絶景スポットを5つ調査して教えてください"
   }
 ],
 "model": "groq/compound",
 "temperature": 1,
 "max_completion_tokens": 1024,
 "top_p": 1,
 "stream": true,
 "stop": null,
 "compound_custom": {
   "tools": {
     "enabled_tools": [
       "web_search",
       "visit_website"
     ]
   }
 }
}
1 Like
4

Thank you! We’re rolling out a fix for this issue, thank you for giving us these test cases.

1 Like
5

I have been getting this error just today on groq compound using web search.
It happens in the playground as well

my query was just “nz news”. it seems to have search 4 times in tool use, not sure if that is the issue?

Previously it has worked fine but today it isn’t

6

Thank you, we’re rolling out more fixes for this over the next coming weeks, please stay tuned!