Skip to main content
Committed ⭐️⭐️
July 14, 2026
Question

Agent API returns empty responses (HTTP 200) on generation calls

  • July 14, 2026
  • 4 replies
  • 42 views

We have an app deployed in abp-sandbox for “offshore regulatory assistance” (Flows + KG-RAG agent) on the Agent API (`az-ams-sp-002`, `cdf-version: beta`). While developing document export, I've encountered a reproducible failure pattern:

Generation calls with complex instructions and/or long input intermittently return HTTP 200 with empty `content.text` — no error signal. The failure threshold shifted within hours on identical configuration: a 28.7K prompt succeeded at 18:15, 25K failed 12/12 an hour later, 15K succeeded at 21:49. Compression/summarization calls of similar size succeeded in the same window where generation calls failed.

A report with the full test matrix is attached.

Questions for Cognite (prepared with AI assistance):

1. Could the endpoint return an explicit error/finish-reason instead of an empty 200?
2. Are there documented practical limits for input size × instruction complexity?
3. What is the roadmap status for streaming or async chat?
4. Does a plain LLM endpoint without agent/RAG exist (or is one planned) for tasks that don't require retrieval?

15.07.2026
The empty-response issue is now deterministically reproducible — 10/10 empty with a 28K prompt vs. 33/33 OK with a short prompt, all within 20:01–21:32 UTC on 14 July (call ids and timestamps in the report). The report also documents a separate cognite-sdk hang triggered by these responses; please route that part to the SDK team.

4 replies

Mithila Jayalath
Expert ⭐️⭐️⭐️⭐️
Expert ⭐️⭐️⭐️⭐️
July 15, 2026

@Odd Egil Overskeid I will check on this internally and get back to you with an update.

kelvin
Expert ⭐️⭐️⭐️⭐️
Expert ⭐️⭐️⭐️⭐️
August 4, 2026

Hey ​@Odd Egil Overskeid ! Thanks for the details -- can you share a minimal notebook and prompt to reproduce this issue?

Committed ⭐️⭐️
August 4, 2026

Hi, ​@kelvin there is an app in CDF at Aker BP sandbox which can be tested and reproduce the issues i have posted in the files here. Yes i can use the app to reproduce it.

kelvin
Expert ⭐️⭐️⭐️⭐️
Expert ⭐️⭐️⭐️⭐️
August 4, 2026

Which app?

Also, I noticed you’re using the “Query Knowledge Graph” tool which is superseded by the new Query tool which typically is significantly faster. It might not fix the underlying problem, but may help you reduce the occurrence of it: https://docs.cognite.com/cdf/atlas_ai/references/atlas_ai_query_tool#query-tool