Atlas AI Evaluation Tool Requirements
Requirement: Improve Evaluation Tool CLI Report Details
The Cognite Atlas AI Evaluation Tool CLI should include timing information for each individual evaluation question, including:
- Start Time — datetime when the test started.
- End Time — datetime when the test finished.
- Duration (chatDuration) — total execution time, using a consistent unit such as seconds or milliseconds.
This information should also be included in the exported evaluation report to support Agent performance and latency analysis, comparison across Agents, models, skills, and evaluation runs, and overall production-readiness assessment.
Check the
documentation
Ask the
Community
Take a look
at
Academy
Cognite
Status
Page
Contact
Cognite Support
