Skip to main content
Leonardo Maia Barbosa
Committed ⭐️
Committed ⭐️
October 14, 2026
New

Atlas AI Evaluation Tool Requirements

Related products:Evaluation framework

Requirement: Improve Evaluation Tool CLI Report Details
The Cognite Atlas AI Evaluation Tool CLI should include timing information for each individual evaluation question, including:
- Start Time — datetime when the test started.
- End Time — datetime when the test finished.
- Duration (chatDuration) — total execution time, using a consistent unit such as seconds or milliseconds.
This information should also be included in the exported evaluation report to support Agent performance and latency analysis, comparison across Agents, models, skills, and evaluation runs, and overall production-readiness assessment.