DEV Community

AI Agent Evaluation Series' Articles

Back to Shashank Agarwal's Series
System Prompts Define Instructions. Factual Evaluation Needs Evidence.

System Prompts Define Instructions. Factual Evaluation Needs Evidence.

1
Comments
2 min read
Evaluate Agent Outcomes and Tool Use Together

Evaluate Agent Outcomes and Tool Use Together

1
Comments
2 min read
Using System Prompts in Evaluation Without Discarding Reviewed Evidence

Using System Prompts in Evaluation Without Discarding Reviewed Evidence

1
Comments
2 min read
Beyond Accuracy: Choosing the Right Dimensions of AI Agent Quality

Beyond Accuracy: Choosing the Right Dimensions of AI Agent Quality

Comments
2 min read
How to Investigate Agent Failures With Captured Traces

How to Investigate Agent Failures With Captured Traces

Comments
2 min read
Five Agent Failure Categories and the Evidence Each Needs

Five Agent Failure Categories and the Evidence Each Needs

1
Comments
2 min read
How to Measure the Cost of an Agent’s Captured Workflow

How to Measure the Cost of an Agent’s Captured Workflow

Comments 1
2 min read
Privacy and Policy Review Signals in AI Agent Traces

Privacy and Policy Review Signals in AI Agent Traces

Comments
2 min read
How to Scale Agent Evaluation Without Losing the Evidence

How to Scale Agent Evaluation Without Losing the Evidence

Comments
2 min read
Monitoring and Evaluation: Connecting Execution to Agent Outcomes

Monitoring and Evaluation: Connecting Execution to Agent Outcomes

Comments
2 min read
The AI Agent Feedback Loop: From Findings to Reviewed Changes

The AI Agent Feedback Loop: From Findings to Reviewed Changes

Comments
2 min read