DEV Community

#evals

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I Published a Perfect Recall. Then I Measured Dust.
dylanmerigaud profile

I Published a Perfect Recall. Then I Measured Dust.

#evals #measurement #python #docverification
Comments
7 min read
OpenAI's dots need acceptance criteria, not just Custom Rules
ascotlan profile

OpenAI's dots need acceptance criteria, not just Custom Rules

#agents #evals #openai #workflows
1
Comments
6 min read
How to Evaluate AI Agents: Reliability, Cost, Latency, and Failure Modes
fernandoabishai profile
FA33

How to Evaluate AI Agents: Reliability, Cost, Latency, and Failure Modes

#ai #agents #evals #reliability
Comments
7 min read
Evals are the unit tests of prompts
intframe profile

Evals are the unit tests of prompts

#ai #evals
Comments
2 min read
TypeSafe Jev Played Chess — And Landed Next to Reasoning Models
maximsaplin profile

TypeSafe Jev Played Chess — And Landed Next to Reasoning Models

#ai #evals #llm #agents
13
Comments 1
3 min read
One pass of my eval bills $9.14 on the API and $0 through the CLI
dylanmerigaud profile

One pass of my eval bills $9.14 on the API and $0 through the CLI

#ai #evals #claude #tooling
Comments
2 min read
AI per developer: cosa accelera davvero (e cosa ti fa perdere tempo)
frontendfacile profile

AI per developer: cosa accelera davvero (e cosa ti fa perdere tempo)

#workflowaicoding #agentillm #evals #reliabilitytesting
Comments
4 min read
I have been Vibecoding Evals (works better than I thought)
juampitech profile

I have been Vibecoding Evals (works better than I thought)

#ai #llm #python #evals
Comments
3 min read
How to Design AI Evaluations You Can Actually Trust
jfschmakeit profile

How to Design AI Evaluations You Can Actually Trust

#ai #evals
46
Picked as gem Comments 11
4 min read
Evals: How You Know the Agent Works in Production
rxkov profile
Rxkov

Evals: How You Know the Agent Works in Production

#agentic #llm #evals #testing
Comments
3 min read
How to Write Reliable Rubrics for LLM-as-a-Judge Evaluations
jfschmakeit profile

How to Write Reliable Rubrics for LLM-as-a-Judge Evaluations

#ai #evals #testing
33
Comments 2
5 min read
Rewriting prose until the tests pass: everything passed, but the check that mattered never ran once
matsumotory profile

Rewriting prose until the tests pass: everything passed, but the check that mattered never ran once

#testing #aiwriting #evals #promptengineering
Comments
6 min read
Rewriting research prose until the tests pass
matsumotory profile

Rewriting research prose until the tests pass

#testing #research #aiwriting #evals
Comments
5 min read
The 12-Prompt Eval I Run Before I Trust Any Model Upgrade
agnelnieves profile

The 12-Prompt Eval I Run Before I Trust Any Model Upgrade

#prompting #evals #modelmigration #claude
Comments
3 min read
How to Build AI Evals for Tool-Calling Agents
dhanushreddy29 profile

How to Build AI Evals for Tool-Calling Agents

#ai #evals #aievals #agents
1
Comments 2
17 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.