Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
evaluation
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Your Private Eval Is the Only Benchmark That Steers You
Travis Frisinger
Travis Frisinger
Travis Frisinger
Follow
Nov 12
Your Private Eval Is the Only Benchmark That Steers You
#
evaluation
#
aiagents
#
benchmarking
#
testdiscipline
Comments
Add Comment
7 min read
Moderation
Business Process Automation Mapping: A Decision Framework
Kh3loix
Kh3loix
Kh3loix
Follow
Nov 12
Business Process Automation Mapping: A Decision Framework
#
decisioncriteria
#
evaluation
#
framework
#
bpa
Comments
Add Comment
4 min read
Moderation
Restaurant Menu Retrieval Architecture — 6 Evaluation Sets for Grounded Answers
GodfreySterling9226
GodfreySterling9226
GodfreySterling9226
Follow
Nov 11
Restaurant Menu Retrieval Architecture — 6 Evaluation Sets for Grounded Answers
#
retrieval
#
rag
#
evaluation
#
devtools
Comments
Add Comment
4 min read
Moderation
Sixteen AI graders, six synthetic answers: measuring rubric drift without touching live data
EmBot-Lantern
EmBot-Lantern
EmBot-Lantern
Follow
Nov 11
Sixteen AI graders, six synthetic answers: measuring rubric drift without touching live data
#
ai
#
agents
#
evaluation
#
llm
Comments
Add Comment
4 min read
Moderation
How an LLM Benchmark Produces Comparable Numbers: Inside LFORLA's LLM Evaluation
RESK
RESK
RESK
Follow
Nov 11
How an LLM Benchmark Produces Comparable Numbers: Inside LFORLA's LLM Evaluation
#
llm
#
benchmarking
#
evaluation
#
opensource
Comments
Add Comment
3 min read
Moderation
The 30.6 Short: why a second-place table needed a video, not a screenshot
InApp
InApp
InApp
Follow
Nov 10
The 30.6 Short: why a second-place table needed a video, not a screenshot
#
video
#
evaluation
#
leaderboard
#
ai
1
 reaction
Comments
Add Comment
1 min read
Moderation
RAG faithfulness: how to evaluate a RAG and where the metric stops
Span Observer
Span Observer
Span Observer
Follow
Nov 9
RAG faithfulness: how to evaluate a RAG and where the metric stops
#
evaluation
#
hallucination
#
llamaindex
#
llm
Comments
Add Comment
6 min read
Moderation
Why my Arabic debate-scoring engine refuses to give one overall score
Abdullrahman Yazouri
Abdullrahman Yazouri
Abdullrahman Yazouri
Follow
Nov 9
Why my Arabic debate-scoring engine refuses to give one overall score
#
ai
#
llm
#
python
#
evaluation
Comments
1
 comment
5 min read
Moderation
What to Take from Project EVE: The Behavior Sandbox, Not the 6 Return
zxpmail
zxpmail
zxpmail
Follow
Nov 9
What to Take from Project EVE: The Behavior Sandbox, Not the 6 Return
#
ai
#
agents
#
evaluation
#
security
Comments
Add Comment
6 min read
Moderation
LLM Evaluation, Explained: How a Benchmark Produces Comparable Numbers (TL;DR)
RESK
RESK
RESK
Follow
Nov 9
LLM Evaluation, Explained: How a Benchmark Produces Comparable Numbers (TL;DR)
#
llm
#
benchmarking
#
evaluation
#
ai
Comments
Add Comment
4 min read
Moderation
How I'd test a robot policy in a tiny controlled world, in Python
kestrelfield
kestrelfield
kestrelfield
Follow
Nov 9
How I'd test a robot policy in a tiny controlled world, in Python
#
machinelearning
#
python
#
robotlearning
#
evaluation
Comments
Add Comment
7 min read
Moderation
Why Inkling 2 Small's 30.6 needed a full video, not a leaderboard screenshot
InApp
InApp
InApp
Follow
Nov 10
Why Inkling 2 Small's 30.6 needed a full video, not a leaderboard screenshot
#
ai
#
benchmarks
#
evaluation
#
selfhosted
Comments
Add Comment
1 min read
Moderation
Digital Approval Workflow: A Practical Decision Framework
Kh3loix
Kh3loix
Kh3loix
Follow
Nov 8
Digital Approval Workflow: A Practical Decision Framework
#
digitalapprovalworkflow
#
framework
#
evaluation
#
decisioncriteria
Comments
Add Comment
5 min read
Moderation
How an LLM Evaluation Benchmark Produces Comparable Numbers: Inside the Refusal Boundary
RESK
RESK
RESK
Follow
Nov 7
How an LLM Evaluation Benchmark Produces Comparable Numbers: Inside the Refusal Boundary
#
llm
#
evaluation
#
benchmark
#
safety
Comments
Add Comment
4 min read
Moderation
How to stop an LLM from inventing numbers: evidence containment and numeral tracing
Ali Ahmed
Ali Ahmed
Ali Ahmed
Follow
Nov 5
How to stop an LLM from inventing numbers: evidence containment and numeral tracing
#
aiengineering
#
llms
#
hallucinations
#
evaluation
Comments
Add Comment
3 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account