Writing
Notes on evaluating AI.
Practical guides to software judgment, model comparisons, and evaluation design. Explore the current guides alongside our engineering archive.
Start with a worked example.
Trace a session-validation review from requirement to finding, then adapt the downloadable rubric and records.
Read the sample report → All evaluation guidesAI Engineering · Featured
Machines and Trust: How to Mitigate AI Bias
Machines and Trust: How to Mitigate AI Bias
Unwanted AI bias is already a widespread problem. Machine learning models replicate and exacerbate existing biases — often in ways that aren't detected until after release. Here's how to detect it, me
Read the article →AI Engineering
Review the plan, not the diff: a checkpoint for coding agents
AI Engineering
Review the plan, not the diff: a checkpoint for coding agents
Oct 11, 20268 min
AI Engineering
Inter-rater agreement for LLM evals: is your human review reliable?
AI Engineering
Inter-rater agreement for LLM evals: is your human review reliable?
Oct 11, 20269 min
AI Engineering
Switching to a new LLM? Run a blinded side-by-side eval first
AI Engineering
Switching to a new LLM? Run a blinded side-by-side eval first
Oct 10, 20267 min
AI Engineering
How to write a rubric for grading AI-generated code
AI Engineering
How to write a rubric for grading AI-generated code
Oct 10, 20268 min
AI Engineering
AI coding agent spend per engineer: how to budget it
AI Engineering
AI coding agent spend per engineer: how to budget it
Oct 08, 20268 min
AI Engineering
How to A/B test an AI feature in B2B SaaS without fooling yourself
AI Engineering
How to A/B test an AI feature in B2B SaaS without fooling yourself
Oct 08, 20267 min
AI Engineering
Deleting customer data from an AI feature: the full map
AI Engineering
Deleting customer data from an AI feature: the full map
Oct 08, 20269 min
AI Engineering
Stop your AI feature from signing other people's names
AI Engineering
Stop your AI feature from signing other people's names
Oct 06, 20267 min
Hiring vs Subscription
Giving an outside AI team data access without leaking customer data
Hiring vs Subscription
Giving an outside AI team data access without leaking customer data
Oct 06, 20268 min
AI Engineering
How to red-team your AI feature in CI before attackers do
AI Engineering
How to red-team your AI feature in CI before attackers do
Oct 05, 20268 min
…
Work with Boundev
Put expert judgment to work.
Talk to our team about evaluating AI-generated code, comparing responses, and building clear rubrics.