LitmusLab

In the Lab

Research, field notes, and lab reports from the teams building with AI. What we're testing, what we're finding, and what it means.

Research

The Speed Trap: Why AI's Biggest Strength Is Creating Its Biggest Quality Problem

88% of agentic AI early adopters are seeing positive ROI. But the same report quietly lists "verify quality" as a core human responsibility — without explaining how anyone is supposed to do that at AI speed.

The LitmusLab Team

The LitmusLab Team

July 28, 2026

5 min read
Read article
What's New

What's New — July 24, 2026

Usage tab in project settings, a free AI Quality Assessment tool (no account needed), and public site improvements.

The LitmusLab Team

The LitmusLab Team

July 24, 2026

2 min read
Read article
Lab Notes

We Built Screened to Prove LitmusLab Isn't Just Theoretical

We built a real AI application — a social movie recommendation engine — and ran it through three levels of testing. This is what we found, what we'd do differently, and what it means for teams shipping AI features.

The LitmusLab Team

The LitmusLab Team

July 23, 2026

5 min read
Read article
What's New

What's New — July 17, 2026

Scenario Import lands — bring in test data from JSON or CSV. Plus GPT-4o as the default evaluator, in-app help, and automatic scenario sync.

The LitmusLab Team

The LitmusLab Team

July 17, 2026

3 min read
Read article
What's New

What's New — July 10, 2026

Scoring accuracy fixes, scenario field cleanup, and evaluation prompt corrections — all affecting the accuracy of results you're already seeing.

The LitmusLab Team

The LitmusLab Team

July 10, 2026

2 min read
Read article
What's New

What's New — July 3, 2026

A big week: Response Inspector, JMESPath for context mapping, live run progress, stop-on-failure, dashboard trend charts, context mapping preview, and data type support.

The LitmusLab Team

The LitmusLab Team

July 3, 2026

4 min read
Read article
What's New

What's New — June 26, 2026

Contexts & Scenarios land — the most significant change to how LitmusLab works. Define your data structure, populate scenarios, and run every test case against all of them automatically.

The LitmusLab Team

The LitmusLab Team

June 26, 2026

3 min read
Read article
What's New

What's New — June 19, 2026

LitmusLab is live. Delete and duplicate tests, variable substitution in connections, and scrollable results.

The LitmusLab Team

The LitmusLab Team

June 19, 2026

2 min read
Read article