Code · Systems · Ideas

Achint Mehta

Achint Mehta is a senior software development manager and AI security researcher — writing here about AI agents, low-level systems, and computer science. More about me

The Latest

Using a spec as a benchmark: What 90 model runs taught me about agents, prompts, and shortcuts

I ran the same OpenSpec through 90 runs across models, agents, and configurations. Some results were expected. Others were not.

29 May 2026 — 8 min read

All series
01

Introduction to AI Agents

What AI agents are, why they exist, and how to set up a local environment to start building them with LangChain and LangGraph.

02

LLM Clients and Chains

How to talk to LLMs from code, ChatOpenAI vs OpenAI, composing chains with LCEL, and the invoke, batch, and stream invocation patterns.

03

Chunking Strategies

How to break documents into retrieval-friendly chunks, fixed-size, structure-aware, language-aware splitting, and choosing the right chunk size.

All series
01

One Number Is Not a Finding

Why "the model scored 74" tells you almost nothing on its own, what runs, conditions and cells are, how much the same experiment moves when you simply run it again, and the three questions every result has to answer before it counts as a finding. With the twenty-four runs that the rest of the series will keep coming back to.

02

Middles, Spreads and Rates

The mean and the median, and the runaway token cost that pulls them apart. Trimmed, weighted and geometric means and when each one is honest. Standard deviation, the interquartile range and how to read a box plot. Then rates, which are averages in disguise, and the four ways of putting an interval on "16 out of 18", one of which claims a pass rate of 103 per cent.

03

The Claim and Its Shadow

What a hypothesis is and the four things it has to contain, why every hypothesis comes with a null hypothesis attached and why it is the null that gets tested, one-sided and two-sided claims, primary and secondary contrasts, and the six hypotheses from the verification study written out as bets, three of which lost.

All articles
All tutorials
Full timeline
01

IBM 701, The Speed Demon

IBM's first commercially available scientific computer, introduced in 1953 and born from the demands of the Korean War.

02

Fortran (1957)

The world's first high-level programming language, created by John Backus at IBM to make programming accessible beyond assembly.

03

COBOL (1959)

The business programming language born from a Pentagon-led collective effort, designed with "maximum use of Simple English" in mind.