Case studies / angular/angular

A real, confirmed opportunity we could not verify, and said so

REAL · CONFIRMED 5/5 RUNS · UNVERIFIABLE VIA FORK

This is not a savings-proof case study: there is no verified number here, and it should never be cited as one. What it is: a concrete example of the verification discipline itself, a real opportunity, diagnosed and re-confirmed with live data, that gets held back rather than shipped on the strength of an estimate alone, because the standard verification path structurally cannot reach it. That's a story about rigor, not about a delivered percentage.

The opportunity is real, not a dead end

The deep autoresearch loop found a genuine sharding opportunity in Angular's ci.yml: the adev job runs 161 independent test targets as one serial block, followed by adev-deploy's own production build. Composed estimate: 1386s → 666s (+51.9%) over two accepted changes. We shard-authored the first change for real: a genuine, working structural change, not a placeholder.

Then we checked whether the underlying hypothesis holds up against real data, not just the model. We pulled job-level timestamps from 5 independent real ci.yml runs.

Runadevadev-deployChainNext-longest parallel job
16:14342s723s1065s433s
14:04415s590s1005s~400s
12:39406s493s899s478s
12:25292s540s832s408s
09:51424s605s1029s387s

5 for 5. The adevadev-deploy chain dominates every single run, consistently 2×+ the next-longest parallel job. This is real, repeated evidence (not a single noisy sample) that the opportunity is genuinely there.


Why it's unverified anyway

Live verification requires pushing a candidate branch to a fork and comparing real CI runs. Two structural facts block that here, neither fixable from our side: ci.yml only triggers on push to protected branches, never on a fork's pull request; and its jobs need credentials (including deploy secrets) that don't exist on a personal fork.

We piloted against the fork-safe PR-triggered workflow instead. That came back statistically null, but root-caused, not just measured: that workflow has no deploy job at all, and its own critical path is an unrelated 111-second job. The pilot tested the wrong workflow. It doesn't disprove the real hypothesis; it couldn't reach it in the first place.

The only remaining path

Verifying against the real workflow requires push access to Angular's protected branches and Angular's own deploy credentials, i.e., landing this as a genuine pull request against angular/angular itself, not an automated verification run. That's a different, public, reputational kind of action we don't take without explicit client sign-off. What's here documents a real opportunity the verification discipline correctly declined to claim without proof, not a dead end, and not a delivered result either.

Book an engagement

← Back to case studies