PromptProxy

Caching and rate-limit-smoothing proxy for LLM API calls that reduces token costs for indie developers, sold as monthly SaaS. · LLM Infrastructure

STOP · SKIP

4.4 ShipScore / 10

Strongest: productized SaaS timing. Weakest: entry — free OSS gateways and native provider caching.

Condition: Only reconsider if you own a measurable cost-saving technique (semantic caching quality, cross-provider arbitrage) that free gateways cannot match, and target paying teams rather than indie devs.

Part I — The Verdict what the instruments read

01 — The ShipScore breakdown

Control

Entry barriers

Need

Time-freedom

Scale

What the five commandments measure

C — Control	Do you own the customer, or does a gatekeeper stand between you and revenue?
E — Entry	How hard is this to copy once it works? A rival's existence isn't the question — the durability of their advantage is.
N — Need	Is demand proven with money rather than vibes?
T — Time	Can income detach from your hours, or did you buy yourself a job?
S — Scale	How far does it reach without linear cost?

Scored on the evidence below, against CENTS as we've adapted it plus a Buffett-style moat reading of every rival — the same referee for every idea, including the ones we generate ourselves. The verdict follows the arithmetic: we never relabel a score to make it read better, and the weakest commandment is always named. The exact rubric stays in-house so the scale can't be written for.

02 — The pace test — $1M/yr

At $25/mo (assumed category price), you need 3,334 subscribers for a $1M/yr pace.

Nearest tracked rivals on that curve:

Headroom

$4k 5%

Part II — The Evidence the receipts, good and bad

03 — Rival scan — corpus tracks 1 similar

Headroom

verified MRR $4k (trustmrr)

Headroom — Only tracked peer, already at $4k verified MRR — proves the ceiling is low, not that it's lucrative.
LiteLLM / open-source LLM gateways — Free, self-hostable proxy with caching and rate-limit handling — your entire feature set at $0.
Cloudflare AI Gateway / Helicone / Portkey — Well-distributed gateways bundling caching, logging and rate limits, often free at indie volumes.

04 — Demand evidence

Corpus tracks exactly 1 similar product; Headroom at $4k verified MRR is the only revenue datapoint.
Zero Reddit demand signals found for these keywords — no visible complaint volume or pull.
No funded companies tracked in the corpus near this space, so no investor validation either way.
Evidence is thin overall: one small-revenue peer and silence elsewhere is weak support for recurring WTP.

05 — Risks

OpenAI and Anthropic already ship native prompt caching, shrinking the core value proposition.
Indie developers are the lowest-willingness-to-pay segment and churn when their side project dies.
A proxy sits in the critical path: one outage on your side breaks customers' apps entirely.
Savings-based pricing self-cannibalises — the better you cache, the smaller the bill you're a percentage of.

06 — Kill switches — what kills this with one decision

Model providers (OpenAI/Anthropic) API terms and key handling policy — Restricting third-party key proxying or tightening ToS makes the product unusable overnight.
Native provider-side prompt caching and rate-limit tiers — Each pricing update that caches or smooths for free erases your headline savings claim.
Cloudflare/Vercel bundling a free AI gateway into existing dev plans — Distribution-owning platforms give it away, leaving no reason to add a paid hop.

Part III — The Plan if you insist on proceeding

07 — What this scan can't tell you

Cannot tell how much real token spend an average indie dev has left to save after native caching.
Cannot measure actual churn or retention behind Headroom's $4k MRR, only the topline figure.
Cannot assess whether your caching approach has any latency or hit-rate edge over LiteLLM.

Scores judge the market and business model — not your ability to execute. Verified MRR = independently tracked revenue; reviews/upvotes = platform-reported. Judged 2026-08-04.

08 — The wedge & the next step

Skip the generic proxy; if anything, sell verified cost-reduction reporting and spend guardrails to funded AI startups whose finance team wants an audit trail, not to indie devs chasing free tools.

Cheapest next step: Post a concrete before/after token-cost teardown in two AI dev communities and count how many people ask to try it — a week of zero replies confirms the missing demand signal.

Not quite it? Spin the model

Business-model variations of this idea, engineered to beat 4.4 — different vertical, audience, model, or wedge. Same harsh scale. Pro feature.

One evidence-backed gap a day, free

This one got a skip. Every morning the engine files one mined gap that could be a yes — idea, score, and what holds it back, free at 7am AEST. Unedited, like this verdict.

Free forever · one email a day · unsubscribe in one click.

Monitor this idea

Weekly re-scan against the live corpus. If the market moves this ShipScore by a point, or flips the verdict, you hear about it. Free while we're small.