Insights

Analysis, reports, and deep dives.

Confidence Thresholds for Model Escalation Routing

Confidence-based escalation keeps most requests on a cheap model and sends only the ones it is unsure about to a stronger one. This guide covers forcing a numeric confidence field with structured outputs, setting the threshold from error rates on your own traffic, tuning it against accuracy, cost, and latency, routing the escalation in your code, and re-tuning it after launch.

October 1, 2026

Cost vs. Quality Tradeoff Framework for Agent Models

The cheapest model that clears your quality bar is usually not the model at the top of a leaderboard. This framework sets the bar for one task, measures cost per quality point across a cheap, a mid-tier, and a frontier model on your own examples, and picks the cheapest one that clears the bar with margin. It uses live catalog prices and the cost each OpenRouter response reports.

October 1, 2026

Image-to-Video AI Models Compared: Cost, Resolution, and Control

If you already have the image a video should start from, the model choice comes down to what has to happen after that frame. This post compares the Veo 3.1, Seedance, Kling, and Grok Imagine Video lines on duration, resolution, first-frame and last-frame control, generated audio, reference inputs, and current per-second price, then shows how to submit an image-to-video job with the TypeScript SDK.

September 29, 2026

Best Embedding Models in 2026

An embedding model decides what your retrieval system can find. We shortlisted the embedding models in our catalog for English RAG, multilingual retrieval, code search, text-and-image retrieval, and low-cost indexing, sent live requests to each one, and recorded their prices, context windows, and default vector sizes so you can pick a candidate and test it on your own data.

September 23, 2026

Is Jev as Accurate as Frontier Models at Classification?

Claude Opus 5 leads OpenRouter's classification task ranking by spend. We sent the same 3,080 Banking77 utterances to it and to Jev 1.13 through the Decisions API. Opus scored 84.4% to Jev's 81.0%, and Jev answered in 175 ms at $0.11 per thousand requests against 2.3 seconds and $2.42 for Opus.

September 22, 2026

What Is Nemotron 3.5 Lightning

Nemotron 3.5 Lightning is NVIDIA's open-weight 30B mixture-of-experts model with about 3B active parameters per token, built for the high-volume execution calls in an agent run. This post covers what the architecture means, how the model compares with Nemotron 3 Ultra, what context and features each OpenRouter endpoint exposes, and how to call it with structured outputs.

September 22, 2026

Two Hours of Work That Takes a Week

For Descript, testing a new model was a couple of hours of work and a week of waiting. The team removed the waiting. Evaluations run in an hour or two now, and nobody has to ask an engineer for time. This post covers the queue, what replaced it, and what changed once evaluation ran several times a week.

September 21, 2026

What Is Jev? TypeSafe's Decision Model Explained for Developers

Jev reads text and returns typed answers with probabilities instead of prose. Here's what that means, three live API calls, how to read the numbers, and how to call it with an OpenRouter key.

September 21, 2026

Image Generation Models Compared: Cost, Edit, Quality

Image models are priced per token, per megapixel, or per image, so their listed rates do not compare. We sent the same prompt to 20 of them through the Image API, read usage.cost off each response, and tested text rendering, reference-image editing, seeds, and text-plus-image replies.

September 18, 2026

Does DeepSeek V4 Have Vision?

DeepSeek V4 is a family of models, and only some of them accept images. This guide maps every V4 slug on our catalog to its input modalities, shows how to send an image to the two that read images, and shows how to put a vision model in front of the text-only ones.

September 16, 2026

Zero Data Retention (ZDR): What It Means for AI APIs

ZDR means an AI provider processes your prompt, returns a response, and doesn't store either one afterward. It's a retention guarantee, not a universal privacy policy. This page explains the boundary, compares ZDR with related controls, and shows how to enforce it at the account, guardrail, or request level.

September 11, 2026

OpenRouter Fusion: How It Works and When to Use It

Fusion is our compound model. It turns one prompt into a short debate among several models: a panel answers in parallel, a judge maps agreement and disagreement, and the calling model writes the final answer. You trade some speed and tokens for quality. This is what it does, what it costs, and when to use it.

September 10, 2026

Seedance 2.5 Review: What It's Best At and When to Use It

Seedance 2.5 trades resolution for length. It runs to 30 seconds and stops at 720p. We work through what it's best at, what a clip costs at each resolution, how it compares to Seedance 2.0, Wan 3.0, and Veo 3.1 on our own catalog data, and the cases where we'd recommend a different model.

September 9, 2026

GPT 5.6 Discounts & Jevons Paradox

OpenAI introduced large discounts on their new Terra and Luna models from July 27th through August 14th. What impact did these discounts have on token volumes, total spend, and the competition?

August 25, 2026

Governing AI Spend Across a Team on OpenRouter

Your team's AI bill is the total of every key each engineer holds. OpenRouter gives you six ways to control that spend, from per-key limits to Enterprise workspace budgets. This guide explains what each control caps, what plan it needs, and which ones fit your team.

August 6, 2026

How to Evaluate LLM Provider Performance Across Latency, Throughput, and Uptime

The same model behaves differently across provider endpoints. Infrastructure, quantization, load handling, and routing defaults all change the result. Here's how to measure latency, throughput, uptime, and precision, then turn the measurements into a routing policy.

July 28, 2026

Every Modality Through One API

Chat, image generation, embeddings, and transcription usually mean four SDKs, four bills, and four auth schemes. On OpenRouter every modality runs through one base URL: you change the model string and the content type, and the same routing controls carry across.

July 16, 2026

Why Use OpenRouter for DeepSeek

DeepSeek is one model served by 16 providers, at prices that vary by about 4x and throughput from 4 to 57 tokens per second. Here's what routing that spread through one slug actually buys you, and when going direct is the better call.

July 13, 2026

Choosing the Optimal Image Input Detail Level in LLMs

We ran 1,730 visual reasoning questions across 5 models. Dropping image detail to "low" costs real accuracy, and on gpt-5.5 the bill went up too. The lever that reliably cuts cost is reasoning effort.

July 7, 2026

DeepSeek V4 Is Earning Agentic Token Share

DeepSeek doubled its token share on OpenRouter in six months. V4 Flash is the model that made it happen, and agentic workloads are driving the surge.

June 30, 2026

The Open Weight Models that Matter: June 2026

A slew of compelling open-weight models have shipped from new players in both China and the US. As of June 2026, these are the four open-weight models that matter the most — and when to reach for each.

June 27, 2026

AI Governance Checklist: Your LLM Architecture Comes First

Policy language can't show who called which model or where the audit trail lives. Map your governance checklist to the three routing postures your stack can actually prove.

June 22, 2026

How to Enforce AI Data Residency Without Building Local Infrastructure

If your procurement team flagged country of origin, you don't need to build local infrastructure. For API teams, data residency is a routing constraint you enforce in a single request.

June 22, 2026

OpenRouter vs Portkey: Which LLM Gateway for Your Team?

OpenRouter routes across providers on credits you buy; Portkey governs the provider keys you already have. Here's how they compare on models, observability, compliance, and price.

June 19, 2026

OpenRouter vs LiteLLM: Which LLM Gateway Fits Your Stack?

OpenRouter is a managed gateway; LiteLLM is a self-hosted proxy. Here's how they compare on cost, data residency, routing, and latency.

June 19, 2026

Agentic AI Governance: Your API Key Is a Guardrail

Most agentic AI governance frameworks define the rules but never enforce them. Learn how the API routing layer stops runaway spend and model escalation.

June 15, 2026

How OpenRouter Model Routing Works

OpenRouter routes every request across 70+ providers, and you control how: provider order, price ceilings, and the fallback chain. Here's how each routing layer works.

June 12, 2026

OpenRouter Reliability & Automatic Failover: How Requests Keep Succeeding

Provider failover is on by default. Model fallbacks are opt-in. The two layers recover from different failures; here's how each one works and where failover stops.

June 12, 2026

Dinner is Served

Standardizing on one LLM is like everyone at the table ordering their own entree. The case for going family style with your AI, and the OpenRouter data showing teams already do.

June 11, 2026

What Is an LLM Gateway? The Missing Layer Between Your App and AI Models

Without an LLM gateway, provider outages become user-facing errors and AI spend stays opaque. Compare the best options by routing, compliance, and setup time.

June 11, 2026

A Robot is Sprinting Towards You: Do You Want it Running on Claude or Grok?

A 30-game battle royale across eleven LLMs, $482 of inference, and one finding that should change how you read model benchmarks.

June 4, 2026

GPT-5.5 Price Increase: What It Actually Costs

OpenAI doubled per-token prices with GPT-5.5 but the model is less verbose. We measured real usage to see the net cost impact.

May 4, 2026

Opus 4.7's New Tokenizer: What It Actually Costs

Anthropic changed the tokenizer in Opus 4.7. We looked at usage that shifted from 4.6 to 4.7 to measure exactly how it affects costs.

April 27, 2026

The 2025 State of AI Report

Introducing the 2025 State of AI report, in partnership with a16z. The largest empirical look yet at how developers and organizations use language models in the real world.

December 4, 2025

Is Implicit Caching Prompt Retention?

Should customers consider providers that have implicit caching as “ZDR”?

October 23, 2025