Google's Omni line treats video as a multimodal conversation rather than a one-shot render. I spent a while going through the model card, the changelog, the pricing docs and the benchmark charts because the interesting question for anyone shipping this isn't "how good are the demos" — it's whether you can keep a usable take and steer it, instead of regenerating from scratch every time a detail is wrong.

Here's what's actually documented, and where the docs get slippery.

The spec sheet

Field Value
Developer Google DeepMind
Stable model ID gemini-omni-1.1-flash
Status / date Generally available; August 27, 2026
Context window 1,048,576 tokens
Generation inputs Text, image, video — depends on the operation
Output Video with audio
Clip length 3–10 seconds per generation
Frame rate 24 FPS
Resolutions 360p, 720p, 1080p, 4K
Default resolution 720p
1080p / 4K Upscaled, not native
Extension 10-second increments, up to 40s cumulative
Prior-video context for extension Up to 10 seconds
First-and-last-frame control Yes
Video reference for scene generation Up to 3 seconds in supported workflows
Main workflow Gemini API / Interactions API
Free tier None
Legacy preview retirement September 30, 2026

The model card advertises native text, image, audio and video input, but individual API operations accept different combinations. Don't read the family-level multimodal claim as a guarantee that every endpoint takes every modality — check per-operation.

Three numbers get conflated constantly and they measure different things: the 3-second video reference (scene generation), the 10-second prior context (extension), and the 40-second cumulative extension chain. A 10-second output clip and a 40-second chain are not the same unit of work.

Two similar-looking model IDs, two different products

This is the part that will bite you in a migration script.

# Stable, paid Gemini Developer API MODEL=gemini-omni-1.1-flash # Gemini Enterprise Agent Platform, preview MODEL=gemini-omni-1.1-flash-preview # Legacy Gemini API endpoint, retiring 2026-09-30 MODEL=gemini-omni-flash-preview 

The retirement notice applies to gemini-omni-flash-preview. It does not refer to the gemini-omni-1.1-flash-preview endpoint currently exposed by Gemini Enterprise Agent Platform. Those are separate identifiers on separate surfaces, and I've already seen people conflate them in migration checklists. Verify the request shape and the returned output before you redirect production traffic.

What 1.1 actually adds

Longer continuation context. The model now reads up to 10 seconds of prior footage when extending — previous models were described as using the final second. Extensions chain in 10-second steps up to 40 seconds cumulative. This is not a 40-second text-to-video call; it's four appended segments. Check the joins, character identity and camera movement after every step, because drift compounds.

First-and-last-frame interpolation. Supply both endpoints and let the model generate the transition. Practical for product reveals, before/after sequences, and shots that need to cut cleanly into surrounding footage.

A real draft tier. Google reports up to 60% higher system throughput at 360p versus 720p, at roughly one third of the video-output cost. That's a throughput claim, not a per-request latency promise. The workflow I'd actually run: block composition and motion at 360p, iterate on prompt and references, approve a take, then pay for delivery resolution. Count the discarded attempts when you compare cost per accepted clip.

1080p and 4K via upscaling. Default output is 720p; the higher tiers are upscaled. Higher pixel counts don't remove motion or consistency errors.

Video as reference. In supported scene-generation workflows, up to 3 seconds of reference footage can carry timing, movement and character context that a still can't.

The pricing math, worked out

Token rates on the paid tier: $1.50 per million input tokens, $17.50 per million video-output tokens, $9 per million text-output tokens.

At 720p the billing is 5,792 video-output tokens per second. That gives:

OUT_RATE = 17.50 / 1_000_000 # USD per video-output token TOKENS_PER_SEC_720P = 5792 seconds = 10 cost = seconds * TOKENS_PER_SEC_720P * OUT_RATE print(f"{cost:.4f}") # 1.0136 -> the rounded $0.10/sec launch figure 

Which explains the rounded per-second numbers:

Resolution Per second 3s 10s 40s of generated output
360p $0.03 ~$0.09 ~$0.30 ~$1.20
720p $0.10 ~$0.30 ~$1.00 ~$4.00
1080p $0.15 ~$0.45 ~$1.50 ~$6.00
4K $0.30 ~$0.90 ~$3.00 ~$12.00

These are rounded Google launch estimates multiplied by generated duration. They exclude input tokens, text output, discarded attempts, and any separately billable processing — a 40-second extension chain can carry extra context cost and isn't a flat-price package. At these numbers, drafting at 4K costs about 10× per output second versus 360p.

One thing worth repeating: the per-second rate is provider-specific. If you route the same logical model through an aggregator, the billing is that route's, not Google's — a unified multi-model API like CometAPI can be a cheaper integration path, but the underlying model version behind the route is a separate question from the price tag.

Benchmarks are family-level, not 1.1-level

The official charts identify Gemini Omni Flash without isolating a 1.1 checkpoint. Treat this as family evidence, not a measured preview→1.1 delta. Elo values are relative ratings, not percentages.

Evaluation Metric order Samples Omni Flash Seedance 2.0
Video editing overall / instruction 504 1087 / 1082 946 / 960
MovieGenBench T2V overall / instruction 1,003 1113 / 1108 1070 / 1051
Fast motion fast-motion quality 500 1050 1112
VBench I2V overall preference 355 1057 1003
Reference-to-video overall / speech / reference 468 1004 / 1028 / 962 996 / 972 / 1038

Editing and instruction following are where the family is strongest. Fast motion and reference adherence go the other way — Seedance 2.0 leads both. You can have a model that's easier to direct without it being the right pick for action-heavy or reference-strict work.

On the image-to-video chart it's 1057 for Omni, 1054 for Grok Imagine Video, 1053 for Kling v3 Pro. Three points is not a decisive quality gap, and the published charts carry no confidence intervals.

Omni 1.1 Flash vs Veo 3.1 Fast

Omni 1.1 Flash Veo 3.1 Fast
Emphasis Iterative direction, creative context Direct generation controls
Text / image input Yes Yes
Video-conditioned work References, edits, extension Depends on route
Audio output Yes Yes
Frame rate 24 FPS 24 FPS
Clip duration 3–10s 4, 6, or 8s
1080p / 4K Upscaled Supported; 8-second generation required
Extension up to 40s cumulative Supported at 720p
360p drafting Yes No documented equivalent

Pricing overlaps: tied at 720p ($0.10) and 4K ($0.30), while Veo 3.1 Fast is cheaper at 1080p ($0.12 vs $0.15). Omni's 360p tier exists for a different job — cheap iteration before you commit. Note that Veo's higher resolutions require 8-second generations and extension output is capped at 720p.

Where it breaks

Google still lists consistency, complex motion and text rendering as open limits. Longer extension chains are exactly where identity, geometry, lighting and stray objects drift, even when each individual clip looks fine. Upscaling to 4K doesn't repair any of that — inspect the scene before you treat a 4K file as a finished asset.

When I'd reach for it

If a usable take needs several rounds of direction — ad concepts, storyboards, product visualisation, short narrative — the combination of 360p drafts, keyframe endpoints and continuation is genuinely useful, because it converts "start over" into "targeted edit". If your current model already lands the clip reliably, measure the marginal value of the editing controls before you touch production traffic. And for highly dynamic action or strict reference fidelity, test the alternatives on those specific requirements rather than trusting an overall preference number.

The metric that matters isn't benchmark placement. It's accepted takes divided by total spend — retries, drafts and manual repair included.

Originally published at cometapi.com