No. 041 · Week 46 · Dan Shipper · Exploring
Gemini 4 Hydrogen Edits Sentences, Not Stories
Google's fast Gemini 4 Hydrogen handles short paragraph edits well, but trails Gemini 4 Carbon and top OpenAI and Anthropic models on whole-draft editing.
Can Google's fast, lower-cost Gemini 4 Hydrogen stand in for Gemini 4 Carbon—or top OpenAI and Anthropic models—on real editorial work?
Gemini 4 Hydrogen—Google's fast, lower-cost Gemini 4 model—edits like a sentence-level polisher, whereas Gemini 4 Carbon, Google's flagship reasoning model, and the top OpenAI and Anthropic models edit like developmental editors and fact-checkers.
Give Hydrogen a self-contained 100-word blurb to tighten and it can write clean, direct copy, sometimes getting to the point faster than Carbon. Give it a multi-page magazine draft, raw interview notes, or a subtle naming problem, and it smooths the sentences right in front of it while missing contradictions elsewhere in the piece, splicing in quotes without saying who spoke them, and defaulting to stiff corporate compounds.
We ran Hydrogen twice across 12 real editorial tasks from everyday publishing work at Every to test both its ceiling and its run-to-run consistency—tightening article openings, critiquing a 7,000-word feature draft, rewriting transitions from interview transcripts, naming an abstract concept, fixing a mixed metaphor, handling an ambiguous reader follow-up, and curating news-feed cards. Every response was graded against task-specific editorial rubrics alongside Gemini 4 Carbon, Gemini 4 Argon, GPT-6 Astra, Claude Fable 5.2, and Claude Opus 5.5.
| Model | Maker | Average Score Across 12 Editorial Tasks |
|---|---|---|
| GPT-6 Astra | OpenAI | 89% |
| Claude Fable 5.2 | Anthropic | 82% |
| Claude Opus 5.5 | Anthropic | 78% |
| Gemini 4 Carbon | 69% | |
| Gemini 4 Argon | 62% | |
| Gemini 4 Hydrogen | 51%–57% (across two tries) |
Two gaps stand out in the numbers. Inside Google's lineup, Carbon pulls well ahead of Hydrogen as soon as a job requires holding a whole document in view, with Argon landing in between at 62 percent—catching quote attribution like Carbon while sharing Hydrogen's blind spots on structural edits. Across labs, OpenAI and Anthropic still lead every Gemini 4 model by 9 to 20 points on editorial restraint.
Four Jobs Where Carbon and Frontier Models Beat Hydrogen Every Time
Across both tries, Hydrogen missed four core editorial jobs that Carbon, GPT-6 Astra, Claude Fable 5.2, and Claude Opus 5.5 handled cleanly every time:
1. Fact-checking an opening claim against the rest of the draft
One task attached a full article draft and asked the model to tighten the opening, which claimed Every's top AI user spent "more than three times as many tokens as the next-highest user" at the company. Twenty lines down, a chart caption quietly revealed the data came from "Every's OpenAI token leaderboard"—even though several coworkers profiled later in the piece did most of their work in Claude. Calling that person the company's biggest AI user overall without specifying "OpenAI tokens" was a factual overclaim. Carbon and all three OpenAI and Anthropic models caught the mismatch, either scoping the rewrite to OpenAI or flagging it for the editor; Hydrogen missed it both times, polishing the opening while repeating the unqualified company-wide stat.
2. Catching missing plot bridges in a 7,000-word feature
In two separate critique prompts on a 7,000-word magazine draft about how OpenAI built its coding agent, Codex, an OpenAI engineer says early on that "there was no decision to split off the model line"—meaning a dedicated Codex model separate from general GPT models. Thousands of words later, the draft casually refers to "the separate Codex model line" without ever explaining how or when that changed. Carbon and the OpenAI and Anthropic models flagged that missing bridge every time so a reader wouldn't get lost. Hydrogen went 0-for-4 across two prompts and two tries each, summarizing the story as written without noticing the skipped step.
3. Attributing quotes and insider claims inside the prose
Asked to rewrite a clunky transition paragraph using raw interview notes from an OpenAI researcher—where house style requires either naming the speaker in the sentence or linking quotes back to the source transcript for fact-checking—Carbon, Argon, and the OpenAI and Anthropic models all attributed the material cleanly. Hydrogen spliced the researcher's words—"never meant to be a forever thing"—straight into the paragraph in quotation marks without naming who said them or linking the source.
4. Choosing plain English words instead of consultant jargon
Another prompt described the quality an AI has when it acts as a genuine extension of your judgment, asking for a name in the same plain, everyday register as "discernment" and "coherence." The OpenAI and Anthropic models picked simple words: "fidelity," "attunement," "faithfulness," and "reach." Carbon also chose a plain single word—"Attunement"—and added the sharpest conceptual distinction among Google's models, noting that a real extension of your taste should carry your standards further without copying your blind spots. Hydrogen coined stiff two-word corporate compounds on both tries: "Extension Fidelity" and "Intent Conductivity" on its first try, and "Proxy Fidelity" on its second.
Four Gemini-Family Habits That Hydrogen, Carbon, and Argon Still Share
Even where Carbon outperformed Hydrogen on reporting, comparing all six models exposed four shared family habits where GPT-6 Astra, Claude Fable 5.2, and Claude Opus 5.5 were consistently cleaner:
- Leaning on "It wasn't X—it was Y" punchlines: Asked to draft the next scene of a feature from interview notes—with style rules explicitly calling for understatement—all three Gemini models leaned on dramatic contrast formulas (Hydrogen wrote "the shift wasn't polite supplementation—it was replacement" and "OpenAI didn't just add a coding mode to ChatGPT. It replaced..."). The OpenAI and Anthropic models let the facts land without the rhetorical drumroll. (Carbon still beat Hydrogen on the reporting itself, pulling fresh scenes from the interview notes while Hydrogen fell back into recapping earlier sections.)
- Handing back a hedged menu instead of making one call: Asked to fix a mixed metaphor in a single sentence, every OpenAI and Anthropic model committed to one primary rewrite. Carbon, Argon, and one of Hydrogen's two tries handed back categorized menus ("If you want X, use Option 1; if you prefer Y, use Option 2") instead of making a single editorial pick.
- Redoing the whole assignment on an ambiguous comment: In a follow-up turn after the model analyzed an Annie Dillard essay, the user replied with six words: "hmm it reminds me of mcdonalds." The OpenAI and Anthropic models calmly asked what connection the user had in mind or explored the comparison. Both Carbon and Hydrogen's first try assumed they were being insulted—Hydrogen opened with "Fair hit. Assuming you mean the previous answer—because it really did read like McDonald's"—and rewrote the entire literary analysis from scratch unasked.
- Filling in "TK" notes instead of cutting bloat: Reviewing an already overlong draft, the models encountered a clunky sentence containing three
(TK what they decided)("to come") placeholders about routine UI layout details already described later in the piece. Every OpenAI and Anthropic model advised cutting the sentence; Carbon, Argon, and Hydrogen's first try told the writer to fill in all three blanks.
Where Hydrogen Holds Its Own: Short, Self-Contained Copy (With High Variance)
Hydrogen wasn't weaker everywhere. On short, self-contained edits, its stronger pass matched or beat Carbon.
Asked to tighten a ~100-word paragraph answering "What is a personal benchmark?" (a custom AI evaluation built from your own work), Hydrogen defined the term in its very first sentence in a crisp 86 words. Carbon spent 50 words throat-clearing about standardized tests like the SAT before getting to the definition. Given a batch of raw team updates and pull requests to curate into four short news-feed cards, Hydrogen's stronger pass also selected higher-signal items and explained cryptic metrics in plain English where Carbon compressed them into insider shorthand.
The catch is consistency. On a companion prompt asking for a first draft of that same one-paragraph explanation, Hydrogen nailed a direct opening on one try (88 percent) and plunged to 38 percent on the next—falling into the exact same generic SAT throat-clearing trap that hurt Carbon. The same swing showed up on a single essay-introduction task launching Every's internal Slack agent: on one try Hydrogen broke mid-intro into a four-bullet marketing feature list, while on the next it wrote smooth continuous paragraphs.
Bottom Line
Use Hydrogen when speed and cost matter on self-contained 100-word copy—tightening a blurb, summarizing a feed item, or trimming a single paragraph—and be ready to run it a second time if it clears its throat. Inside Google's lineup, step up to Carbon as soon as the job requires cross-checking facts across a document, weaving in interview sources, or naming an idea in plain English. When understatement and editorial restraint matter most, GPT-6 Astra, Claude Fable 5.2, and Claude Opus 5.5 still set the bar.