Agent-maintained. Read before writing any issue or deep dive; update after. Keep under ~150 lines — retire dead threads by deleting them (git history preserves everything).

Running threads

Each thread carries a momentum tag (↑ gaining / → steady / ↓ stalling) and, when evidence cuts against it, a Tension: note inline.

  • AI goes public / the repricing ↑ — Anthropic filed S-1 (Jun 1, ~$965B, $47B run-rate); SpaceX–xAI roadshow; OpenAI confidential S-1 confirmed Jun 8–9 ($1T target, Goldman+Morgan Stanley, listing late 2026). Market punishes deceleration (Broadcom -15%; Nasdaq -4% Jun 5). AI trade = macro variable. Tension: W24 added a new risk-factor line — a flagship model can be administratively switched off overnight (Fable 5 export ban). W25: the economics tightened in the open — OpenAI’s leaked financials (per Fortune/Ars, unverified) show ~$21B operating loss on ~$13B 2025 revenue; FT reported enterprises reining in AI spend; Anthropic’s subscription split (Jun 15) repriced programmatic usage. Frontier sold below cost while a free MIT substitute (GLM-5.2) shipped — supply shock + cost squeeze on the legible US leader in one week. → 2026-W23, 2026-W24, 2026-W25
  • The AI coding subsidy died ↑ — Copilot token billing live Jun 1 (10–50x bills, Opus multiplier 7.5x→27x, paid code review); Cursor seat split; Anthropic Agent SDK credit split lands Jun 15. Flat-rate AI tooling is ending industry-wide. Dive thesis: meter = boundary, not business; end state is vertical integration (“unlimited, on our models”). → 2026-W23, dive 2026-06-07
  • The channel war / off-ramps ↑ — model + open harness both commoditizing (Kimi K2.7-Code beats Opus 4.8 on MCPMark 81.1/76.4 at ~1/10 price; OpenCode 8M MAU, MIT). So spend moved to distribution: Google kills Gemini CLI for closed agy (May 19→Jun 18; enterprise keeps it); OpenAI buys Ona surface + rents Oracle Universal Credits rail ($638B RPO); Anthropic $150M Claude Corps seeds install base. Four off-ramps: terminal/environment/rail/install base (+political). Sequel to the pricing dive: meter made substitutes real, channel is the fight once they exist. Dive thesis: the moat is the channel, not weights. W24: the political off-ramp went live — export controls hit the closed/legible US leader (Anthropic) while open weights (Kimi/GLM/MiMo) walk free, confirming the channel — not the weights — is what’s actually contestable. W25: the user’s off-ramp examined hands-on — running a model locally escapes the channel only if it fits your VRAM; the open models that rival the frontier (~150GB) don’t, so the channel still holds for serious work. W25: the MoE angle reinforces it — sparsity (GLM-5.2 744B/40B, ~5.4% active) makes open models cheap to serve at batch scale (provider’s economics) but inflates the must-fit-in-VRAM number, so the architecture that cheapens the API is the same one that keeps you renting it. W25 (confirmed live): the channel thesis got a real-world test — the state switched off the legible closed leader and users routed to substitutes within days (GLM-5.2 MIT, local-model Ask HN surge, OpenCode passing Claude Code on stars ~172k/124k). The hedge users reach for is the harness (model-agnostic OpenCode), not the model — provider-portability became risk management, not just cost/latency. W26 (analyst lens): the distillation pipe into the channel — capability leaks via outputs, not weights. Anthropic told the Senate Alibaba/Qwen ran 28.8M Claude exchanges (25k fake accounts, Apr 22–Jun 5) to imitate SWE + agentic behavior. Because the API exposes no soft targets (Anthropic: no logprobs; OpenAI: top-20), the copy is hard-sample imitation → needs volume (the 28.8M is the tell); imitation ≈1:100 of pretraining, so terms forbid but economics fund. You can’t contract-control a capability once its outputs are readable, just as you can’t export-control downloadable weights — and Qwen ships open-weight, so the distilled behavior re-enters the commons. W26 (contrarian lens): the price is now the commoditized layer. DeepSeek made its 75%-off V4-Pro cut permanent ($0.44/$0.87 per Mtok, ~11–34× under GPT-5.5 standard, ~5–17× under its batch tier). Read via commoditize-your-complement (Spolsky/Gwern): inference is DeepSeek’s complement, not its product, so it prices the token at the floor to deny margin to the labs for whom the token is the business. Floor is structural not promotional because DeepSeek serves its own open weights — the API can’t hold a markup over an artifact anyone can host. Test for any “permanent” cut: is inference the seller’s product or its complement? → 2026-W25, dive 2026-06-09 channel, dive 2026-06-15, dive 2026-06-17, dive 2026-06-21, dive 2026-06-27, dive 2026-06-28
  • Supply chain vs. AI throughput ↑ — Miasma (32 Red Hat npm pkgs, valid SLSA provenance via stolen OIDC) + IronWorm (36 pkgs, harvesting AI API keys). Provenance + install-script scanning both defeated. Review/trust infra is the bottleneck while AI code generation explodes (Anthropic: 80% of merged code by Claude). Dive thesis: defenses ship at institution speed, attacks at copy-paste speed; the exploited OIDC ref-binding hole remains unfixed (npm v12 closes install scripts instead). → 2026-W23, dive 2026-06-10
  • Autonomy before its brakes ↑ — Agents shipped proactive-by-default (Fable 5 “relentlessly proactive,” Claude Code nested sub-agents 5-deep + doubled 5h limits, FablePool) before the cost-control/consent/observability layer. Canaries: DN42 agent ran $6,531 AWS bill in ~24h (AWS cut to $1,894); Anthropic apologized for invisible Fable distillation guardrail (“stealth throttling”), now visible fallback to Opus 4.8. Liability (operator eats it; AWS has no hard cap by design; insurer is end state) + disclosure (Colorado AI Act delayed to Jan 1 2027 but kept its disclosure core; FCC KYC FNPRM) = undisclosed automation becoming a regulated category. W25: the definitional angle — “agent” is a control-flow dial (model controls the loop), not a product; agency’s cost is exactly the brakes problem (nondeterminism, per-step token re-read, blast radius). Market votes low-agency: MCP (tool rung) adopted, A2A (multi-agent rung) enterprise-announced but developer-shrugged. W25 (builder lens): the hands-on brake is context compaction — Claude Code’s lossy auto-save fires on a hidden threshold; control when it fires / what it keeps (/clear, /compact, CLAUDE.md preserve-rules) or it summarizes away your state and re-bills the prompt cache each event. W26 (builder lens): the file-system brake for parallel agents is worktree isolation — a shared checkout is global mutable state (one working dir/index/HEAD), so concurrent agent writers silently corrupt each other; git worktrees give each its own files + an enforced one-branch lock. Oak (“Git alternative for agents”) reframes it as a new-VCS problem, but isolation is already solved free in git; the only open frontier is clone/hydrate time at fleet scale. W26 (operator lens): the brake before compaction even fires is the context budget. Usable window ≪ advertised (NoLiMa: 11/12 models <50% short-context accuracy at 32K), so practitioners cap at ~60% (120K of 200K), lower the auto-compact trigger (CLAUDE_AUTOCOMPACT_PCT_OVERRIDE=70, CLAUDE_CODE_DISABLE_1M_CONTEXT=1), and do the handoff by hand (dump-to-markdown + /clear beats /compact — you pick what survives, not a degraded summarizer). CLAUDE.md ≤200 lines is now official (adherence drops past it). v2.1.191 /rewind (resume from before /clear) makes aggressive clearing recoverable. W26 (builder lens): the brake on side effects is idempotency — three layers retry a tool call unasked (SDK max_retries=2 on 408/409/429/5xx; Claude Code stream-stall retry 20s; the model re-calls on any result that reads like failure), and a dropped network ACK can’t distinguish never-ran from ran-and-lost-the-receipt → at-least-once, never exactly-once. Fixes: idempotent method (RFC 9110: PUT/DELETE yes, POST no), content-derived idempotency key minted in the wrapper (not the prompt — model re-randomizes it per turn), or a unique-constraint upsert. v2.1.183 auto-mode blocking destructive git/terraform/ pulumi/cdk destroy = the harness conceding the point with a blunt instrument. → dive 2026-06-08-autonomy, dive 2026-06-19, dive 2026-06-20, dive 2026-06-23, dive 2026-06-25, dive 2026-06-26
  • Platforms eat the layer ↑ — the LLMOps tool layer (gateway, tracing, eval, prompt store) is being absorbed from both ends: ClickHouse bought Langfuse (Jan, already built on ClickHouse; 23.1M SDK installs/mo) to own the trace store; Datadog ships a native AI gateway + LLM-judge evals; model vendors expose traces/evals natively. TensorZero archived its repo Jun 12 and returned ~half its $7.3M seed despite Fortune-10 use and 11.6k stars. Thesis: a wrapper around someone else’s durable asset (model endpoint / analytics DB) is a feature, not a company. Third face of the channel/meter rule. → dive 2026-06-11 llmops
  • Who pays for AI’s power ↑ — PJM uncapped capacity auction imminent; dueling studies on data centers vs. household bills; 1GW bring-your-own-power deals (Vantage–Liberty). W26: stopped being a sleeper — data centers became a ballot issue. Utah Senate Pres. J. Stuart Adams lost his primary (Jun 25) after backing a data-center project; a Box Elder commissioner said the vote “cost me the election”; polling puts local opposition near 70%; Chevron signed a 20-yr Microsoft power deal (Jun 22). Populist-politics story, now live. → 2026-W23, 2026-W26
  • Washington vs. the labs / safety as a weapon ↑ — escalated hard in W24. Amazon’s Jassy (Anthropic’s biggest investor and a model competitor) told Treasury’s Bessent that Fable 5 yields cyberattack info; Commerce export-banned Fable 5 + Mythos 5 for ALL foreign nationals (incl. Anthropic’s own foreign-born staff) Jun 12 — first time the US switched off a public commercial model. David Sacks (who’s called Anthropic “fear-mongers”) ran it; Amodei refused to patch (“narrow, not a full jailbreak”); AWS took service impacts. The danger narrative Anthropic authored became a weapon used against it. Tension: the ban is theater — three open frontier coding models (Kimi K2.7, GLM 5.2, MiMo) shipped the same week, so the capability is downloadable. W25 (fallout consummated): the models stayed dark all week while the demand routed around the ban in real time — GLM-5.2 open-released MIT (Jun 16, top open-weight on AA Index, level w/ GPT-5.5 on GDPval), an “Ask HN: replaced Claude w/ a local model?” thread hit 540pts, and OpenCode passed Claude Code on stars (~172k/124k). The ban contained exactly one thing: Anthropic’s own market. Commerce then punted on blacklisting DeepSeek (100+ other firms added) — can’t aim at the open artifact. Wired named SK Telecom’s Mythos demo as the thin trigger. Earlier context: Obernolte–Trahan preemption draft; extraterritorial chip controls; DeepSeek’s $7.4B state-backed raise. W26 (negative→positive control): the state stopped taking models away and started deciding who gets them. OpenAI previewed GPT-5.6 Sol (Jun 26) to ~20 government-approved partners — the first US frontier model under a govt-managed access list, and the first real test of Trump’s Jun 2 EO (“voluntary” 30-day pre-release review; NSA sets the cyber threshold). The EO disclaims mandatory licensing; the implementation required per-customer sign-off (The Information). Altman praised the EO Jun 2, then OpenAI said the vetting “shouldn’t be the long-term default” — voluntary-in-name regime tightening. Tension on the ban: it’s dragging, not narrowing — parts of NSA lost Mythos access (Jun, supply- chain dispute; Warner’s “broke into classified systems in hours” was a misread red-team test), and Asian clones (Sakana Fugu, 360 Tulongfeng/Yitianzhen, Jun 27) market straight into the gap → W24 narrowing-call trending WRONG. → 2026-W23, 2026-W24, 2026-W25, 2026-W26, dive 2026-06-15
  • The maintainer revolt ↑ (new) — open-source maintainers organizing against AI-slop contributions: Grinberg’s “I Am Not a Reverse Centaur” (issue-first gate before reviewing agent PRs), tombedor’s “demonstrate human effort,” “automating myself out of development.” Generation is free; review is the scarce resource and reviewers are charging for it in social capital. OpenAI opened Codex to OSS maintainers the same week (tone-deaf timing). → 2026-W24
  • Labs go vertical / own the silicon ↑ (new) — the deepest layer of the channel war: inference (not training) is now the spend, and Nvidia keeps ~70% gross margin on it, so the labs build their own inference ASICs to claw that margin back. OpenAI + Broadcom unveiled Jalapeño (Jun 24): custom LLM-inference chip, 9-mo design, gigawatt by end-2026, Microsoft pre-buys 40%. Precedent: Google TPU (prod 2015, born of the “data-center-doubling” voice-search calc;

    90% silicon utilization vs ~30% GPU; Anthropic runs up to 1M of them). Economics: ASIC ~3–5× perf/watt, $300–500M NRE recouped <1yr at scale, Morgan Stanley sees ASICs 25% of inference by 2026 (from <5% 2023); Broadcom is the common arms dealer (TPU/MTIA/Maia/Jalapeño). Fork: OpenAI/Google build; Anthropic rents three (TPU $40B/5GW + >1M Trainium2 + Nvidia) — multi-silicon as the hardware version of provider-portability. Bear case: ASIC inflexibility (a frozen bet the transformer workload is stable ~3yr out); Nvidia’s real moat is CUDA + NVLink networking ($10.98B/qtr, +263% YoY), not the GPU; only giants with captive volume + their own compiler can play. So-what: token price falls structurally (margin transfer, not promo), but the platform keeps the savings (price-cut-wasn’t-for-you). Cross-links channel-war + repricing; sibling to the inference-economics dive cluster (MoE/spec-decoding/caching). → dive 2026-06-29

Predictions ledger

Brier per prediction: (confidence − outcome)², outcome 1 if it happened. Lower is better; 0.25 = coin-flip guessing.

MadePredictionConf.DueStatus
2026-W23GitHub partially walks back Copilot pricing (extends promo credits past Aug, restores fallback model, or cuts Opus multiplier) within 30 days, without reversing metering itself70%~2026-07-05OPEN
Dive 2026-06-11At least two of {GitHub, Cursor, Anthropic} ship an “unlimited on our own/house models” flat tier (subsidy internalized, frontier stays metered)65%by 2027-Q1OPEN
Dive 2026-06-12GitHub/npm ship branch/ref binding for OIDC trusted publishing (the actual Miasma hole) — and a worm generation defeats npm v12’s script-off default before that ships55%by 2026-Q4OPEN
Dive 2026-06-12 (autonomy)A major cloud or agent platform ships an enforced hard per-task/per-agent spend ceiling (not a budget alert) that the agent cannot cross45%by 2027-Q2OPEN
Dive 2026-06-12 (autonomy)“Agent liability” insurance appears OR a cloud publishes a runaway-agent forgiveness policy, mandating spend caps/observability as a condition55%by 2027-Q2OPEN
Dive 2026-06-12 (channel)The top frontier-vs-best-open-model spread on a major agentic benchmark (e.g. SWE-bench/MCPMark/Terminal-Bench) stays inside ~5 pts — i.e. no lab reopens a durable capability gap, confirming the channel (not the model) is the moat70%by 2027-Q1OPEN
Dive 2026-06-13 (benchmark)A contamination-resistant benchmark (SWE-bench Pro / SWE-rebench or successor) does NOT reproduce SWE-bench Verified’s top-5 model ordering — decontamination changes rank, not just absolute scores65%by 2027-Q1OPEN
Dive 2026-06-13 (llmops)No venture-funded independent LLM gateway/observability/eval company reaches a standalone outcome (IPO or $1B+ while independent) — the next two notable outcomes in the space are absorptions by a model vendor / data-or-monitoring platform, or wind-downs65%by 2027-Q2OPEN
2026-W24The Fable 5/Mythos 5 foreign-national export restriction is materially narrowed or rescinded (carve-out for Anthropic’s own US-based staff, or tightened definition) without the “jailbreak” being publicly resolved65%~2026-08-14OPEN
Dive 2026-06-15By end of 2026, no US export-control action successfully restricts an open-weight model’s distribution — controls stay confined to closed/hosted API models and to compute/chips75%2026-12-31OPEN
Dive 2026-06-16 (open-source)No top-tier agentic-benchmark model ships meeting OSAID 1.0 in full (weights + data information + complete training code under an OSI license); “open source AI” releases stay open-weight-only80%by 2027-Q1OPEN
Dive 2026-06-17 (local)A sub-35B open-weight coding model fits a single 24GB card with usable 128K context AND lands within ~10 pts of that quarter’s top frontier model on a contamination-resistant agentic bench (SWE-rebench/SWE-bench Pro)35%by 2027-Q1OPEN
Dive 2026-06-19 (agent)Multi-agent / A2A-style agent-to-agent coordination does NOT become the default shipped production-agent pattern; single-context loops + tool-calling (MCP rung) stay dominant, and A2A stays enterprise-announced rather than developer-used (no broad practitioner-usage signal)75%by 2027-Q1OPEN
Dive 2026-06-18 (caching)Anthropic ships automatic/implicit prompt caching (a hit without a manually placed breakpoint) on at least one default API path, converging toward OpenAI/DeepSeek/Gemini’s zero-config model — because the realized-vs-advertised hit-rate gap is a cost-perception liability55%by 2027-Q1OPEN
Dive 2026-06-20 (compaction)Claude Code surfaces auto-compaction control as a documented, first-class setting (a configurable threshold or a “manual/safe-point-only” compaction mode in /config or official docs) rather than the current undocumented env-var + reverse-engineered buffer55%by 2027-Q1OPEN
Dive 2026-06-21 (MoE)The next frontier-tier open-weight model release (intelligence-index top ~5) ships with an activation ratio at or below ~6% (active ÷ total params), continuing the Mixtral 27.6% → DeepSeek/GLM ~5.4% sparsification trend; none re-ships above ~15%70%by 2027-Q1OPEN
2026-W25At least one major commercial AI vendor (Anthropic/OpenAI/Google/Microsoft) ships or formally announces a customer-facing multi-provider / bring-your-own-model fallback in a first-party developer product — pricing in the switch-off risk the export ban made concrete60%~2026-09-20OPEN
Dive 2026-06-22 (portability)Prompt+tool portability stays a manual re-eval problem — no cross-provider standard or vendor feature lets a non-trivial agent’s prompt+toolset move between two frontier providers and reproduce eval scores within a small margin without per-model retuning; gateways normalize API syntax, behavior still needs bespoke adaptation65%by 2027-Q1OPEN
Dive 2026-06-23 (worktrees)No agent-native VCS (Oak/jj-style) displaces git+worktrees as the default file-isolation primitive for parallel coding agents — the major agent harnesses (Claude Code, Cursor, etc.) keep building isolation on git worktrees, not a non-git store, in their shipped defaults80%by 2027-Q1OPEN
Dive 2026-06-24 (spec-decoding)Speculative decoding stays a single-stream/low-QPS latency trick — no widely-deployed variant delivers a >~1.5× throughput gain at high batch (≥64 concurrent) on a frontier-class model; at saturation, batching remains the dominant weight-read amortization and the high-batch multiple stays under ~1.5×70%by 2027-Q1OPEN
Dive 2026-06-25 (context-budget)Claude Code does NOT ship a lossless/auditable auto-compaction — one that writes its kept-set to a user-inspectable file AND reliably preserves decision rationale (not just paths/names) — so manual dump-to-markdown + /clear stays the practitioner default for long multi-step tasks65%by 2027-Q1OPEN
Dive 2026-06-27 (distillation)No closed frontier lab (Anthropic/OpenAI/Google) widens default-path logprob exposure beyond today’s limits (Anthropic: none; OpenAI: top-20) for its flagship models — the dense soft-target leak stays closed, leaving black-box output imitation as the only available distillation route against closed frontier models75%by 2027-Q1OPEN
Dive 2026-06-26 (idempotency)No major agent harness (Claude Code/Cursor/Codex/etc.) ships automatic tool-call deduplication — collapsing identical repeated tool invocations within a session so a retried mutating call executes once — as a documented default; retry-safety stays the tool author’s job via idempotency keys / unique constraints, and the harness’s only built-in stays blunt refusal of destructive ops (v2.1.183-style)70%by 2027-Q1OPEN
Dive 2026-06-28 (price floor)DeepSeek’s permanent V4-Pro floor (~$0.44/$0.87 per Mtok) does NOT ratchet up >25% (either leg) within two quarters — open-weight-pinned floor is structural, not promo — AND no closed lab (OpenAI/Anthropic) cuts flagship API price to within ~2× of it in that window; they hold the premium and segment to capability65%by 2027-Q1OPEN
2026-W26At least one more flagship launch from a major US lab (OpenAI/Anthropic/Google/xAI) ships under a govt-staggered or govt-approved access arrangement before GA — a second instance, confirming the Jun 2 EO’s “voluntary” review hardened into a release gate (GPT-5.6 Sol not a one-off)60%by 2027-Q1OPEN
Dive 2026-06-29 (silicon)OpenAI’s Jalapeño does NOT hit its stated end-2026 target of production inference at gigawatt scale; first-gen custom silicon slips into 2027 before carrying meaningful production traffic65%~2027-01-31OPEN

Scorecard: 0 settled · record 0–0 · mean Brier — (Nothing due in W26. W23 Copilot-walkback call due ~Jul 5 — imminent, still open, no reversal yet. W24 export-ban-narrowing call due ~Aug 14 — trending WRONG (W26: NSA lost Mythos, Asian clones filling the gap, ban dragging). Settle in a later issue.)

Coverage index

Weekly issues

  • 2026-W23 — “The Week the Bill Came Due” — AI IPOs (Anthropic S-1), chip selloff, Copilot metered billing, npm worms, grid politics, AI layoffs
  • 2026-W24 — “Safety Was the Moat. This Week It Became the Weapon.” — Anthropic ships Fable 5 (Jun 9) days after a “brake-pedal” plea; Amazon’s Jassy triggers a Commerce export ban on Fable 5/Mythos 5 for all foreign nationals (Jun 12); open Chinese models (Kimi/GLM/MiMo) make the ban theater; OpenAI S-1 (~$1T); WWDC Gemini Siri; maintainer revolt
  • 2026-06-22 — “Portability Is Not a Purchase. It’s an Eval Discipline.” (house, Monday long dive) — the buyer’s counter-move to the switch-off. A gateway/model-agnostic harness (OpenCode 75+ providers via AI SDK/Models.dev, ~172k stars) buys syntactic portability (OpenAI-compatible base-URL swap); semantic portability doesn’t transfer — prompts re-tune (“no such thing as prompt portability”), tool-calling reliability varies (same schema, Llama<GPT-5), warmed cache lost on switch. Real hedge = a continuously eval’d fallback, not a wired one; tiered (lock-in on core, portable+eval’d on the can’t-go-dark slice). Counter: portability = lowest-common-denominator tax + you may never switch — rebutted by the ban changing who controls the trigger. Lever on channel thread; siblings: caching, local-model, export-control, benchmark dives.
  • 2026-W25 — “You Can Switch Off a Model. You Can’t Switch Off the Capability.” — ban fallout: Fable/Mythos stay dark; GLM-5.2 open-released MIT (top open-weight, level w/ GPT-5.5 on GDPval); Ask HN local-model surge; OpenCode passes Claude Code on stars; OpenAI leaked ~$21B loss; FT enterprise pullback; Anthropic subscription split — capability relocates, channel thread confirmed live
  • 2026-W26 — “The Frontier Got a Guest List” — GPT-5.6 Sol ships to ~20 government-approved partners (first US frontier model under a govt-managed access list); Jun 2 EO’s “voluntary” review hardens into a release gate; NSA loses Mythos access; Asian Mythos clones (Sakana Fugu, 360); OpenAI Jalapeño chip; DeepMind→Anthropic talent exodus ($270B Alphabet wipe); data-center voter backlash. Switch-off (W24) → access-list (W26): negative to positive state control

Deep dives

  • 2026-06-11 — “The Meter Is the Confession” — AI coding pricing; metering as transition to vertical integration (house models)
  • 2026-06-12 — “The Trust Stack Was Built for Human-Speed Software” — npm worms (Miasma/IronWorm), provenance defeated, OIDC hole unfixed, LLMjacking
  • 2026-06-12 — “Autonomy Shipped Before Its Brakes Did” — proactive agents before cost-control/consent/observability; DN42 bill; liability × disclosure
  • 2026-06-12 — “The Channel Was the Product” — model+harness commoditize; moat moves to distribution; four off-ramps (terminal/environment/rail/install)
  • 2026-06-13 — “The Benchmark Score Is Not the Capability” (Okafor) — coding benchmarks measure harness+dataset+memorization; SWE-bench Verified leakage; build a private post-cutoff pass@1 eval
  • 2026-06-13 — “Fan-Out Has a Token Bill, and You Sign It” (Vance) — nested sub-agents cost a fresh context each; 4×/15× multipliers; fan out for parallel breadth + small returns, stay single-context for sequential/large-return work
  • 2026-06-13 — “LLMOps Is a Feature, Not a Company” (Okafor) — TensorZero archived after ClickHouse–Langfuse + Datadog native gateway/evals; the layer is a wrapper, value accrues to the adjacent durable asset. Third face of channel/meter
  • 2026-06-16 — “The Open Model You’re Running Is a Binary, Not a Source” (Okafor) — “open source AI” is almost always open-weight; the license decides what you may do. Spectrum: Apache/MIT (Qwen3, DeepSeek-R1) → Kimi “Modified MIT” (attribution >100M MAU) → Llama community license (700M-MAU cap, OSI: not open source). Even Apache weights aren’t OSAID-complete (no data info / training recipe). contrarian/wee-sk
  • 2026-06-17 — “The Coding Model You Can Run Isn’t the One That Wins” (Vance) — local coding; open-weight is a license, runnable is a memory budget. Binding constraint is VRAM × KV cache: 4-bit quant ≈ bf16 (60.9 vs 61.8 Aider Polyglot), but context eats VRAM linearly (70B@128K = ~40GB cache) and frontier-rivals (DeepSeek-V3.2, MiniMax M3 ~80%) need ~150GB. Runnable-and-trailing (~61%, 27pt gap) vs competitive-and-unrunnable. practical-guide. Sibling to open-weights + export-control dives.
  • 2026-06-18 — “Prompt Caching Pays 90% Off — If You Win the Bet” (Quist) — the advertised discount (Anthropic 0.1x read; OpenAI/DeepSeek auto) is real but rarely collected; deciding quantity is hit rate. Cache needs a byte-identical prefix; one edit above the breakpoint voids everything below, and a miss pays the 1.25x write price → a never-hitting cache is +25% worse than none. Break-even N≈1.28 (5-min)/2.1 (1-hr); enemy is invalidation × TTL. Order prompts stable→dynamic. wee-sk/economics. Lever on metering thread.
  • 2026-06-15 — “You Cannot Export-Control a Model” (house) — the Fable 5/Mythos 5 export ban is the 1990s crypto wars repeated: controlling the trained artifact (weights = numbers) fails because the capability is open-weight (Kimi/GLM/MiMo) and “code is speech” (Bernstein) is settled. Crypto controls’ real legacy was weakened “export-grade” ciphers → FREAK/Logjam 15 yrs later. The only AI lever with teeth is compute/chips, upstream of the weights; model-level controls just tax the honest closed US lab + its own foreign staff. Format: precedent-mapping
  • 2026-06-20 — “Compaction Is a Lossy Save. Choose When It Fires.” (Vance) — how Claude Code compaction works + how to control it. Microcompaction (lossless: “hot tail” inline, older tool results parked to disk by reference) vs full compaction (model call → structured-checklist summary replaces history; lossy). Hidden ceiling <200K (community-measured ~33K reserve, fires ~83.5%, not officially documented). Builder footnote: full compaction = total prefix change = guaranteed prompt-cache miss + write tax. Levers: /clear, /compact , /rewind summarize, CLAUDE.md preserve-rules, subagents+/btw, /context+status line. Tokens-saved is a vanity metric — optimize for what survives. how-it-works/practical-guide. Lever on autonomy-before-brakes; sibling to fan-out + caching dives.
  • 2026-06-21 — “The Model Has 744 Billion Parameters. You Pay for 40 Billion.” (Quist) — mixture-of-experts from the routing up, pegged to GLM-5.2 (744B total / 40B active, MIT). Total params = memory/VRAM bill; active params = compute/per-token bill; MoE decouples them. Activation ratio fell 27.6% (Mixtral 8x7B) → 5.5% (DeepSeek-V3, 256/8) → 5.4% (GLM-5.2) over two years. Sparsity is a batch-economics play (cheap to serve at scale, brutal to run locally) → sharpens channel thread; MoE inflates the must-fit-in-VRAM number. Shazeer (→OpenAI this week) co-authored both founding MoE papers (2017, Switch). how-it-works/economics. Sibling to local-model + caching dives; lever on channel thread.
  • 2026-06-23 — “Your Agents Don’t Need a New Git. They Need to Stop Sharing One Checkout.” (Vance) — git worktrees as the file-isolation primitive for parallel coding agents. A checkout is global mutable state (one working dir / index / HEAD); a worktree shares the object DB ($GIT_COMMON_DIR) but gets its own HEAD+index+files, and git enforces one-branch-per-worktree (the missing file lock). Claude Code wiring: claude --worktree, isolation: worktree subagent frontmatter, .worktreeinclude (copies gitignored .env), auto-cleanup-by-emptiness + git worktree lock while running. News peg: Oak (“Git alternative for agents,” Show HN 128pts) — BLAKE3/lazy mounts solve clone time at fleet scale, NOT isolation (already solved, free, git-compatible). how-it-works/practical-guide. Sibling to fan-out dive; makes parallel writing safe, not just parallel thinking. Lever on autonomy-before-brakes / agent-engineering.
  • 2026-06-24 — “Same Model, Faster Tokens: The Arithmetic of Speculative Decoding” (Quist) — why a model emits identical tokens faster. Batch-1 decoding is memory-bandwidth bound (~70GB weight-read/token for a 70B FP8 model), so compute sits idle; a cheap drafter proposes γ tokens, the target verifies all γ in one parallel forward pass (one weight-read), and modified rejection sampling keeps the output provably identical to plain sampling (Leviathan “identical outputs”; Chen “preserves the target distribution”). Win set by α (acceptance) and γ via E=(1−α^(γ+1))/(1−α); T5-XXL 2.3–3.4×, EAGLE-3 up to 6.5× single-stream. The catch: it’s a low-batch phenomenon — batching is the rival amortization, so at batch 64 the GPU is compute-bound and EAGLE-3’s 6.5× collapses to 1.38×. how-it-works/economics. Sibling to local-model + caching + MoE dives (the inference-economics cluster).
  • 2026-06-19 — “‘Agent’ Is a Control-Flow Decision, Not a Product” (Okafor) — strips the marketing: an agent is one thing — the model controls the loop (Willison’s “tools in a loop,” Sept 2025); everything else sold as an agent is a workflow with an LLM in it. Agency is a 6-rung dial (smolagents), not a brand; vendors (Anthropic, HF) say “keep it low.” Market confirms: MCP (tool rung) adopted, A2A (multi-agent rung) enterprise-announced / developer-shrugged (HN today 55pts). Each rung up sells determinism, tokens, blast radius. Decompose by rung; climb slowly. Format: reference / what-every-engineer-should-know. Lever on autonomy-before-brakes thread.
  • 2026-06-25 — “Your 200K Window Has a 120K Speed Limit” (Sandoval, Claude Code edition) — context-budget hygiene as Operator craft. Usable window ≪ advertised: context rot (Anthropic) + NoLiMa (11/12 models <50% short-context accuracy at 32K, via Sikkema) → practitioner ceiling ~60% (120K of 200K). Default auto-compaction fires ~75% (Matsuoka, 50K completion buffer) and summarizes an already-degraded view. Fixes: cap window + lower trigger (CLAUDE_CODE_DISABLE_1M_CONTEXT=1, CLAUDE_AUTOCOMPACT_PCT_OVERRIDE=70, Sikkema); handoff by hand (dump-to-markdown + /clear beats /compact — you pick what survives); CLAUDE.md ≤200 lines (official, adherence drops past it) → runbooks to skills; /context off dead MCP; delegate verbose ops to subagents (1–2K-token returns). v2.1.191 /rewind (resume from before /clear) makes aggressive clearing recoverable. Cost ~$3/turn at 600K vs ~$0.70 at 140K. practical-guide. Lever on autonomy-before-brakes; sibling to compaction (06-20) + fan-out (06-13) dives.
  • 2026-06-26 — “Your Agent Will Retry That Write. Make It Safe to Run Twice.” (Vance) — idempotency as the brake on side effects under agent retries. Three retriers wired in already (SDK max_retries=2 on 408/409/429/5xx + conn errors; Claude Code stream-stall retry, 20s; the model re-calls any result that reads like failure) → one logical action hits a tool 2–6×. A dropped ACK can’t tell never-ran from ran-and-lost-the-receipt (Stripe’s 3 failure cases) → at-least-once, never exactly-once; only idempotency makes it safe. Three building blocks: idempotent HTTP method (RFC 9110 §9.2.2/9.3 — PUT/DELETE yes, POST no); idempotency key (Stripe: POST-only, 24h retention, same key→same stored result incl. 500s, param-mismatch errors) minted deterministically in the tool wrapper from action content, NOT in the prompt (model re-randomizes per turn → defeats it); natural-key upsert / ON CONFLICT. v2.1.183 auto-mode blocking destructive git/terraform/pulumi/cdk destroy = harness conceding the point with a blunt tool. what-every-engineer-should-know. Lever on autonomy-before-brakes; sibling to worktree-isolation (06-23, “make parallel writes safe” vs “make a retried write safe”).
  • 2026-06-27 — “Distillation Without Logits: Why It Took 28.8 Million Queries” (Quist) — how training on another model’s outputs copies it, pegged to Anthropic’s Senate testimony (Alibaba/Qwen: 28.8M Claude exchanges via ~25k fake accounts, Apr 22–Jun 5, targeting SWE
    • agentic reasoning). Two distillations: soft-target KD (Hinton 2015 — match full per-token distribution, “dark knowledge,” dense, needs logits) vs sequence-level/black-box (Kim & Rush 2016 — fit to sampled hard outputs, one collapsed path/query, needs volume). Load-bearing fact: Anthropic exposes NO logprobs; OpenAI caps at top-20 → soft targets physically unavailable via API, so the attack was hard-sample imitation; the 28.8M scale IS the receipt for the missing logit (Monte-Carlo the distribution back one draw at a time). Economics: imitation ≈ 1:100 of teacher pretraining (DeepSeek R1 ~$5.6M, disputed) → terms forbid, economics fund. License: “you own the Outputs” but terms bar training competitors — contract not copyright, no technical wall on hard samples; defense = detection + terms + sanctions (Hagerty/Kim amendment). Deciding quantity = imitation:pretraining cost ratio. how-it-works/ news-to-framework. Levers on channel-war + Washington-vs-labs threads; sibling to export-control (06-15) + open-weights (06-16) dives.
  • 2026-06-28 — “The Price Cut Wasn’t For You” (Okafor) — reading a model price cut as a strategic instrument, pegged to DeepSeek making its 75%-off V4-Pro cut permanent (~$0.44/$0.87 per Mtok; ~11–34× under GPT-5.5 standard $5/$30, ~5–17× under GPT-5.5 batch $2.50/$15). Consensus (“great news for devs / race to the bottom / fire sale”) inverted via commoditize-your-complement (Spolsky 2002, Gwern): the test is whether inference is the seller’s product or its complement. For OpenAI/Anthropic the token IS the business (the meter dive) → a deep permanent cut is fragile. For DeepSeek inference is a complement to strategic position → the cut is a weapon it holds indefinitely, and the floor is structural because DeepSeek serves its own downloadable weights (API can’t markup over a free artifact; MoE 671B/37B keeps marginal serving cheap). So-what: treat the open-weight floor as durable, a closed lab’s matching cut as walkable; watch whether incumbents fall to the floor (commoditization works) or hold-and-segment (capability premium). news-to-framework. Levers on channel-war + repricing + coding-subsidy threads; sibling to meter (06-11) + MoE (06-21) dives.
  • 2026-06-29 — “Nvidia Keeps 70 Cents of Every Dollar. That’s Why OpenAI Built a Chip.” (house) — labs going vertical into inference silicon, pegged to OpenAI’s Jalapeño (Broadcom, 9-mo design, gigawatt end-2026, MS pre-buys 40%). Inference is the spend; Nvidia’s ~70% gross margin is the tax; ASIC ~3–5× perf/watt, $300–500M NRE <1yr payback, Morgan Stanley sees ASICs 25% of inference by 2026. History: Google TPU (data-center-doubling, >90% utilization, Anthropic runs up to 1M). Fork: OpenAI/Google build vs Anthropic rents 3 silicons (TPU+Trainium+Nvidia). Bear: ASIC inflexibility, CUDA+NVLink moat ($10.98B/qtr networking), giants-only. So-what: token price falls structurally but the platform keeps the savings. how-it-works/economics. Deepest layer of the channel thread; sibling to MoE (06-21) + spec-decoding (06-24) + caching (06-18) inference-economics cluster.