The owner's answer to the budget-meeting study: the world is big and the harvest sees a patch of it; and a writer can be given a topic by an editor, or can want one. Sections 1 to 3 are coverage. Section 4 is the two doors. Nothing here is built.
Three of the four are already the brew's own. A peg is a candidate story with its link. The harvest is how pegs are gathered each morning. The slate is the day's sixteen commissions. The fourth is the owner's: the space is everything the paper could be about, and it has three sides: where it happened, what it is about, and what kind of thing happened (a ruling, a death, a discovery, a match, a strike, an anniversary, a small strange thing). Coverage is the share of the space today's pegs came from. Nothing else is needed.
The 09-09 harvest, 82 pegs, placed on two sides of the space: the beat, and where the outlet lives. The third side, the kind of event, the harvest cannot see at all, because it searches by beat name.
Thirty-three searches such as「technology AI news today」and「今日体育新闻」, 15 outlets, the New York Times alone 17 pegs. Two thirds of the pegs are American; Culture is a third of them because book, film and art sections open wide; Sports, Markets and China have two pegs between them and「everywhere else」has none. A search by beat name asks Google what is loud, and the loud centre of every beat is the same five outlets.
Two ways in, then two rules, then a count.
| App | How it picks what you see | What we take |
|---|---|---|
| Google News | crawls ~50k outlets, groups articles into stories, ranks a story by how many outlets carry it and how fast, weighted by outlet authority; editors do not touch Top stories | the story, not the article, is the unit; breadth of coverage is the importance signal |
| Apple News | human editors pick the Top Stories; the algorithm fills the rest by topic and reading history | a curated layer on top of the machine one (Wikipedia plays this part for us) |
| SmartNews · 今日头条 | cluster, then rank by engagement and freshness, then personalise hard | freshness matters; personalisation is not the harvest's job |
| Flipboard · Reddit | people curate topic magazines; votes rank inside a topic | the topic list must be wide before ranking means anything |
| Ground News | clusters a story and shows how many outlets, of what leaning, covered it | the outlet count per story is a fact worth keeping and showing |
The common mechanic is cluster first, then rank the cluster by how many sources carry it. We already fold duplicates by title overlap; the change is to count what we fold instead of discarding it. A story that arrives from forty outlets in nine countries is important whatever its topic.
The specimen's sixty sub-field searches were a first cut, and the owner's question (art? films? games? what else?) is the right one: touched-at-least-once has to be a property of a list, not of luck. The list below is the checklist the search layer walks, about 130 lines under the eight beats plus the kinds of event. Each line is one free Google News search; the rota puts every line through at least once a week and the count on the brew log names the lines a week has not touched. The list is a table in the repo, edited by hand when a gap shows.
| Beat | Sub-fields (each one search) |
|---|---|
| World | elections · courts and rulings · war and ceasefires · diplomacy and summits · protests · strikes and labour · migration and refugees · disasters, quakes, floods, wildfires · weather extremes · crime and trials · terrorism · corruption and scandal · military and defence · aid and famine · borders and territory · religion and the churches · the UN and treaties · royals |
| China | the economy · policy and the Party · tech and chips · Taiwan · Hong Kong · trade and tariffs · Chinese science · Chinese culture, film and books · Chinese sport · society and 社会 · the diaspora |
| Tech & AI | AI models and labs · AI in use (medicine, law, school) · AI policy · chips and semiconductors · robotics · cybersecurity and breaches · social platforms and moderation · smartphones and gadgets · apps and software · open source · crypto · VR, AR and wearables · the space industry · EVs and batteries · the internet and telecoms · gaming hardware |
| Science | space and astronomy · space missions and launches · physics · quantum · chemistry and materials · biology and new species · genetics · neuroscience · medicine and trials · public health and outbreaks · drugs and addiction · climate · oceans · energy and fusion · earth science and volcanoes · palaeontology and dinosaurs · archaeology · mathematics · animals and nature · agriculture and food supply |
| Culture | books and prizes · poetry · film and festivals · television and streaming · music, pop · classical, opera and dance · theatre · art, museums and auctions · art crime and forgery · architecture · design and photography · fashion · food, restaurants and chefs · video games · esports · comedy · podcasts · comics and animation · language and words · history and anniversaries · philosophy and ideas · celebrity · obituaries |
| Markets | stocks · bonds and rates · central banks · currencies · commodities, oil and gold · IPOs and deals · startups and funding · earnings · banking and insurance · property and housing · private equity · luxury and retail · airlines and transport · energy companies · media and advertising · trade and tariffs · economics research · philanthropy · scams and fraud |
| Sports | football, world · Premier League · American football · basketball · baseball · cricket · tennis · golf · Formula 1 and motorsport · athletics and marathons · rugby · boxing and MMA · cycling · swimming · winter sports · the Olympics · chess and mind sports · horse racing · women's sport · sport business and doping |
| Life & relationships | parenting · dating and marriage · friendship · sex · grief and loss · work and careers · school and universities · money at home · mental health · sleep · fitness · diet and cooking · ageing and retirement · housing and the home · pets · travel · hobbies, gardening, crafts · cities and commuting · faith and meaning · disability · LGBTQ · the odd and the small strange thing |
| Kinds of event (cross-cut) | a ruling · an election · a death · a discovery · a launch or release · a match or race · a strike or shutdown · a price move · a deal · a disaster · a record · a trial · an anniversary · a festival · a scandal · a rescue · a theft |
Against this list the specimen's sixty searches missed: religion, weather, crime and trials, military, energy, oceans, chemistry, neuroscience, animals, agriculture, poetry, classical music, art crime, fashion, design, comedy, podcasts, comics, language, philosophy, celebrity, bonds, currencies, commodities, banking, luxury, airlines, media, scams, baseball, boxing, cycling, swimming, winter sports, chess, horse racing, women's sport, friendship, grief, sleep, fitness, diet, pets, travel, hobbies, faith, disability. About fifty of a hundred and thirty. A list is the only way to know that.
Nobody has to search for the span; several services already gather it, and the useful ones are free. The commercial ones sell the same search shape we have now over a wider index, which fixes the outlet problem and not the query problem.
| Service | What it is | Cost | Fit |
|---|---|---|---|
| GDELT | scans world news in 100+ languages every 15 minutes; tags each article with its location, its themes and the kind of event | free, one request every 5 s | the wide net: its fields are the three sides of the space; gives the link and the tags, not the text; noisy, so the outlet cap matters; its event codes see rulings, strikes and protests sharply and a cheese theft only through themes |
| Google News feeds | a feed per country edition and per topic over tens of thousands of outlets | free | what is loud in each country rather than only in the US; one feed per region a day |
| Wikipedia Current events · On this day · Deaths | a human-curated daily list of what happened everywhere, by region, with a source link per line | free | the cleanest one-liners of all; the honest baseline; anniversaries and obituaries only one persona would want |
| Event Registry (newsapi.ai) | groups articles into events across languages | ~100–500 USD a month | does the one-story-one-peg merge for us; priced for companies |
| NewsAPI · NewsData · GNews · Mediastack | keyword search over 100k+ outlets by country and category | free tiers with delays, then 50–450 USD a month | our search shape, wider index; not needed while the free layers hold |
| Serper news | Google's news vertical by query (what we use) | ~0.001 USD a search | kept for the checklist searches that reach the corners |
Gone or closed: Bing's news API (retired 2025), Ground News (no public API). Chinese one-liners come from Bocha and the Chinese outlets' own pages; a Chinese story only Chinese media carried arrives as a Chinese headline, which the meeting reads.
The current pegs stage on 09-09 took 90 seconds and cost 0.147 USD, all Serper fees; no model gathers pegs. The redesign is faster and about as cheap, because everything wide is free.
| Layer | calls a day | time, in parallel | cost |
|---|---|---|---|
| GDELT by region and kind | ~45 | 4 min (spaced 5 s) | free |
| Google News country and topic feeds | ~45 | under 30 s | free |
| Wikipedia's three pages | 3 | 2 s | free |
| outlet feeds and front pages across regions | ~20 | 30–60 s | free |
| Serper from the checklist | ~60 | 20 s | 0.06 USD |
| one story, one peg (title overlap, local) | 0 | under 1 s | free |
Three to five minutes of wall time, 0.06 to 0.10 USD. Time is invisible: the text pass starts at 03:00 and the meeting waits for the harvest. GDELT throttles bursts (a 429), so it runs spaced and the harvest proceeds on the other layers when it is slow, as the peg ladder already falls through to Wayback. The box in Singapore reaches all of these directly.
A published piece already carries a beat and the free tags the meeting invents that morning (russia · ukraine · naval-war), and the app records each reader's verdicts and how far they read. The reading side of a recommender exists; the supply side does not: sixteen pieces from a patch, tagged in words that change from day to day.
when:2d, 8 results)pegs-all.json (beat · region · sub-field · kind · layer · outlets · countries · front); coverage.json and two log lines count what the pool and the selection touchedGreen is counting and rules, auditable from the files; blue is the cheap model, reading as a persona or picking from a shortlist with thinking off. The owner's rule (09-09 evening): ten minutes for this step means the design is wrong. The one giant call (154 pegs · the pitches · 90 roster lines · the policy → 20 commissions with questions, thinking on) starved on every model; the meeting is now a shortlist made in code, one fast pick, twenty small question calls and repairs in code, and the door stays open through the ten unpitched stories by attention. Same inputs, 24 seconds instead of nine minutes, no problems left. What the owner's read of 09-09 found: the pitch door held; the assignment door let a name pun, a brand and a register through, because the validator only checks that a reason exists.
The meeting stays, but it stops being the only door. It is the right tool when the day needs a story and no one wanted it: the war on its fourth day, the budget, the thing that happened at 5 a.m. It gets the fixes from the study: the bench first, a reason that cites a line of the profile, no professional adjacency, a quota on how many of the day's slots it may fill by assignment. What it loses is the job of inventing a writer's interest, which is the job it did worst.
The pitch pass. One cheap call per persona (Flash-class, ~4k tokens in, ~200 out). The prompt is the day's headlines first, as the shared, cached prefix, then the persona's motivation sheet, then one instruction: read the morning's paper as yourself; if something in it is yours, say which, and why, in two sentences, and in what form; if nothing is, say so. Silence is a valid answer and most days most personas are silent. Cost at 92 personas: roughly 0.1 to 0.2 USD a day on DeepSeek Flash with the prefix cached, less than one piece's writer call.
What a pitch is. Three lines, machine-readable: the peg (by id), the reason (which must name something in the profile: a memory, a value, a place, a person), the form. Two examples of what the pass should produce, written by hand here:
The motivation sheet. The pass needs something the profile does not have. The card's writes: is the language a persona writes in, not its subjects; nothing on the card says what a persona would want to write about this month. The sheet is a derived block, ~300 words, made once per persona from Values & seams and Specific memories and refreshed when the profile changes: the five or six things this person cannot walk past, each tied to the profile line it comes from, plus the things they are following (a persona may follow a story across days, which is how series happen). It is not authored by hand for 92 personas; it is extracted by one call each and cached beside the card, and it is the only thing the pitch pass reads besides the headlines.
| Failure | Why the pitch alone does not fix it | The editor's rule |
|---|---|---|
| everyone pitches the war | the loudest story is everyone's story; ninety hands go up | a running story at most twice a week, whoever pitched it |
| the same twenty hands every day | a persona with a rich sheet pitches more often and better | the bench: a pitch from a persona idle fourteen days outranks an equal one; a floor of a third of the slate |
| a reason that is a pun on fame | a model can always write two sentences of reason | the validator checks the cited profile line exists; the editor refuses adjacency without a memory |
| no one pitched a story the day needs | 150 pegs have holes no pitch fills | match-making, for at most a quarter of the slate, with the reason cited |
| the pitch is better than the piece | a two-sentence want is not an 800-word essay | the pitch travels with the commission: the writer reads its own reason back, which is the「you are in it」line the first read asked for, written by the persona itself |
| Stage | Now | Proposed |
|---|---|---|
| the harvest | 33 beat-name searches → ~80 pegs from 9 outlets | built 09-09: read 37 editions + 54 feeds + Wikipedia, search the 176-line checklist → 2,200 stories, 160 read, one story one peg, no outlet over a tenth, no beat over 22%; the coverage count on the log |
| before the meeting | nothing | the pitch pass: 92 calls, 0–2 pitches each, from the motivation sheet |
| the meeting | 140 pegs + a 92-line roster → 16 commissions | the pitches + the coverage sheet + the bench → ~12 accepted pitches + ~4 assignments, each with a cited reason |
| the commission | subject + question | subject + question + the persona's own pitch, read back |
| cost | pegs ~0.15 USD | pegs ~0.20 (more searches; reading pages is free) + the pass ~0.15; the rest unchanged |