Skip to content
A compositor's hand holding a composing stick with a line of metal type set in it, loose pieces of type scattered on the table below (Groningen, 1965)

Are English sentences getting shorter? About 40% of the drop is punctuation

· 22 min read · Web Dev

TL;DR I stripped the words from 1,959 Project Gutenberg books and tested the 130-year-old claim that English sentences got shorter. Words between periods fell from 30 (1700-49) to 15 (1900-49). About 40% of that drop is periods taking over the job semicolons and colons used to do, and the rest survives every check I ran, even in narration with the dialogue taken out. Semicolons fell from 10 to 2 per 1,000 words, and a writer's birth year explains that about as well as the publication date does. Punctuation alone names the author 34% of the time where chance is under 1%, and Dickens gets 0 of 20. You can drop your own .txt on Punc's read page and check any of it.

On this page
  1. Try Punc
  2. Prior work
  3. About 40% of the sentence length drop is punctuation
  4. Dialogue explains little of the rest
  5. Semicolons fell from 10 to 2 per 1,000 words
  6. Careers and generations
  7. Punctuation as a fingerprint
  8. Why I built Punc
  9. How I counted
  10. Limitations
  11. Run it on your own books
  12. References
  13. Footnotes

In his 1894 history of the English paragraph, Edwin Lewis wrote that “the English sentence has decreased in average length at least one-half in three hundred years.” People have been repeating some version of it ever since: English sentences are getting shorter.

Linguists have had a boring, sensible objection for decades. Maybe sentences didn’t shrink so much as get cut up. A writer in 1750 joined clauses with semicolons and colons where a writer in 1950 would put a period. Same words, more sentences. Jeanne Fahnestock suggested the trend might be “a by-product of changing punctuation conventions” [Fahnestock 2011, in Rudnicka 2018], and Henry Oliver raised the same suspicion in November 2025 [Oliver 2025]. I couldn’t find anyone who had measured how much of the drop it explains across the 1700s and 1800s, when semicolons were everywhere.

I had a tool that could. Punc, my art project that strips the words out of a book and keeps only the punctuation, now holds 1,959 Project Gutenberg books (mostly out of copyright, so the trend runs to the 1970s), and every one of them has a semicolon count. So I counted semicolons and colons as sentence ends and checked how much of the decline in sentence length survives. Both sides are partly right. Sentences did get shorter, but by closer to a third than to Lewis’s half once semicolons and colons count, and about 40% of the famous drop is punctuation.

You can see it before you count anything. Here are 1,000 words from the middle of Tom Jones (1749) and 1,000 from the middle of A Farewell to Arms (1929), with only the punctuation left. They’re two famous extremes, not averages:

The punctuation from 1,000 words in the middle of two novels, side by side on black, with semicolons and colons in pink. Tom Jones (1749) has 24 semicolons and colons and 41 sentence ends, its pink marks scattered all through the block. A Farewell to Arms (1929) has 1 semicolon and 166 sentence ends, a long block of periods and quotation marks with a single pink mark.

Try Punc

Punc's shelf is built for a bigger screen, so on a phone, open it in a new tab.

Pick any book off the shelf, or open the read page and drop in a .txt file of your own. It runs in your browser and nothing gets uploaded. The numbers below come from the same counting code, plus the Python checks described under How I counted.

Prior work

People have counted this by hand for a long time. In 1893 Lucius Sherman tallied words per sentence in English prose and got 41.4 for Richard Hooker (1590s) against 22.5 for Thomas Macaulay’s Essay on History (1828) [Sherman 1893, p. 259]. Lewis did the same and got roughly the same answer. The current headline version is Babbel’s 2025 press release, built on Google Ngram data, which says British books went from one semicolon every 90 words in 1781 to one every 390 in 2022 [Babbel 2025].

A page from Lucius Sherman's 1893 Analytics of Literature: a table of words per sentence in each of five hundred-sentence stretches, averaging 63.02 for Fabyan, 49.82 for Spenser, 41.40 for Hooker and 22.45 for Macaulay

Lucius Sherman’s hand count of words per sentence, Analytics of Literature, 1893, p. 259 (Internet Archive).

The punctuation objection has been around nearly as long. Douglas Biber and Susan Conrad point to “a much more extensive use of colons and semicolons in earlier historical periods” [Biber and Conrad 2009, in Rudnicka 2018]. Karolina Rudnicka’s 2018 chapter reviews both sides with data from the Corpus of Historical American English, and it’s where I’d start if you want the literature.

One detail in Rudnicka’s review set up the test for me. Ingrid Westin, who studied 20th-century newspaper editorials, reported that counting sentences two ways, once ending them only at periods and once at semicolons and colons too, gave almost the same pattern over time (Westin 2002, as summarized by Rudnicka). That’s what you’d expect if punctuation mattered once and then stopped mattering: by 1900 hardly anyone was using enough semicolons to change the count. So if sentences glued together with semicolons explain some of the decline, the two ways of counting should sit far apart before 1800 and meet once the semicolon dies out.

I’ll use two measures for the rest of the post:

  • Words between periods: words divided by sentence ends (., ?, !). This is what everyone measures.
  • Words between stops: the same, but semicolons and colons count as ends too.1

About 40% of the sentence length drop is punctuation

That’s what the data shows, across the 954 books with a first-publication date between 1600 and 1974 (the other dated books are older or newer, and about 45% of the shelf has no date I could pin down). Words between periods rise to 30.3 in 1700-49 (just 18 books) and fall to 14.5 by 1900-49 (445 books). Words between stops fall from 21.6 to 13.3 over the same span. Taken at face value, 47% of the drop disappears once semicolons and colons count. By 1950-74 the two lines meet at 12.5 and 12.4, because modern books barely use either mark, which matches Westin’s result.

I measure from 1700-49, the peak, not from Lewis’s Elizabethans. Nine of the shelf’s 21 books from 1600-49 are plays, which run about 8 words a sentence and drag that period’s median down. The 11 prose books from those years have a median of 42 words, close to Sherman’s 41 for Hooker, but 11 books is too few to measure from.

WORDS BETWEEN PERIODS VS WORDS BETWEEN STOPS 0 10 20 30 1600-49 21 1650-99 13 1700-49 18 1750-99 48 1800-49 96 1850-99 288 1900-49 445 1950-74 25 books Medians of per-book values. Words per sentence. GLUED SENTENCES30.314.521.613.3words between periods (. ? !)words between stops (. ? ! ; :) GLUED SENTENCES30.314.521.613.3words between periods (. ? !)words between stops (. ? ! ; :)
WORDS BETWEEN PERIODS VS WORDS BETWEEN STOPS 0 10 20 30 1600 21 1650 13 1700 18 1750 48 1800 96 1850 288 1900 445 1950 25 books Medians of per-book values GLUEDSENTENCES30.314.521.613.3periodsstops (adds ; :)

Here’s what one of those glued sentences looks like, punctuated the way the first edition of Adam Smith’s The Wealth of Nations printed it in 1776 [Smith 1776, vol. 2]. Most writers today would make it three. Checking this example against the first edition is also how I found that Gutenberg’s copy of the same book adds semicolons Smith never printed (more under Limitations).

SAME WORDS. THREE SENTENCES. SAME WORDS. THREE SENTENCES.
SAME WORDS. THREE SENTENCES.

A scan of the 1776 first edition of The Wealth of Nations, in its original long-s type: "A shepherd has a great deal of leisure; a husbandman, in the rude state of husbandry, has some; an artificer or manufacturer has none at all."

The same sentence in the first edition of The Wealth of Nations, London, 1776, vol. 2 (Internet Archive).

That 47% assumes every semicolon and colon joins two clauses that could each stand alone as a sentence, and they don’t. Plenty of semicolons separate items in a long list, and plenty of colons just introduce a quotation.

So I pulled 100 random semicolons and colons out of 1700s English prose and had each one coded, checking whether the words after the mark could stand as their own sentence. Claude did that first pass while I wrote the analysis. For the semicolons, 43 of 60 did (72%). For the colons, 23 of 40 did (58%). The rest were things like a run of “that” clauses in a list, a colon setting up a quotation, or a chapter heading. If each mark counts only as often as it actually glues two sentences together, the 47% drops to 38%.

A second, separate Claude agent that saw only the passages and the rule coded the same 100 and agreed on 95 (Cohen’s kappa 0.89). That’s one model family agreeing with itself, not two linguists, so treat the 38% as a careful estimate. It also coded 100 marks from 1900-49 books, to check whether the marks changed jobs. The semicolons mostly hadn’t (62% still glue two clauses), but the colons had: only 18% did, because by then a colon mostly introduced a list or a quotation. Using each era’s own rates still gives 38%.

DOES THE MARK GLUE TWO CLAUSES? 100 MARKS, CODED TWICE SEMICOLONS COLONS ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;::::::::::::::::::::::::::::::::::::::::43 of 60 glue (72%)23 of 40 glue (58%)glues two clausesdoesn't: a list, a quotation, a heading ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;::::::::::::::::::::::::::::::::::::::::43 of 60 glue (72%)23 of 40 glue (58%)glues two clausesdoesn't: a list, a quotation, a heading
DOES IT GLUE TWO CLAUSES? 100 marks, two coders agree on 95 SEMICOLONS COLONS ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;::::::::::::::::::::::::::::::::::::::::43 of 60 glue (72%)23 of 40 glue (58%)glues two clausesdoesn't (list, quote, heading)

Other ways of counting move the number around. A stricter sentence splitter that skips “Mr.”, initials, ellipses and dialogue tags like "Help!" he cried gives 52%. Counting dashes as stops gives 43%. Semicolons alone give 42%. Taking out plays and poetry, dropping translated books, or measuring from 1750 instead of 1700 all land between 48% and 58%. The 58% rests on just 13 English-original books from 1700-49 and drops to 49% measured from 1750. Every version falls between 38% and 58%, and only the two weighted ones account for the marks that don’t glue anything. Weighting takes about 10 points off any of the others, which is why I treat 40% as the floor of the range and not the middle.

EVERY WAY OF COUNTING LANDS BETWEEN 38% AND 58% Share of the 1700-49 to 1900-49 drop in sentence length that disappears, with 95% intervals 0% 20% 40% 60% Weighted by hand-coded glue rate Weighted + strict sentence splitter Semicolons only Dashes count as stops too Base: ; and : count as stops Plays and poetry removed English originals (catalog flag) Measured from 1750-99 Strict sentence splitter Narration only English originals (both checks) 38%42%42%43%47%48%48%49%52%54%58%about 40% 38%42%42%43%47%48%48%49%52%54%58%about 40%
EVERY WAY OF COUNTING Share of the drop that is punctuation 0% 20% 40% 60% Weighted by hand-coded glue rate Weighted + strict sentence splitter Semicolons only Dashes count as stops too Base: ; and : count as stops Plays and poetry removed English originals (catalog flag) Measured from 1750-99 Strict sentence splitter Narration only English originals (both checks) 38%42%42%43%47%48%48%49%52%54%58%about 40%

I’m calling it about 40%. The bottom of that range is the number I can defend against someone who knows what a semicolon does, and none of the point estimates drops below a third.

Dialogue explains little of the rest

The obvious suspect for the other 60% is dialogue. Speech is short, and the share of words inside quotation marks in Punc’s books goes from 5% in 1775-99 to 28% in 1950-74. Question marks climb too, from 1.9 to 5.3 per 1,000 words. Muzny, Algee-Hewitt and Jurafsky found a rise in the same direction in 1,100 novels, about one more quotation per 1,000 words every 25 years [Muzny et al. 2017].

It’s mostly not dialogue, though. I cut every quoted passage out of every book and measured only the narration. Words between stops in narration still fall from 21.9 (1700-49) to 14.5 (1900-49), a 7.4-word fall against 8.3 for the full text, so dialogue accounts for roughly a tenth of it. If anything that understates the narration’s fall: plenty of 1700s novels don’t put speech in quotation marks, so some short spoken lines are still in the early narration counts.

TAKE THE DIALOGUE OUT, AND SENTENCES STILL GOT SHORTER 10 15 20 1700-49 18 books 1750-99 48 books 1800-49 96 books 1850-99 288 books 1900-49 445 books 1950-74 25 books 21.613.321.914.5narration only, dialogue removedall the text 21.613.321.914.5narration only, dialogue removedall the text
NARRATION GOT SHORTER TOO Words between stops, dialogue removed 10 15 20 1700 18 1750 48 1800 96 1850 288 1900 445 1950 25 books 13.321.914.5narration (dialogue removed)all the text

Semicolons fell from 10 to 2 per 1,000 words

Counting only 25-year periods with at least 20 books (the same rule Punc’s Numbers page now uses), the median book has 10.1 semicolons per 1,000 words in 1775-99, 12.6 in 1800-24, 8.6 in 1850-74, 4.6 in 1900-24 and 1.8 in 1950-74. The steepest fall comes after 1825. That matches Rudnicka’s finding in American English: “a dramatic decrease in the frequency of use of semicolons happening between 1810 and 1900.” Commas fell too, from 86 to 63 per 1,000 words, but not nearly as far.

SEMICOLONS FALL FROM 10 TO 2 PER 1,000 WORDS COMMAS 50 75 100 SEMICOLONS 0 6 12 18 1600 1650 1700 1750 1800 1850 1900 1950 Hollow dots: periods with fewer than 20 books, left out of the numbers in the text 85.963.110.14.61.8 85.963.110.14.61.8
THE SEMICOLON FADES OUT Per 1,000 words, median book COMMAS 50 75 100 SEMICOLONS 0 6 12 18 1600 1700 1800 1900 Hollow: fewer than 20 books, not quoted 85.963.110.14.61.8

Babbel’s 1781 peak of one semicolon every 90 words works out to 11 per 1,000. Punc’s median for 1775-99 is 10.1, from a different set of books. I wouldn’t lean on that too hard, because Google’s scans of pre-1800 books trip over the long s, but it’s a nice check.

One result doesn’t line up. Darmon, Bazzi, Howison and Porter found semicolons fell “less noticeably” in their 14,947 Gutenberg documents [Darmon et al. 2021]. It isn’t a matter of units: measured as a share of all marks instead of per 1,000 words, Punc’s median still falls from 6% of marks in 1775-99 to under 1% in 1950-74. They also dated each book by the middle of its author’s life, since Gutenberg doesn’t record publication dates, and worked with a different slice of the library. I can’t tell you which of those explains the gap.

Careers and generations

If writers dropped the semicolon, you’d expect to see it in their careers. Seventeen authors on the shelf have five or more dated books spanning 20 or more years. Eight of them use fewer semicolons over time and nine use more, and the median slope is about zero. Dickens drops from about 12 semicolons per 1,000 words to 6, and Henry James from 12 to 7. Jane Austen, Mark Twain and G. K. Chesterton rise, though Austen’s first dated book is juvenilia.

Seventeen authors is a hint, not a result, so I tried something with more data. Gutenberg’s catalog lists author birth years, which let me put birth year and publication year in the same model for 748 English-original books from 1750 to 1974. Each takes about half of the semicolon’s fall: -3.1 per 1,000 words per century for publication year and -3.7 for birth year. Resampling authors rather than books, neither interval crosses zero (publication year only just), but the two overlap almost completely, and birth year and publication year move together, so this can’t separate them.

WRITERS DON'T DROP SEMICOLONS OVER A CAREER Semicolons per 1,000 words, fitted from each author’s first dated book to their last 0 6 12 18 1600 1650 1700 1750 1800 1850 1900 1950 Both in one model: change per century, 748 English-original books, 1750-1974 Publication year Author birth year 0 -6 whole shelf, median bookAustenDickensTwainHenry James8 fall9 rise-3.1-3.7 whole shelf, median bookAustenDickensTwainHenry James8 fall9 rise-3.1-3.7
WRITERS DON'T DROP THEM Semicolons per 1,000 words, first book to last 0 6 12 18 Tuttle James Dickens Rousseau Mill Shakespeare Wilde Conan Doyle Dostoyevsky Darwin Hardy Burroughs Nietzsche Tolstoy Twain Chesterton Austen One model, both at once (per century) Publication year Author birth year 0 -6 hollow: first book8 fall9 rise-3.1-3.7

So I can’t rule out either one, and both probably contributed. Writers born later used fewer semicolons, which fits Underwood and colleagues’ finding, in 10,830 works of fiction from 1880 to 1999, that 54.7% of the change explained by time is explained better by an author’s birth year than by the book’s publication year [Underwood et al. 2022]. And books published later used fewer, even from the same generation. Since individual careers barely move, my guess is that the “later” half belongs to publishers and later editors more than to authors changing their minds. I can’t prove that from punctuation counts.

Punctuation as a fingerprint

Part of the semicolon’s fall tracks when a writer was born, which suggests punctuation is partly personal habit. So how personal is it? Punc gives every book a fingerprint of ten numbers: the share of its marks that are commas, periods, double quotes, apostrophes, semicolons, colons, dashes, question marks, exclamation marks and parentheses. Then it plays a guessing game. Take one book away, average each author’s other books, and guess whichever author’s average is closest.

For the 132 authors with at least three works on the shelf, it names the right author for 241 of 708 books, 34%. Guessing at random gets 1 in 132, under 1%. I shuffled the author labels 20 times and reran the test, and the shuffled runs averaged 0.8%. None beat 2%.

PUNCTUATION ALONE NAMES THE AUTHOR A THIRD OF THE TIME 708 books by 132 authors, one dot each. Each book is guessed from the other books’ averages. Named the right author Named someone else 0% 10% 20% 30% 40% English originals alone, no translations: 35% 241 of 70834%: the real test4.2%: shuffled within genre0.8%: labels shuffled 241 of 70834%: the real test4.2%: shuffled within genre0.8%: labels shuffled
PUNCTUATION NAMES THE AUTHOR 708 books by 132 authors, one dot each Named right Named someone else 0% 10% 20% 30% 40% English originals alone: 35% 241 of 70834% real4.2% genre kept0.8% shuffled

Genre could be doing the work. Plays punctuate like plays and mysteries punctuate like mysteries, so maybe the test was just recognizing genre. To check, I shuffled the author labels only among books with the same genre tags. That version scores 4.2%, against 0.8% for a full shuffle and 34% with the real labels. With translations removed, 104 authors still score 35%. So genre explains a little of it.

Translators are a real caveat, though. Plato goes 12 of 18, and every one of those books is somebody’s translation, so that’s a translator’s fingerprint as much as Plato’s.

For comparison, Darmon and colleagues reached 62-72% across 651 authors using the order of the marks and the spacing between them as well as their shares. Their setup differs (at least ten documents per author and an 80/20 train-and-test split, against my three works and leave one out), so the numbers aren’t directly comparable. Punc’s version only counts how often each mark shows up.

Dickens goes 0 for 20. His books get taken for Robert E. Howard, the pulp writer who created Conan the Barbarian, seven times, plus Dumas three times and Dostoyevsky twice. The Pickwick Papers, Nicholas Nickleby, The Old Curiosity Shop and David Copperfield all go to Howard. My guess is range: Dickens wrote in so many registers that his average fits none of his books well, but I haven’t tested that. Oscar Wilde, who wrote plays, essays, a novel and fairy tales, is 0 of 14.

Charles Dickens in his fifties, bearded, in a dark coat, photographed in profile

Charles Dickens, photographed by Jeremiah Gurney around 1867 (Wikimedia Commons).

DICKENS: 0 OF 20, AND 7 WENT TO ROBERT E. HOWARD Going by punctuation alone, who each of his 20 books was taken for CHARLES DICKENS Robert E. Howard Alexandre Dumas Fyodor Dostoyevsky Jules Verne Robert Louis Stevenson Homer Edgar Allan Poe Jacob Grimm Leo Tolstoy John Milton Bertrand Russell 732111111110 named Dickens 732111111110 named Dickens
DICKENS: 0 OF 20 Who his books were taken for CHARLES DICKENS Robert E. Howard Alexandre Dumas Fyodor Dostoyevsky Jules Verne Robert Louis Stevenson Homer Edgar Allan Poe Jacob Grimm Leo Tolstoy John Milton Bertrand Russell 732111111110 named Dickens

No single mark carries the signature. Leave any one mark out of the fingerprint and accuracy drops by about 3 points at most. The period matters most (30.9% without it), and double quotes matter least.

NO SINGLE MARK CARRIES THE AUTHOR’S SIGNATURE Share of books matched to the right author, with one mark left out of the fingerprint 0% 10% 20% 30% 40% no period no comma no colon no apostrophe no question mark no semicolon no dash no parentheses no exclamation mark no double quote .30.9%,31.4%:31.4%'32.1%?32.1%;32.3%-32.3%(32.3%!32.6%"33.8%all ten marks: 34% .30.9%,31.4%:31.4%'32.1%?32.1%;32.3%-32.3%(32.3%!32.6%"33.8%all ten marks: 34%
NO SINGLE MARK CARRIES IT Authors named, with one mark left out 0% 10% 20% 30% 40% no period no comma no colon no apostrophe no question mark no semicolon no dash no parentheses no exclamation mark no double quote .30.9%,31.4%:31.4%'32.1%?32.1%;32.3%-32.3%(32.3%!32.6%"33.8%all ten: 34%

Genres do have fingerprints of their own. Mystery and crime has the most dialogue on the shelf (42% of its words are in quotes), the most question marks of any prose genre and the fewest semicolons. Plays are the loudest, with 9.3 exclamation marks per 1,000 words and 8.5 words a sentence. History and philosophy are the quietest, at under one exclamation mark per 1,000 words.

Why I built Punc

A lot of what steers you through a book isn’t the words. A comma tells you to take a breath, a period tells you to stop, and an exclamation point tells you someone is yelling. You follow every one of those instructions while you read, and you almost never notice them. Punc takes the words away and leaves the instructions, so you can see a book’s rhythm on its own. Alice’s Adventures in Wonderland comes out loud and nervous, full of exclamation points and questions, which is how the book feels to read.

ONLY THE INSTRUCTIONS. ONLY THE INSTRUCTIONS.
ONLY THE INSTRUCTIONS.

It’s an erasure, like the blackout poems I make on paper, except a blackout poem keeps a few words and Punc keeps none. It’s a sibling of linger, my other erasure piece. I started it in 2016 after reading Adam J. Calhoun’s essay Punctuation in novels, which was itself inspired by Nicholas Rougeux’s posters Between the Words. Ray Farias wrote most of the original code. In 2026 I came back to it and filled the shelf with Gutenberg’s most-downloaded books.

I built it to make pictures. Once the shelf held 1,959 books, though, the pictures turned into a dataset, and the dataset could test a claim people have been making since the 1890s.

Counting style is old. Lewis and Sherman counted sentences by hand. Frederick Mosteller and David Wallace used the rates of words like “upon” to argue that Madison wrote the disputed Federalist Papers [Mosteller and Wallace 1964]. John Burrows’ Delta made comparing writers by their most common words a standard method [Burrows 2002]. The Stanford Literary Lab, Ted Underwood and many others took it to whole libraries. The Literary Lab’s pamphlet on style at the scale of the sentence opens with its authors disagreeing about whether their own measure captures style at all. In 2015 my sister and I built a screenplay parser for the Bechdel test in the same spirit.

Page 217 of a 1788 edition of The Federalist in long-s type, from the copy Thomas Jefferson owned: a passage arguing that taxes on land unite the interests of the wealthiest landlord and the poorest tenant, with semicolons all through it

A page from Thomas Jefferson’s copy of The Federalist, 1788, Library of Congress (Wikimedia Commons).

I think art and data analysis together are good ground for this kind of research. Making a picture of a text makes you look at it in a way nobody planned, and that’s where you find evidence you weren’t looking for, which is the fun part.

How I counted

Corpus. Gutenberg’s 2,000 most-downloaded English books as of November 2026, minus dictionaries, encyclopedias, repeat editions and the few without a plain text, plus a few favorites: 1,959 books, about 2.5% of Gutenberg’s roughly 80,000. Gutenberg’s license header and footer are cut at the *** START and *** END lines.

Dates. First publication, taken from Wikidata’s date for the work, with a hand-checked override list in Punc’s fetch script. Translations take the original’s year, which is why I flag translations and rerun without them. The 114 books from before 1600 are left out of everything over time.

Counting. Curly quotes and long dashes fold into their plain versions. Rates are per 1,000 words. Punc ends a sentence at any run of ., ? or !, and the stricter splitter is there as a check on that. Dialogue is the share of words inside double quotes.

Statistics. Medians of per-book values, so one enormous book can’t swing a period. Bootstrap intervals come from resampling books within each period, and for the generations model, from resampling authors, since one writer’s books aren’t independent. The generations test is a least-squares fit of semicolons per 1,000 words on publication year and author birth year, for authors aged 15 to 90 at publication. Attribution uses the Hellinger distance between the ten-mark fingerprints.

Hand-coding. 100 marks drawn at random (seed 42) from 49 English-original prose books dated 1700-1799, coded first by Claude and then, without seeing those codes, by a separate Claude agent (Claude Opus 5.5), which agreed on 95 of 100. A second set of 100 from 382 books dated 1900-1949 was coded by the agent alone. The prompt and both sets of codes are in the repo.

The table behind the main result:

PeriodBooksWords between periodsWords between stops
1600-16492120.913.9
1650-16991324.316.6
1700-17491830.321.6
1750-17994827.319.8
1800-18499621.416.4
1850-189928817.915.0
1900-194944514.513.3
1950-19742512.512.4

Punc’s counting code is the same TypeScript the site runs, on GitHub. The Python scripts behind the new analyses, the hand-coded sample and a ledger of every number in this post are in the repo’s analysis/ folder, pinned to the commit this post used. I wrote those scripts with Claude Code. Before adding anything new, they reproduce Punc’s own numbers: the same period medians and the same 241 of 708 authors.

Limitations

  • Editors. Gutenberg texts are often later editions, and editors change punctuation in both directions. Gutenberg’s Wealth of Nations has “hurtful to the landlord; it is frequently hurtful to the tenant; and it is always hurtful to the community,” where Smith’s 1776 first edition has a period after “landlord” and a comma after “tenant.” That semicolon after “tenant” turned up as item 5 of my 100 hand-coded marks, so the problem reaches the sample too. Editors add semicolons as well as remove them, and I can’t say which way the editions push the totals.
  • Few early books, and almost no recent ones. Before 1800 each 50-year period has 13 to 48 books, so the intervals are wide. At the other end, Gutenberg carries books that are public domain in the US, which mostly means books published before 1931 [Duke CSPD 2026]. Only 67 of the 1,073 dated books on the shelf came out after 1930, so the trend stops in the 1970s and says nothing about the last 50 years.
  • The hand-coding was done by Claude, twice, not by a person: 100 marks from the 1700s coded by two separate agents, and 100 from 1900-49 coded by one. A linguist coding a few hundred more would tighten the 40%.
  • Only about half the shelf has a date. 1,073 of 1,959 books have a first-publication year (954 of them fall in the 1600-1974 trend charts). The undated ones are out of every over-time number, and I haven’t checked whether they differ from the dated ones.
  • Translations slip through. I flag them from Gutenberg’s catalog and from each book’s title page, and some still get past both (Candide does).
  • The shelf is today’s taste. These are the books people download now, not a sample of what was printed then. For what it’s worth, popularity barely tracks punctuation. The strongest link between download rank and any measure is question marks, at a rank correlation of -0.19.
  • Dialogue means double quotes. Books that use single quotes, and plays, undercount it.
  • It’s all correlation. Nothing here says why writers changed.

Run it on your own books

Punc’s read page takes any .txt file. Drop one in and it runs in your browser, nothing gets uploaded, and you get the same counts I used here. The library and command line tool make PDF, SVG and PNG versions of the pictures if you want to print them.

A few experiments I’d love to see someone run:

  • Your own writing from ten years ago against your writing today. Did you lose your semicolons?
  • Two translations of the same book. Does the translator’s fingerprint beat the author’s?
  • A novel published this year against the 1950-74 line.
  • Whether books start quiet. In my data, question and exclamation marks run about 3.5 per 1,000 words in a book’s first tenth and 4.8 through the middle, even after cutting the front matter. I haven’t checked it any harder than that.
  • Anything that breaks one of the results above. Open an issue on Punc’s repo and tell me.

Go play with it.

References

Footnotes

  1. Linguists will recognize words between stops as a crude version of the T-unit [Hunt 1965]: a main clause plus whatever hangs off it. It’s crude because not every semicolon or colon starts a new main clause, which is the problem the hand-coded sample in the main results takes on. ↩

If you liked this post, consider sharing it on Hacker News, Bluesky, LinkedIn, or X.

Joe Karlsson at his desk, chin on hand, with a microphone in front of him

Joe
Karlsson

I write about my homelab, AI tools, databases, and the weird stuff I build on the side.

More about me →

BlueskyLinkedInGitHub