Twitxy Saved

Andrew Piper

Verified account This account is verified. Learn more

@_akpiper

Using AI to study storytelling at McGillU. Director of .txtlab and author of the new book, Why You Should Read More Fiction.
Montreal, QC txtlab.org Joined March 2012
2.9K Following 6.1K Followers 17K Posts

Latest posts 5

Pinned post

Andrew Piper Verified account @_akpiper
Today is launch day! My new book, *Why You Should Read More Fiction*, synthesizes over ten years of research to provide a science-based approach explaining why fiction is so important for our brains, especially right now. I hope you will pick up a copy and spread the word.
7 replies 10 reposts 67 likes 105K views View on X
Andrew Piper Verified account @_akpiper
Are children disappearing from the novel?

In a new study published in the Journal of Computational Literary Studies, I analyze 9,544 English-language novels published between 1800 and 2000 to examine how the representation of children has changed over two centuries.

Using a combination of natural language processing and large language models, I identify approximately 167,000 fictional characters and measure their visibility, emotional valuation, narrative agency, and relationships to parents.

Five main findings:

1. Children are becoming less visible. Contrary to expectations, the proportion of narrative attention devoted to children and adolescents has declined over the past 200 years. Adolescents show the largest decline, losing roughly 5 percentage points of their share of character mentions, compared with just over 3 points for younger children.

2. Adolescent girls have experienced the sharpest decline. While adult women have become increasingly prominent in fiction, adolescent girls have moved in the opposite direction. The historical expansion of women's representation in novels has primarily benefited adult women at the expense of adolescent women.

3. Children remain the most positively portrayed characters. The emotional language surrounding adults and adolescents has become increasingly negative over time. Younger children, however, have maintained—and slightly increased—their positive emotional associations. The ideal of the "good child" remains remarkably persistent.

4. Children have gained agency, but more slowly than adults. Across measures of grammatical subjecthood, power, and the kinds of actions characters perform, children remain less agentive than adolescents, who in turn remain less agentive than adults. Adolescent girls exhibit especially large gender gaps in agency relative to boys their age.

5. Children are increasingly represented alongside parents. Rather than becoming more independent, young child characters are increasingly embedded in family relationships. Meanwhile, adult women have become less likely to be represented alongside their own parents, suggesting a shift away from multigenerational family structures.

The larger picture: Over two centuries, the novel has increasingly centered adults, especially adult women, while children have remained positively valued but comparatively constrained in their capacity to act.

The findings complicate familiar accounts of childhood's growing cultural importance and independence. Children may have become more socially valued, but this has not translated into greater narrative visibility or relative agency in the modern novel.

Read the open-access article: doi.org/10.48694/jcls.…
jcls.io 200 Years of Children in Literature: On their Visibility, Value, and Agency Across modern literary history, children have served as powerful symbolic figures through which societies negotiate core social values. Yet despite their prominence in canonical criticism, we lack a...
1 replies 7 reposts 17 likes 972 views View on X
Andrew Piper Verified account @_akpiper
Doing really important work testing AI detectors.
Tuhin Chakrabarty Verified account @TuhinChakr 17h
It’s unfortunate that mostly black authors have been outed for using AI to write fiction, but does that mean AI detectors are racist ? Sadly, the answer is a resounding NO. With the help of @pangram and @GPTZeroAI I analyzed 187 African books published between 2001 & 2026. 👇👇
View quoted post on X
2 replies 0 reposts 7 likes 1.1K views View on X
Andrew Piper Verified account @_akpiper
"Hint: Academic publishing is dead. It was already a very stupid way to record and promulgate knowledge, and had been so for decades, even before all that publicly funded knowledge was locked behind paywall cartels."
Casey Handmer Verified account @CJHandmer 23h
In my ongoing quest to find the limits of Opus 5.5, I directed it to audit my old scientific field, theoretical astrophysics. We indexed about 150,000 papers, audited 50,000 for issues, and did progressively more thorough checks on thousands more. We found nearly 1000 major errors that got cited many times, most are still uncorrected. This survey enabled me to estimate the efficacy of peer review for correcting errors (not very good) and to identify dozens of open questions that anyone with spare Claude Max tokens could answer today (.md context files included).

Bottom line: AI can speed up quantitative science by >1000x with no further model improvement required. But I'm seeing no evidence of this being pushed within universities, only academics complaining about labs dropping math proofs.

Among my fellow reformed academic high agency founders, however, several are speed running entire disciplines.

This survey has implications for how science will be run in the very near future. Hint: Academic publishing is dead. It was already a very stupid way to record and promulgate knowledge, and had been so for decades, even before all that publicly funded knowledge was locked behind paywall cartels. Now AIs can generate thousands of novel, correct papers per day, it is no longer meaningful for humans to consider a research paper a "unit of science" or to even bother much with the 99.9% of science which, up to this point, was necessary drudgery. Time to discover something like General Relativity or Evolution every week. LFG!!

Enjoy: science.caseyhandmer.com/physics/
View quoted post on X
1 replies 0 reposts 12 likes 1.2K views View on X
Andrew Piper Verified account @_akpiper
"The real problem is not that the papers and reports were AI-generated; it is that no one had done the thinking behind them, and you can so easily tell."
Jesús Fernández-Villaverde Verified account @JesusFerna7026 18h
I am sharing a new paper today with Dario Caldara: “Can Peer Review Survive AI-Generated Text?”

sas.upenn.edu/~jesusfv/Peer_…

Dario and I, as editors, are increasingly getting papers submitted to our journals that are 99 percent AI-generated. Even worse, we are also receiving many AI-generated referee reports, both as editors and, more frustratingly, as authors.

And we cannot emphasize this enough: the real problem is not that the papers and reports were AI-generated; it is that no one had done the thinking behind them, and you can so easily tell. The papers were eminently forgettable, and the referee reports were disappointingly uninsightful. We have seen too many reports of the form: “The paper is well-written and addresses an important problem. However, the authors should consider additional baselines.”

This deluge of AI-generated text puts peer review in jeopardy: journals will be flooded with low-quality submissions, economists will decline requests to referee papers or routinely use AI to referee them, and which papers get published will become less and less linked to their quality.

We do not want to defend the status quo entirely. Peer review is slow, many reports are poor, and editors (including us!) make bad calls all the time. Still, well-executed peer review remains the best system we have for assessing each other’s work and advancing the profession. AI could improve peer review if used deliberately for that purpose, for instance, to check proofs and code. That is not what we are seeing.

The difficulty is that readers, including editors and referees, cannot see how AI was used. As a result, in practice, the burden of verification shifts from the author to the reader.

Since we reject this shift, Dario and I did what economists always do when something bothers us: we wrote a paper.

So, what do we do in it? First, we check whether AI detectors such as Pangram get this right: is a referee report flagged as AI-generated indeed AI-generated? Or is Pangram just flagging proofreading and editing? No. We run an experiment with 25 referee reports from the pre-AI era. Proofreading and editing do not trigger AI-generated flags. Only when we ask the LLMs to substantially rewrite the referee report or to generate a new report do we get the AI-generated flags. Pretty compelling evidence, if I may say so.

Second, we build a theoretical model to explore who should bear the burden of verification: the author or the reader? (Yours truly always enjoyed the courses on the rules of evidence in law school; yes, as Billy Wilder would say, nobody is perfect.)

The answer is that it is much more efficient for the author to do it, because the author can verify at a much lower cost and only needs to do it once (rather than each reader repeatedly). Before AI, the authors more or less had to verify the results, even if only because they had to type them in. This was not perfect (and all papers ever published in economics probably have at least one mistake). But the problem is that, with AI, the author does not even need to read the text. Or can just skim it. Writing is thinking, and without writing there is usually not much thinking.

So, a paper flagged as AI-generated is prima facie evidence that the author has not verified it. Should this lead to an automatic rejection? No. But there should be a zero-tolerance policy for serious mistakes. The first serious mistake we find in the paper, and it is out! In comparison, for a non-flagged paper, a serious mistake is something that the editor might determine it can be fixed in a revision.

We are stricter with referee reports. There is absolutely no point in the referee generating a report using an LLM. As an editor, I can do that directly and save myself the trouble of asking you for it. Now, of course, you can use the LLM to help you with the report (if the journal allows it! Many journals do not allow you to upload the paper to an LLM, and you need to follow the rules). For example, you can use the LLM to search for existing results in the literature.

But peer review is not about finding one sentence that is not entirely precise or a slightly sloppy mathematical proof. Referees are asked: “Is this idea important despite its flaws?” And, relatedly: “Is the paper a good fit for the journal in terms of quality and focus?” That judgment is the task for which you are selected as a subject expert.

We also propose that journals require that, before a paper is submitted, the author submit it to an LLM using an approved prompt and include the LLM report and a discussion of what was and was not fixed. That way, the referee would not need to check (or at least not check so carefully) every technical detail, and they could focus on the big picture: Is this a good paper? Is this a good fit for this journal? What is fundamental for this paper to become publishable at this journal?

Anyway. The paper has many other arguments, and we try to be nuanced. So, before ferociously typing the first complaint that crosses your mind, would you consider reading it? Chances are that we have already discussed your objection. We have been thinking about this for a long time.

But by all means, leave good comments!
View quoted post on X