91ɫƬ

Feeding our books into generative AI risks creating a cultural void

When we put our literature, games and films into AI models, we risk replacing our cultural history with a mishmash of auto-generated works. We desperately need to preserve human writing, says columnist Annalee Newitz
A book is fed into a scanner
A book is fed into a scanner
STEPHANE DE SAKUTIN/AFP via Getty Images

In 800 years, a group of students is sitting in a graduate seminar devoted to an era known as the Void Ages. They’ve read a couple of books and watched some of the two-dimensional, low-resolution media once called “movies”. A few students even assembled devices to experience “video games” – interactive stories devoted to accumulating digital representations of value – using the original controllers. The professor is explaining the psychology behind why game controllers looked like fists covered in nipples, when somebody’s hand shoots up.

“I don’t understand why we have so little media preserved from this era. Everything is fragmentary, and most of what we’ve read in this class was reconstructed from probabilities. Was it because of the atomic wars? Or the Fire Years?”

“No war or global wildfire could do this,” the professor answers gravely, uncoiling a liquid metal tentacle to point at a time map on the wall. “People from this era fed their culture into large language models and disposed of the original texts. All we have left is the output of ancient algorithms. We have to reverse-engineer what people were doing from that.”

“So, we can never know if any of what we’re studying in this class is actually what people knew or saw or believed? It could all be generated by LLMs?”

“That’s right. There’s a reason why we call it the Void Ages.”

More students break into the conversation, voices overlapping, frustrated and fascinated by the mystery of this pivotal era when their ancestors decided to subsume their greatest works of culture into a word-guessing model, the kind of thing a child would do to wreck their sibling’s homework.

It sounds bonkers, but this is the future we’re building for ourselves right now. When we feed books, movies, games and art into generative AI models, we risk replacing our own cultural history with a mishmash of auto-generated works that offer nothing to future generations who will be desperate to know what we were thinking. It’s as if we are deliberately recreating the tragic void at the heart of Bronze Age history, an era when humans transformed their civilisations across the globe – and left virtually no written narratives behind to explain what the hell happened and why.

As a writer of both science journalism and science fiction, I continue to be appalled by the idea that using an LLM could substitute for the experience of writing to, for and about each other. The point of writing, of creating culture, is to communicate my own weird way of looking at the world. It’s my letter to you, another weirdo probably. And it’s my letter to the future, my record of what one hairless ape experienced in the very specific era of the early 21st century, in the urban region currently known as San Francisco. It’s a human record, for other humans.

Back in 2020, when I was freaking out because I had no idea how to survive a global pandemic, . In 1666, he was a regular Englishman, just trying to survive a terrible wave of plague. Pepys worried about big-picture stuff like global politics and the meaning of life, but he also wrote about how to hide a wheel of cheese when you flee London and what it felt like to walk down a street where doors were painted with the red crosses of quarantine. Reading his words was soothing, because it was like he had reached out to me across the centuries to reassure me that I was not alone. That is the value of expository writing, and the value of history.

Of course, when I write fictional stories about time travellers and robots, I’m not recording an exact experience of real life. But I am still capturing the anxieties and hopes of my time. There are things you can say in fiction that you can’t say in journalism; I can reflect social ambiguities and fantasies, the biases that say more about us than facts ever could. The works of George Eliot and H. G. Wells are remembered today not just because they are engaging, but because they capture 19th-century aspirations and fixations, the little psychological tics that reveal how humans reacted to their rapidly industrialising world.

I’m not against the use of generative algorithms in code development, or as an aid in analysing big data. I am as devoted to the scientific project as the next nerd. But we need human writing as much as we need technology. Neither can replace the other. If we truly want to understand the universe, we need records of the human world as well as the physical one. When we feed all our writing to AI, we risk losing more than individual works of literature. We lose our connections to each other, in the present, past and future.

Topics: Artificial intelligence