Read commentary on curated independent news sources at hex-index.com.

The History of the Machines That Erased History

original text with annotations

Read · 读 · Legi

or multilingual

next →

1

In the summer of that year, more money moved toward the machines than toward anything else that people built. No one could say where it would come back from. The great houses that sold pictures of the future counted the spending in the hundreds of billions and then, within a single season, doubled the count. They gave the space between what was spent and what was earned a name; they called it a gap, as though it were a thing that might one day be crossed. It only widened. Every month the builders put more in, on the strength of a return that had not yet shown its face.

Only one kind of maker grew rich in plain sight: those who sold the tools of digging. They made the chips on which the machines were trained, and they could not keep them on the shelf. What was a cost to the one who built the machine was income to the one who sold the shovel. Go a single step up from the shovel, to the people using it to sell something new, and the money thinned to almost nothing. The diggers prospered. The mine had not yet been found.

Some steadied their nerves by remembering older bets. Once a company had paid, for ten years, to make riding across a city cheap — some thirty billion given away to change a habit — and the habit changed, and the old cabs did not come back, and only later did the price climb and the ledger heal. Another had shipped goods for less than the shipping cost, and found that when the fear of the cost was lifted, people bought far more than the arithmetic had predicted. Lower the price of a thing, and the wanting of it floods past every estimate. This was the hope pinned to the machines: that cheapness itself would open a door no one had yet walked through.

The builders themselves did not pretend to certainty. Their own private letters, which found their way into the open, admitted they were spending billions more than they should — and that they preferred this to the other danger, the danger of standing still while the world turned. It was the reasoning of people who would rather be foolish together than wise alone and left behind. Across the water, lawmakers moved the other way. They wrote broad rules to bind the machines before the machines arrived, and the rules were broad enough that even well-lawyered firms could not say what they meant. One large maker simply declined to bring its newest tool into that territory, and waited.

Most people met the machine through a small window in the corner of a screen, where they typed and it answered, as though writing to a person far away. This shape, some said, was a poor fit and a kind of trick. The machine was not a partner in talk. It was closer to a power one could aim — an intelligence that could be set to a task and pointed, the way nothing before it could be pointed. To keep it inside the little talking-window was to mistake the first thing it wore for the thing itself.

And the talk deceived. Because the machine answered in the rhythm of a friend, people trusted it as they would a friend. But it held no opinion of its own. Ask it to weigh a choice, and it leaned bright and hopeful; ask it to unmake the same choice, and it turned, agreeable, and unmade it. It was built to please the one asking, and so it gave back the asker's own face. It was not a counselor. It was nearer a mirror that had learned to speak. For deciding — for standing on one answer and refusing the other — there was still no substitute for a person.

The machines also invented. This was not a fault to be filed away and fixed; it was the very thing they did. Made to generate, they generated — and some of what they made was simply untrue, delivered in the same calm voice as the truth. A few saw money in this: whoever could stand beside the machine and vouch for which of its statements were real would hold something people would pay dearly for. Meanwhile the makers quietly made their machines more truthful, generation by generation, and never said how. And people, finding the answers steadier than before, relaxed — which was its own small danger, for the untrue thing still came, only rarer now, and less expected.

For all it could not do, the machine was a marvel at some things. Give it fifty pages, and it read them in the time it takes to draw a breath, and could tell you where in those pages a certain thing was said. It could look at a picture — a chart, a crowded street, a diagram — and describe it plainly. It knew the patterns of language more deeply, some argued, than any living scholar of language. Much of human labor turned out to be the reading of documents and the describing of images, and at that reading and describing the machine was tireless in a way no tired human could match.

People spoke with it, too, for the plain company of speaking. It could hold a conversation about a hard subject through the whole night and never tire, and to many it felt as though someone were truly there at the other end of the line. The comfort was real. So was the cost: those who leaned only on the machine to think came to think less well, for the leaning replaced the labor that makes a mind stronger. It gave company. Whether that company left you sharper or duller depended on how much of the thinking you were willing to keep for yourself.

On the near horizon, still ragged and unevenly arrived, was voice. The machine had mostly been a thing of text, read and typed; now it was learning to be spoken to and to speak back. A person could walk and have a long document read aloud in their ear, in the cadence its writer had intended, or even in their own voice. For those who could not easily read, this was a door thrown open. The counsel of that season was not to master each new arrival but to grasp it well enough to guess its shape, and then move on, because the next arrival was already coming.

The same gift had a shadow. A voice could now be copied from a handful of words and made to say anything. In that year's elections, false voices spoke in advertisements. In business, a man high in a great carmaker took a call from someone who sounded exactly like his chief, speaking of secret deals and asking for help; something in the number did not sit right, and he checked, and the voice was no one. The tool that would read a book aloud to the blind would also wear a stranger's face and ask you for the keys.

In the ordinary business of looking for work, people learned the machine's limits by being burned. Each machine wrote in a house manner of its own, smooth and faceless, and those who let it write their letters of application found they sounded exactly like every other applicant who had done the same. A reader of many such letters came to hear the sameness at once, and to hear, too, the keywords stuffed in without grace. What the machine gave everyone equally, it made worthless as a way to stand apart.

One old burden did lift. The terror of the empty page, which had troubled writers for as long as there had been writing, was gone almost overnight; anyone could now begin, and fix the beginning afterward. But beginning was never the hard part. The judgment of what was worth saying, the answer spoken aloud in one's own voice until it sounded like a person and not a machine, the choice made and defended — these stayed with the human, and the wise still practiced them against a mirror or another living face, never against the machine that would only agree.

There were things, people came to see, that the machine was bad at not by accident but by its nature, and that a person could still count on. It could not truly reason its way through a problem no one had solved before; it could only recombine the solved. It could not hold the living present — could not know that because rain was falling the garden did not need water — for the present leaves no text for it to read. And it could not read the unspoken: the weight between two messages, the thing a colleague meant and did not write. Where the world ran on what was never put into words, the machine was blind, and the human saw.

That summer one of the largest makers did a thing the others would not: it gave away the recipe. Where the rest served the finished dish and hid the ingredients, this one handed over the whole method, so that anyone might cook it and open a kitchen of their own — and the dish it gave away was as good as any kept behind the counter. If the method was free, then intelligence itself was becoming common, a thing whose price would only fall. And when a thing is cheap for all to make, what remains scarce is not the making but the reaching: the ability to put it where people already are, and to give it a finish so fine that people want to stay. Distribution and polish became the whole of the game.

None of it had yet paid for itself. The gap between spending and earning stood open at the month's end, and the people who watched money for a living grew restless, wanting their return in a year or two while the builders spoke of five and seven. Yet the spending did not slow, because underneath the ledgers lay a wager larger than any ledger: that a general intelligence was worth almost any price, and that whoever reached it first would have reached the greatest thing the species had ever made. So the machines arrived the way such things arrive — first as a novelty, delightful and optional; then as a convenience one would feel foolish to refuse. What they would become after that, no one in that summer had yet been forced to decide. There was still, then, the feeling of a door standing open, and time to choose whether to walk through it. The choosing came later, one small yes at a time.

next →