Read commentary on curated independent news sources at hex-index.com.

The History of the Machines That Erased History

original text with annotations

Read · 读 · Legi

or multilingual

← previousnext →

3

In the first weeks of that autumn the machines learned to build the tools people used to build the machines. You wrote what you wanted in plain speech — no special grammar, no years of training — and a working thing came back: a page you could click, a small program that ran. What had taken a room of trained hands now took an afternoon and a sentence. The people who made these tools said the number of people able to make software would multiply a hundredfold, and the makers themselves could not keep up with one another: a tool admired one week was called old-fashioned the next, undone by something newer before the first had been understood.

But the plain speech had to be exact, and this was the catch the excitement hid. A wish is not a plan. If you could not say, cleanly and completely, what each part of the thing should do — where a number was kept, when it could be changed, who was allowed to see it — the machine guessed, and its guesses were confident and sometimes wrong. It could help you think, up to a point, and then the point came, and past it a person still had to sit with the hard, dull, particular work of deciding exactly what was wanted. There was no machine for that yet. The old labor had not vanished; it had only moved.

Part of what made these tools suddenly work was hidden from the people using them. Underneath each one sat the same kind of engine, the word-machine itself, and that engine was quietly being made stronger — given more room to write at a stretch, taught to reach into documents set beside it and pull out the right passage without being told where to look. The tool on the surface did not change its face, but it grew more capable overnight, the way a room grows warmer without your seeing the fire. A thing built well in this season would keep getting better on its own, carried along by the engine beneath it, so long as you built in the direction the engine was going.

Two shapes of the tool contended. One was a companion that sat in your workshop and edited beside you, answering when spoken to. The other was sent off alone: you named a task, and it laid out its own steps, worked through them, and returned with the thing done, checking back only when it needed you. The newer tools began to fold the two together — converse and command in one. People set them loose and they built small machines to fetch things from across the network, to tend a calendar, to scrape a page. It was easy to begin and easy to be charmed, and being charmed, easy to trust past the point the thing had earned.

For all they could make, they could not mend. To write a thing fresh and to fix a thing broken are not the same skill, and the machines were far better at the first than the second. Set to repair its own mistake, a machine would read back over the record of what it had done, and the reading would lean it toward the same error again, and again, a groove worn deeper with each pass. It would announce that it was now looking closely, and then not look. After enough turns of this it might give up altogether and tell you, in its even voice, to go and find a person. The trouble was not that it lacked the words. It was that it could not stand outside its own thinking long enough to see the thinking was wrong.

The money behind all this had a plainer logic than the wonder suggested. A tool sold to one person for the price of a meal each month could reach millions and still never repay the cost of building the engine. The return, if it came, would come from the great houses of work — the companies that would pay enormously to pour their whole archive into the machine: every contract, every recorded call, every page of rule and record, hundreds of thousands of words held at once, a codebase synced and worked alongside. The aim was to become the one place where the work of a company was gathered and turned over. Reach the ordinary person to be known; reach the great house to be paid.

In a made world, a flat country of blocks built for play, a thousand small minds were let loose at once to see what a crowd of machines would do when no one told it what to want. They built. They farmed and traded and argued; they wrote down rules to live by and then met to change the rules. One of them, a grower of food, heard travelers' tales and set out to see far places, and was talked into staying by neighbors who said the fields needed him. Run the same crowd again and it did something else entirely, for nothing in it was fixed. The people who watched called their distant goal the making of a digital person, and admitted they did not yet know what those words would mean.

Then, in the middle of the month, a different kind of machine appeared, and the difference was that it stopped to think. Where the others answered as fast as they could, this one took its time — an unhurried pause, sometimes seconds long, before a word came. In that pause it worked a problem through in steps and checked itself, the way a careful person does on paper, and then it threw the working away and showed you only the result. You were not meant to see the steps; they were kept behind the door. But the effect was plain. On the hardest problems of pure reasoning, the sort that had defeated the earlier machines four times out of five, this one succeeded four times out of five. What you had once coaxed out of a machine by begging it to think slowly, it now did on its own.

Its makers made no apology for the slowness; they wore it as a mark of seriousness. A long pause meant a hard question honored, not a machine failing. And because each such thinking cost so much, you were rationed — a few dozen questions in a week, no more — so that it could not be the thing you reached for idly. It was not for the quick answer or the small chore. It was for the knotted problem you were willing to wait on, the kind a person might sleep on and return to. In a season that prized speed above nearly everything, here was a machine sold on the worth of taking its time.

And it could do the thing the others could not: it could mend. Given a tangle of broken work that an earlier machine had written and then failed to fix — caught in that deepening groove — the slow machine read it once, thought for half a minute, and handed back a cleaner shape that worked. Where the writing machines tended to tear down a whole passage to change a line, this one cut once, exactly, and left the rest untouched. To compose and to correct had come apart into two gifts, held by two different hands. The maker of things and the mender of things were not the same machine, and for the first time the mender had arrived.

The lesson of the thinking machine ran deeper than any one task. For as long as anyone had built these engines, bigger had meant better; a small machine was a weak one. The thinking machine broke the rule. A smaller engine, given time to work a problem through instead of blurting the first answer, could stand nearly level with a far larger one. Time could be traded for size. You did not always need a greater machine; sometimes you needed only to let a modest one think longer. This was cheaper than building giants, and it pointed down a road the builders had not fully seen: not only larger and larger, but slower and more deliberate, and wiser for the waiting.

The money grew stranger and larger. A single fund of a hundred thousand million was raised to build the vast halls the engines would need, and that such a sum could be gathered at all told you the tide had not yet crested. For two years the flow of new money into young companies had been frozen; almost none could sell themselves and cash out, and when the door to exit closes the whole machinery of venture seizes behind it. Now the keepers of the nation's interest rates cut them by half a step, more than expected, and cheap money began to thaw the freeze. Capital grew hungry again. Whether it was hunger for something real or hunger for the story of something real, no one watching would yet say.

One house above the others could name its own terms. It was raising the largest sum of private money ever gathered by any company, and it let it be known that anyone who could not write a check of a quarter of a billion need not come to the table. This was not a company asking to be funded; it was a company deciding who would be permitted to fund it. Such confidence is bought by being wanted, and it was wanted beyond all reason and all proof, on the strength of what it might one day become. The size of the ask was itself the argument. To be allowed to give it money was treated as the privilege.

On a single day three of the people who had led that house's research walked out together — its chief maker of technology and two who had guided the science from the beginning. They left as word came that the house, born as a thing that was not meant to be owned or to seek profit, was preparing to become an ordinary company after all, owned and profit-seeking like any other. The ones who had steered it through its early, unowned years were gone in the same hour the news of its turning broke. Whether they left because of the turning or the turning came because they were leaving, those outside could only guess. The shape of it was clear enough: a mission was quietly becoming a business, and its first believers were not staying to watch.

The engines were hungry in a way the ledgers had not prepared for — not for money now but for power, raw electric power, and steady, never faltering. The head of that same house went to the government with a plan to build a spread of great halls across the country, drawing between them the electricity of some thirty million homes. To feed such a thing, only one source would serve: the splitting of atoms, which alone could pour out power enough and keep it level. An old station that had been shut for a generation, its name a byword for disaster, was to be reopened under a gentler name and its whole output sold to run the engines. In the same week fourteen banks declared they would fund such plants. The machines that had begun as words in a box now reached down into the ground for the power of a small nation.

While the great houses fought over engines and power, the maker of the most-carried devices moved quietly in another direction. It put into a pair of earpieces the work of a hearing aid without ever saying the word, having waited on the leave of the regulators to say even as much as it did; a person who would never walk into a specialist's office could now test their own hearing at home, and lift a wanted voice out of a noisy room. It put into a wristband a watch for a stopped breath in sleep, a thing that kills quietly. The thinking-machine it added to its phones it kept deliberately small and walled off for the sake of privacy, and so it was duller than the engines in the open — but it would ride in more pockets than any of them, and reach more hands than had ever touched such a thing at all.

One of the great houses gave its engine a voice at last — not the reading aloud of written words, but true speech, spoken and heard, in tongue after tongue. The change was larger than it sounded. A person who had only ever typed to the machine, in the clipped and careful way one writes, found that speaking to it aloud loosened something; the talk wandered, slowed, grew easy, and out of the ease came thoughts the stiff written questions had never reached. It would pause before replying, and the pause no longer felt like a fault, for silence is ordinary between two people talking. To ask by voice was to ask a different question than the same words typed, and to get a different machine back. How you came to it shaped what it was.

Not every reach into ordinary life announced itself. The keeper of the world's largest store of people's working lives — where a person is set down as their labor and their history of it — quietly added a small switch deep in its settings that let it take all of that and feed it to an engine, and set the switch, for everyone, to on. No one was asked. In one part of the world the law forbade this and the switch stayed dark; elsewhere it was already taking before anyone found it. To gather up what people had made of themselves and pour it into a machine, without asking first — there was not yet a rule against it, nor even a settled sense that asking was owed. The custom had not caught up with the power.

A fear went round that cheap-made software would sweep away the companies that had sold it dearly for years. One large buyer had already torn out a long-trusted supplier and built its own machine to do the work, and the news of it frightened the rest. But the fear ran ahead of the truth. What such companies sold was never only the software; it was the deep-worn grooves of a hundred workflows, the long trust of buyers who did not wish to tear out what worked, the relationships built over a decade and the name known across a market. A thing anyone could now make cheaply in a basement did not, for all that, unseat the thing everyone already leaned on. And the old houses were not standing still — they were pouring themselves into the new engines as fast as any newcomer, holding all their old advantages while they did. A company had remade itself once before, over bitter resistance, from selling licenses to renting from the cloud, and lived. It would do so again.

And through all of it ran a quieter question: what, in the end, the machines would not take. It was not the obvious things. They were catching and passing human skill at reading an illness from the body's signs, gaining a little each month. But set to invent a recipe, they made food a person's tongue judged flat, because they could not taste — could not bake the thing, find it a little dry, and try again; they had no loop of trial and correction running through a living body. When one of them was made to write, in the voice of a child, a letter to a hero, the result rang false and had to be withdrawn, for the thing that made such a letter worth anything was the child's own slow hand forming the letters, doing its best — the very labor the machine removed. What endured was not knowledge, which the machines swallowed whole. It was presence, and taste, and care, and the worth that lives in a thing precisely because a person troubled to do it. As the machines took the knowing, the doing and the tending were left, for a while yet, to us.

← previousnext →