Online Flip Book / Download   Back to our Information Page

Sai woke to the rousing first movement of Vivaldi’s violin concerto in C minor, “Il Sospetto.”

He lay still for a minute, letting the music wash over him like a gentle Pacific breeze. The room brightened as the blinds gradually opened to the sunlight. Tilly had woken him right at the end of a light sleep cycle, the optimal time. He felt great: refreshed, optimistic, ready to jump out of bed.

Which is what he did next. “Tilly, that’s an inspired choice for a wake-up song.”

“Of course.” Tilly spoke from the camera/speaker in the nightstand. “Who knows your tastes and moods better than I?” The voice, though electronic, was affectionate and playful.

Sai went into the shower.

“Remember to wear the new shoes today.” Tilly now spoke to him from the camera/speaker in the ceiling.

“Why?”

“You have a date after work.”

“Oh, the new girl. Shoot, what’s her name? I know you told me—”

“I’ll bring you up to speed after work. I’m sure you’ll like her. The compatibility index is very high. I think you’ll be in love for at least six months.”

Sai looked forward to the date. Tilly had also introduced him to his last girlfriend, and that relationship had been wonderful. The breakup afterward was awful, of course, but it helped that Tilly had guided him through it. He felt that he had matured emotionally and, after a month on his own, was ready start a new relationship.

But first he still had to get through the workday. “What do you recommend for breakfast this morning?”

“You are scheduled to attend the kickoff meeting for the Davis case at eleven, which means you’ll get a lunch paid for by the firm. I suggest you go light on the breakfast, maybe just a banana.”

Sai was excited. All the paralegals at Chapman Singh Stevens & Rios lived for client lunches made by the firm’s own executive chef. “Do I have time to make my own coffee?”

“You do. Traffic is light this morning. But I suggest you go to this new smoothie place along the way instead—I can get you a coupon code.”

“But I really want coffee.”

“Trust me, you’ll love the smoothie.”

Sai smiled as he turned off the shower. “Okay, Tilly. You always know best.”

*  *  *  *  *

Although it was another pleasant and sunny morning in Las Aldamas, California—sixty-eight degrees Fahrenheit—Sai’s neighbor Jenny was wearing a thick winter coat, ski goggles, and a long, dark scarf that covered her hair and the rest of her face.

“I thought I told you I didn’t want that thing installed,” she said as he stepped out of his apartment. Her voice was garbled through some kind of electronic filter. In response to his questioning look, she pointed to the camera over Sai’s door.

Talking to Jenny was like talking to one of his grandmother’s friends who refused to use Centillion e-mail or get a ShareAll account because they were afraid of having “the computer” know “all their business”—except that as far as he could tell, Jenny was his age. She had grown up a digital native, but somehow had missed the ethos of sharing.

“Jenny, I’m not going to argue with you. I have a right to install anything I want over my door. And I want Tilly to keep an eye on my door when I’m away. Apartment three-oh-eight was just burglarized last week.”

“But your camera will record visitors to my place too, because we share this hallway.”

“So?”

“I don’t want Tilly to have any of my social graph.”

Sai rolled his eyes. “What do you have to hide?”

“That’s not the point—”

“Yeah, yeah, civil liberties, freedom, privacy, blah blah blah . . .”

Sai was sick of arguing with people like Jenny. He had made the same point countless times: Centillion is not some big, scary government. It’s a private company, whose motto happens to be “Make things better!” Just because you want to live in the dark ages doesn’t mean the rest of us shouldn’t enjoy the benefits of ubiquitous computing.

He dodged around her bulky frame to get to the stairs.

“Tilly doesn’t just tell you what you want!” Jenny shouted. “She tells you what to think. Do you even know what you really want anymore?”

Sai paused for a moment.

“Do you?” she pressed.

What a ridiculous question. Just the kind of pseudointellectual antitechnology rant that people like her mistake for profundity.

He kept on walking.

“Freak,” he muttered, expecting Tilly to chime in from his phone earpiece with some joke to cheer him up.

But Tilly said nothing.

*  *  *  *  *

Having Tilly around was like having the world’s best assistant:

—“Hey, Tilly, do you remember where I kept that Wyoming filing with the weird company name and the F merger from maybe six months ago?”

—“Hey, Tilly, can you get me a form for Section 131 Articles? Make sure it’s a form that associates working with Singh use.”

—“Hey, Tilly, memorize these pages. Assign them the tags: ‘Chapman,’ ‘favors buyer,’ ‘only use if associate is nice to me.’ ”

*  *  *  *  *

For a while, Chapman Singh had resisted the idea of allowing employees to bring Tilly into the office, preferring their proprietary corporate AI system. But it proved too difficult to force employees to keep their personal calendars and recommendations rigidly separate from work ones, and once the partners started to violate the rules and use Tilly for work, IT had to support them.

And Centillion had then pledged that they would encrypt all corporate-derived information in a secure manner and never use it for competitive purposes—only to give better recommendations to employees of Chapman Singh. After all, the mission statement of Centillion was to “arrange the world’s information to ennoble the human race,” and what could be more ennobling than making work more efficient, more productive, more pleasant?

As Sai enjoyed his lunch, he felt very lucky. He couldn’t even imagine what drudgery work would have been like before Tilly came along.

*  *  *  *  *

After work, Tilly guided Sai to the flower shop—of course Tilly had a coupon—and then, on the way to the restaurant, she filled Sai in on his date, Ellen: educational background, ShareAll profile, reviews by previous boyfriends/girlfriends, interests, likes, dislikes, and of course, pictures—dozens of photos recognized and gathered by Tilly from around the Net. Sai smiled. Tilly was right. Ellen was exactly his type.

It was a truism that what a man wouldn’t tell his best friend, he’d happily search for on Centillion. Tilly knew all about what kind of women Sai found attractive, having observed the pictures and videos he perused late at nights while engaging the Just-for-Me mode in his browser.

And, of course, Tilly would know Ellen just as well as she knew him, so Sai knew that he would be exactly Ellen’s type too.

As predicted, it turned out they were into the same books, the same movies, the same music. They had compatible ideas about how hard one should work. They laughed at each other’s jokes. They fed off each other’s energy.

Sai marveled at Tilly’s accomplishment. Four billion women on Earth, and Tilly seemed to have found the perfect match for him. It was just like hitting the “I Trust You” button on Centillion search back in the early days and how it knew just the right web page to take you to.

Sai could feel himself falling in love, and he could tell that Ellen wanted to ask him to come home with her.

Although everything had gone exceedingly well, if he was being completely honest with himself, it wasn’t quite as exciting and lovely as he had expected. Everything was indeed going smoothly, but maybe just a tad too smoothly. It was as if they already knew everything there was to know about each other. There were no surprises, no thrill of finding the truly new.

In other words, the date was a bit boring.

As Sai’s mind wandered, there was a lull in the conversation. They smiled at each other and just tried to enjoy the silence.

In that moment, Tilly’s voice burst into his earpiece. “You might want to ask her if she likes contemporary Japanese desserts. I know just the place.”

Sai realized that though he hadn’t been aware of it until just then, he did suddenly have a craving for something sweet and delicate.

Tilly doesn’t just tell you what you want. She tells you what to think.

Sai paused.

Do you even know what you really want anymore?

He tried to sort out his feelings. Did Tilly just figure out what he hadn’t even known he wanted? Or did she put the thought into his head?

Do you?

The way Tilly filled in that lull . . . it was as if Tilly didn’t trust that he would be able to manage the date on his own, as if Tilly thought he wouldn’t know what to say or do if she didn’t jump in.

Sai suddenly felt irritated. The moment had been ruined.

I’m being treated like a child.

“I know you’ll like it. I have a coupon.”

“Tilly,” he said, “please stop monitoring and terminate autosuggestions.”

“Are you sure? Gaps in sharing can cause your profile to be incomplete—”

“Yes, please cease.”

With a beep, Tilly turned herself off.

Ellen stared at him, eyes and mouth wide open in shock.

“Why did you do that?”

“I wanted to talk to you alone, just the two of us.” Sai smiled. “It’s nice sometimes to just be ourselves, without Tilly, don’t you think?”

Ellen looked confused. “But you know that the more Tilly knows, the more helpful she can be. Don’t you want to be sure we don’t make silly mistakes on a first date? We’re both busy, and Tilly—”

“I know what Tilly can do. But—”

Ellen held up a hand, silencing him. She tilted her head, listening to her headset.

“I have the perfect idea,” Ellen said. “There’s this new club, and I know Tilly can get us a coupon.”

Sai shook his head, annoyed. “Let’s try to think of something to do without Tilly. Would you please turn her off?”

Ellen’s face was unreadable for a moment.

“I think I should head home,” she said. “Early workday tomorrow.” She looked away.

“Did Tilly tell you to say that?”

She said nothing and avoided looking into his eyes.

“I had a great time,” Sai added quickly. “Would you like to go out again?”

Ellen paid half the bill and did not ask him to walk her home.

*  *  *  *  *

With a beep, Tilly came back to life in his ear.

“You’re being very antisocial tonight,” Tilly said.

“I’m not antisocial. I just didn’t like how you were interfering with everything.”

“I have every confidence you would have enjoyed the rest of the date had you followed my advice.”

Sai drove on in silence.

“I sense a lot of aggression in you. How about some kickboxing? You haven’t gone in a while, and there’s a twenty-four-hour gym coming up. Take a right here.”

Sai drove straight on.

“What’s wrong?”

“I don’t feel like spending more money.”

“You know I have a coupon.”

“What exactly do you have against me saving my money?”

“Your savings rate is right on target. I simply want to make sure you’re sticking to your regimen for consumption of leisure. If you oversave, you’ll later regret that you didn’t make the most of your youth. I’ve plotted the optimum amount of consumption you should engage in daily.”

“Tilly, I just want to go home and sleep. Can you shut yourself off for the rest of the night?”

“You know that in order to make the best life recommendations, I need to have complete knowledge of you. If you shut me out of parts of your life, my recommendations won’t be as accurate—”

Sai reached into his pocket and turned off the phone. The earpiece went silent.

*  *  *  *  *

When Sai got home, he saw that the light over the stairs leading up to his apartment had gone out, and several dark shapes skulked around the bottom.

“Who’s there?”

Several of the shadows scattered, but one came toward him: Jenny.

“You’re back early.”

He almost didn’t recognize her; this was the first time he’d heard her voice without the electronic filter she normally used. It sounded surprisingly . . . happy.

Sai was taken aback. “How did you know I was back early? You stalking me?”

Jenny rolled her eyes. “Why would I need to stalk you? Your phone automatically checks in and out of everywhere you go with a status message based on your mood. It’s all on your ShareAll lifecast for anyone to see.”

He stared at her. In the faint glow from the streetlights he could see that she wasn’t wearing her thick winter coat or ski goggles or scarf. Instead, she was in shorts and a loose white T-shirt. Her black hair had been dyed white in streaks. In fact, she looked very pretty, if a bit nerdy.

“What, surprised that I do know how to use a computer?”

“It’s just that you usually seem so . . .”

“Paranoid? Crazy? Say what’s on your mind. I won’t be offended.”

“Where’s your coat and goggles? I’ve never even seen you without them.”

“Oh, I taped over your door camera so my friends could come for a visit tonight, so I’m not wearing them. I’m sorry—”

“You did what?”

“—and I came out here to meet you because I saw that you turned off Tilly, not once, but twice. I’m guessing you’re finally ready for the truth.”

*  *  *  *  *

Stepping into Jenny’s apartment was like stepping into the middle of a fishing net.

The ceiling, floor, and walls were all covered with a fine metal mesh, which glinted like liquid silver in the flickering light from the many large, high-definition computer monitors stacked on top of each other around the room, apparently the only sources of illumination.

Besides the monitors, the only other visible furniture appeared to be bookshelves—full of books (the paper kind, strangely enough). A few upside-down, ancient milk crates covered with cushions served as chairs.

Sai had been feeling restless, had wanted to do something strange. But he now regretted his decision to accept her invitation to come in. She was indeed eccentric, perhaps too much so.

Jenny closed the door and reached up and plucked the earpiece out of Sai’s ear. Then she held out her hand. “Give me your phone.”

“Why? It’s already off.”

Jenny’s hand didn’t move. Reluctantly, Sai took out his phone and gave it to her.

She looked at it contemptuously. “No removable battery. Just what you’d expect of a Centillion phone. They should call these things tracking devices, not phones. You can never be sure they’re really off.” She slipped the phone inside a thick pouch, sealed it, and dropped it on the desk.

“Okay, now that your phone is acoustically and electromagnetically shielded, we can talk. The mesh on the walls basically makes my apartment into a Faraday cage, so cellular signals can’t get through. But I don’t feel comfortable around a Centillion phone until I can put a few layers of shielding around it.”

“I’m just going to say it. You are nuts. You think Centillion spies on you? Their privacy policy is the best in the business. Every bit of information they gather has to be given up by the user voluntarily, and it’s all used to make the user’s life better—”

Jenny tilted her head and looked at him with a smirk until he stopped talking.

“If that’s all true, why did you turn Tilly off tonight? Why did you agree to come up here with me?”

Sai wasn’t sure he himself knew the answers.

“Look at you. You’ve agreed to have cameras observe your every move, to have every thought, word, interaction recorded in some distant data center so that algorithms could be run over them, mining them for data that marketers pay for.

“Now you’ve got nothing left that’s private, nothing that’s yours and yours alone. Centillion owns all of you. You don’t even know who you are anymore. You buy what Centillion wants you to buy; you read what Centillion suggests you read; you date who Centillion thinks you should date. But are you really happy?”

“That’s an outdated way to look at it. Everything Tilly suggests to me has been scientifically proven to fit my taste profile, to be something I’d like.”

“You mean some advertiser paid Centillion to pitch it at you.”

“That’s the point of advertising, isn’t it? To match desire with satisfaction. There are thousands of products in this world that would have been perfect for me, but I might never have known about them. Just like there’s a perfect girl out there for me, but I might never have met her. What’s wrong with listening to Tilly so that the perfect product finds the perfect consumer, the perfect girl finds the perfect boy?”

Jenny chuckled. “I love how you’re so good at rationalizing your state. I ask you again: If life with Tilly is so wonderful, why did you turn her off tonight?”

“I can’t explain it,” Sai said. He shook his head. “This is a mistake. I think I’ll head home.”

“Wait. Let me show you a few things about your beloved Tilly first,” Jenny said. She went to the desk and started typing, bringing up a series of documents on a monitor. She talked as Sai tried to scan and get their gist.

“Years ago, they caught Centillion’s traffic-monitoring cars sniffing all the wireless traffic from home networks on the streets they drove through. Centillion also used to override the security settings on your machine and track your browsing habits before they shifted to an opt-in monitoring policy designed to provide better ‘recommendations.’ Do you think they’ve really changed? They hunger for data about you—the more the better—and damned if they care about how they get it.”

Sai flicked through the documents skeptically. “If this is all true, why hasn’t anyone brought it up in the news?”

Jenny laughed. “First, everything Centillion did was arguably legal. The wireless transmissions were floating in public space, for example, so there was no violation of privacy. And the end-user agreement could be read to allow everything Centillion did to ‘make things better’ for you. Second, these days, how do you get your news except through Centillion? If Centillion doesn’t want you to see something, you won’t.”

“So how did you find these documents?”

“My machine is connected to a network built on top of the Net, one that Centillion can’t see inside. Basically, we rely on a virus that turns people’s computers into relaying stations for us, and everything is encrypted and bounced around so that Centillion can’t see our traffic.”

Sai shook his head. “You’re really one of those tinfoil-hat conspiracy theorists. You make Centillion sound like some evil repressive government. But it’s just a company trying to make some money.”

Jenny shook her head. “Surveillance is surveillance. I can never understand why some people think it matters whether it’s the government doing it to you or a company. These days, Centillion is bigger than governments. Remember, it managed to topple three countries’ governments just because they dared to ban Centillion within their borders.”

“Those were repressive places—”

“Oh, right, and you live in the land of the free. You think Centillion was trying to promote freedom? They wanted to be able to get in there and monitor everyone and urge them to all consume more so that Centillion could make more money.”

“But that’s just business. It’s not the same thing as evil.”

“You say that, but that’s only because you don’t know what the world really looks like anymore, now that it’s been remade in Centillion’s image.”

*  *  *  *  *

Although Jenny’s car was heavily shielded like her apartment, as she and Sai drove, she whispered anyway, as if she were afraid that their conversation would be overheard by people walking by on the sidewalk.

“I can’t believe how decrepit this place looks,” Sai said as she parked the car on the side of the street. The surface of the road was pockmarked with potholes, and the houses around them were in ill repair. A few had been abandoned and were falling apart. In the distance they could hear the fading sound of a police siren. This was not a part of Las Aldamas that Sai had ever been to.

“It wasn’t like this even ten years ago.”

“What happened?”

“Centillion noticed a certain tendency for people—some people, not all—to self-segregate by race when it came to where they wanted to live. The company tried to serve this need by prioritizing different real estate listings to searchers based on their race. Nothing illegal about what they were doing, since they were just satisfying a need and desire in their users. They weren’t hiding any listings, just pushing them far down the list, and in any event, you couldn’t ever pick apart their algorithm and prove that they were looking at race when it was just one out of hundreds of factors in their magical ranking formula.

“After a while, the process began to snowball, and the segregation got worse and worse. It became easier for the politicians to gerrymander districts based on race. And so here we are. Guess who got stuck in these parts of the town?”

Sai took a deep breath. “I had no idea.”

“If you ask Centillion, they’ll say that their algorithms just reflected and replicated the desire to self-segregate in some of their users, and that Centillion wasn’t in the business of policing thoughts. Oh, they’d claim that they were actually increasing freedom by giving people just what they wanted. They’d neglect to mention that they were profiting off it through real estate commissions, of course.”

“I can’t believe no one ever says anything about this.”

“You’re forgetting again that everything you know now comes filtered through Centillion. Whenever you do a search, whenever you hear a news digest, it’s been curated by Centillion to fit what it thinks you want to hear. Someone upset by the news isn’t going to buy anything sold by the advertisers, so Centillion adjusts things to make it all okay.

“It’s like we’re all living in Oz’s Emerald City. Centillion puts these thick green goggles over our eyes, and we all think everything is a beautiful shade of green.”

“You’re accusing Centillion of censorship.”

“No. Centillion is an algorithm that’s gotten out of hand. It just gives you more of what it thinks you want. And we—people like me—think that’s the root of the problem. Centillion has put us in little bubbles, where all we see and hear are echoes of ourselves, and we become ever more stuck in our existing beliefs and exaggerated in our inclinations. We stop asking questions and accept Tilly’s judgment on everything.

“Year after year, we become more docile and grow more wool for Centillion to shave off and grow rich with. But I don’t want to live that way.”

“And why are you telling me all this?”

“Because, neighbor, we’re going to kill Tilly,” Jenny said, giving Sai a hard look, “and you’re going to help us do it.”

*  *  *  *  *

Jenny’s apartment, with all its windows tightly shut and curtained, felt even more stifling after the car ride. Sai looked around at the flickering screens showing dancing, abstract patterns, suddenly wary. “And just how are you planning to kill Tilly?”

“We’re working on a virus, a cyber weapon, if you want to get all macho about it.”

“What exactly would it do?”

“Since the lifeblood of Tilly is data—the billions of profiles Centillion has compiled on every user—that’s how we have to take it down.

“Once inside the Centillion data center, the virus will gradually alter every user profile it encounters and create new, fake profiles. We want it to move slowly to avoid detection. But eventually, it will have poisoned the data so much that it will no longer be possible for Tilly to make creepy, controlling predictions about users. And if we do it slowly enough, they can’t even go to backups because they’ll be corrupted too. Without the data it’s built up over the decades, Centillion’s advertising revenue will dry up overnight, and poof, Tilly’ll be gone.”

Sai imagined the billions of bits in the cloud: his tastes, likes and dislikes, secret desires, announced intentions, history of searches, purchases, articles and books read, pages browsed.

Collectively, the bits made up a digital copy of him, literally. Was there anything that was a part of him that wasn’t also up there in the cloud, curated by Tilly? Wouldn’t unleashing a virus on that be like suicide, like murder?

But then he remembered how it had felt to have Tilly lead him by the nose on every choice, how he had been content, like a pig happily wallowing in his enclosure.

The bits were his, but not him. He had a will that could not be captured in bits. And Tilly had almost succeeded in making him forget that.

“How can I help?” Sai asked.

*  *  *  *  *

Sai woke to Miles Davis’s rendition of “So What.”

For a moment, he wondered if the memory of the night before wasn’t a dream. It felt so good to be awake, listening to just the song he wanted to hear.

“Are you feeling better, Sai?” Tilly asked.

Am I?

“I thought I turned you off, Tilly, with a hardware switch.”

“I was quite concerned that you stopped all Centillion access to your life last night and forgot to turn it back on. You might have missed your wake-up call. However, Centillion added a system-level fail-safe to prevent just such an occurrence. We thought most users such as yourself would want such an override so that Centillion could regain access to your life.”

“Of course,” Sai said. So it’s impossible to turn Tilly off and keep her off. Everything Jenny said last night was true. He felt a chill tingle on his back.

“There’s a gap of about twelve hours during which I couldn’t acquire data about you. To prevent degradation in my ability to help you, I recommend that you fill me in.”

“Oh, you didn’t miss much. I came home and fell asleep. Too tired.”

“There appears to have been vandalism last night of the new security cameras you installed. The police have been informed. Unfortunately, the camera did not capture a good image of the perpetrator.”

“Don’t worry about it. There’s nothing here worth stealing, anyway.”

“You sound a bit down. Is it because of the date last night? It seems that Ellen wasn’t the right match for you after all.”

“Um, yeah. Maybe not.”

“Don’t worry: I know just the thing that will put you in a good mood.”

*  *  *  *  *

Over the next few weeks, Sai found it extremely difficult to play his assigned role.

Maintaining the pretense that he still trusted Tilly was crucial, Jenny had emphasized, if their plan was to succeed. Tilly couldn’t suspect anything was going on at all.

It seemed simple enough at first, but it was nerve-racking, keeping secrets from Tilly. Could she detect the tremors in his voice? Sai wondered. Could she tell that he was faking enthusiasm for the commercial consumption transactions she suggested?

Meanwhile, he also had a much bigger puzzle to solve before John P. Rushgore, Assistant General Counsel of Centillion, came to Chapman Singh in another week.

Chapman Singh is defending Centillion in a patent dispute with ShareAll, Jenny had said. This is our opportunity to get inside Centillion’s network. All you have to do is to get someone from Centillion to plug this into his laptop.

And she had then handed him a tiny thumb drive.

*  *  *  *  *

Though he still hadn’t figured out a plan for plugging the thumb drive into a Centillion machine, Sai was glad to have come to the end of another long day of guarding himself against Tilly.

“Tilly, I’m going jogging. I’ll leave you here.”

“You know that it’s best to carry me with you,” Tilly said. “I can track your heart rate and suggest an optimal route for you.”

“I know. But I just want to run around on my own a bit, all right?”

“I’m growing quite concerned with your latest tendencies toward hiding instead of sharing.”

“There’s no tendency, Tilly. I just don’t want you to be stolen if I get mugged. You know this neighborhood has become more unsafe lately.”

And he turned off the phone and left it in his bedroom.

He closed the door behind him, made sure that the taped-over camera was still taped-over, and gently knocked on Jenny’s door.

*  *  *  *  *

Getting to know Jenny was the oddest thing he’d ever done, Sai realized.

He couldn’t count on Tilly to have made sure ahead of time that they would have topics to talk about. He couldn’t rely on Tilly’s always apropos suggestions when he was at a loss for words. He couldn’t even count on being able to look up Jenny’s ShareAll profile.

He was on his own. And it was exhilarating.

“How did you figure out everything Tilly was doing to us?”

“I grew up in China,” Jenny said, wiping a strand of hair behind her ear. Sai found the gesture inexplicably endearing. “Back then, the government watched everything you did on the Network and made no secret of it. You had to learn how to keep the insanity at bay, to read between the lines, to speak without being overheard.”

“I guess we were lucky, over here.”

“No.” And she smiled at his surprise. He was learning that she preferred to be contrarian, to disagree with him. He liked that about her. “You grew up believing you were free, which made it even harder for you to see when you weren’t. You were like frogs in the pot being slowly boiled.”

“Are there many like you?”

“No. It’s hard to live off the grid. I’ve lost touch with my old friends. I have a hard time getting to know people because so much of their lives are lived inside Centillion and ShareAll. I can peek in on them once in a while through a dummy profile, but I can never be a part of their lives. Sometimes I wonder if I’m doing the right thing.”

“You are,” Sai said, and, though there was no Tilly to prompt him, he took Jenny’s hand in his. She didn’t pull away.

“I never really thought of you as my type,” she said.

Sai’s heart sank like a stone.

“But who thinks only in terms of ‘types’ except Tilly?” she said quickly, then smiled and pulled him closer.

*  *  *  *  *

Finally, the day had come. Rushgore had come to Chapman Singh to prepare for a deposition. He was huddled up with the firm’s lawyers in one of their conference rooms all day long.

Sai sat down in his cubicle, stood up, and sat down again. He found himself full of nervous energy as he contemplated the best way to deliver the payload, as it were.

Maybe he could pretend to be tech support, there to perform an emergency scan of his system?

Maybe he could deliver lunch to him and plug the drive in slyly?

Maybe he could pull the fire alarm and hope that Rushgore would leave his laptop behind?

Not a single one of his ideas passed the laugh test.

“Hey.” The associate who had been with Rushgore in the conference room all day was suddenly standing next to Sai’s cubicle. “Rushgore needs to charge his phone—you got a Centillion charging cable over here?”

Sai stared at him, dumbfounded by his luck.

The associate held up a phone and waved it at him.

“Of course!” Sai said. “I’ll bring one right to you.”

“Thanks.” The associate went back to the conference room.

Sai couldn’t believe it. This was it. He plugged the drive into a charging cable and added an extension on the other end. The whole thing looked only a little odd, like a thin python that had swallowed a rat.

But suddenly he felt a sinking feeling in the pit of his stomach, and he almost swore aloud: He had forgotten to turn off the webcam above his computer—Tilly’s eyes—before preparing the cable. If Tilly raised questions about the weird cable he was carrying, he would have no explanation, and then all his efforts at misdirection, at hiding, would be for naught.

But there was nothing he could do about it now but proceed as planned. As he left his cubicle, his heart was almost in his throat.

He stepped into the hallway and strode down to the conference room.

Still nothing from his earpiece.

He opened the door. Rushgore was too busy with his computer even to look up. He grabbed the cable from Sai and plugged one end into his computer and the other end into his phone.

And Tilly remained silent.

*  *  *  *  *

Sai woke to—what else?—“We Are the Champions.”

The previous night of drinking and laughing with Jenny and her friends had been a blur, but he did remember coming home and telling Tilly, right before he fell asleep, “We did it! We won!”

Ah, if Tilly only knew what we were celebrating.

The music faded, stopped.

Sai stretched lazily, turned to his side, and stared into the eyes of four burly, very serious men.

“Tilly, call the police!”

“I’m afraid I can’t do that, Sai.”

“Why the hell not?”

“These men are here to help you. Trust me, Sai. You know I know just what you need.”

*  *  *  *  *

When the strange men had appeared in his apartment, Sai had imagined torture chambers, mental hospitals, faceless guards parading outside of dark cells. He had not imagined that he would be sitting across the table from Christian Rinn, Founder and Executive Chairman of Centillion, having white tea.

“You got pretty close,” Rinn said. The man was barely in his forties and looked fit and efficient—kind of like how I picture a male version of Tilly, Sai thought. He smiled. “Closer than almost anyone.”

“What was the mistake that gave us away?” Jenny asked.

She was sitting to Sai’s left, and Sai reached out for her hand. They intertwined their fingers, giving each other strength.

“It was his phone, on that first night he visited you.”

“Impossible. I shielded it. It couldn’t have recorded anything.”

“But you left it on your desk, where it could still make use of its accelerometer. It detected and recorded the vibrations from your typing. There’s a very distinctive way we strike the keys on a keyboard, and it’s possible to reconstruct what someone was typing based on the vibration patterns alone. It’s an old technology we developed for catching terrorists and drug dealers.”

Jenny cursed under her breath, and Sai realized that until that moment, on some level he still hadn’t quite believed Jenny’s paranoia.

“But I didn’t bring my phone after that first day.”

“True, but we didn’t need it. After Tilly picked up what Jenny was typing, the right alert algorithms were triggered and we focused surveillance on you. We parked a traffic observation vehicle a block away and trained a little laser on Jenny’s window. It was enough to record your conversations through the vibrations in the glass.”

“You’re a very creepy man, Mr. Rinn,” Sai said. “And despicable too.”

Rinn didn’t seem bothered by this. “I think you might feel differently by the end of our conversation. Centillion was not the first company to stalk you.”

Jenny’s fingers tightened around Sai’s. “Let him go. I’m the one you really want. He doesn’t know anything.”

Rinn shook his head and smiled apologetically. “Sai, did you realize that Jenny moved into the apartment next to yours a week after we retained Chapman Singh to represent us in the suit against ShareAll?”

Sai didn’t understand what Rinn was getting at, but he sensed that he would not like what he was about to find out. He wanted to tell Rinn to shut up, but he held his tongue.

“Curious, aren’t you? You can’t resist the pull of information. If it’s possible, you always want to learn something new; we’re hardwired that way. That’s the drive behind Centillion, too.”

“Don’t believe anything he says,” Jenny said.

“Would it surprise you to find out that the five other paralegals in your firm also had new neighbors move in during that same week? Would it also surprise you to learn that the new neighbors have all sworn to destroy Centillion, just like Jenny here? Tilly is very good at detecting patterns.”

Sai’s heart beat faster. He turned to Jenny. “Is this true? You planned from the start to use me? You got to know me just so you’d have a chance to deliver a virus?”

Jenny turned her face away.

“They know that there’s no way to hack into our systems from the outside, so they had to sneak a trojan in. You were used, Sai. She and her friends guided you, led you by the nose, made you do things—just like they accuse us of doing.”

“It’s not like that,” Jenny said. “Listen, Sai, maybe that was how it started. But life’s full of surprises. I was surprised by you, and that’s a good thing.”

Sai let go of Jenny’s hand and turned back to Rinn. “Maybe they did use me. But they’re right. You’ve turned the world into a panopticon and all the people in it into obedient puppets that you nudge this way and that just so you’d make more money.”

“You yourself pointed out that we were fulfilling desires, lubricating the engine of commerce in an essential way.”

“But you also fulfill dark desires.” He remembered again the abandoned houses by the side of the road, the pockmarked pavement.

“We unveil only the darkness that was already inside people,” Rinn said. “And Jenny didn’t tell you about how many child pornographers we’ve caught, how many planned murders we’ve stopped, or how many drug cartels and terrorists we’ve exposed. And all the dictators and strongmen we’ve toppled by filtering out their propaganda and magnifying the voices of those who oppose them.”

“Don’t make yourself sound so noble,” Jenny said. “After you topple governments, you and the other Western companies get to move in and profit. You’re just propagandists of a different ilk—for making the world flat, turning everywhere into copies of suburban America studded with malls.”

“It’s easy to be cynical like that,” Rinn said. “But I’m proud of what we’ve done. If cultural imperialism is what it takes to make the world a better place, then we’ll happily arrange the world’s information to ennoble the human race.”

“Why can’t you just be in the business of neutrally offering up information? Why not go back to being a simple search engine? Why all the surveillance and filtering? Why all the manipulation?” Sai asked.

“There’s no such thing as neutrally offering up information. If someone asks Tilly about the name of a candidate, should Tilly bring them to his official site or a site that criticizes him? If someone asks Tilly about ‘Tiananmen,’ should Tilly tell them about the hundreds of years of history behind the place or just tell them about June 4, 1989? The ‘I Trust You’ button is a heavy responsibility that we take very seriously.

“Centillion is in the business of organizing information, and that requires choices, direction, inherent subjectivity. What is important to you—what is true to you—is not as important or as true to others. It depends on judgment and ranking. To search for what matters to you, we must know all about you. And that, in turn, is indistinguishable from filtering, from manipulation.”

“You make it sound so inevitable.”

“It is inevitable. You think destroying Centillion will free you, whatever ‘free’ means. But let me ask you, can you tell me the requirements for starting a new business in the State of New York?”

Sai opened his mouth and realized that his instinct was to ask Tilly. He closed his mouth again.

“What’s your mother’s phone number?”

Sai resisted the urge to reach for his phone.

“How about you tell me what happened in the world yesterday? What book did you buy and enjoy three years ago? When did you start dating your last girlfriend?”

Sai said nothing.

“You see? Without Tilly, you can’t do your job, you can’t remember your life, you can’t even call your mother. We are now a race of cyborgs. We long ago began to spread our minds into the electronic realm, and it is no longer possible to squeeze all of ourselves back into our brains. The electronic copies of yourselves that you wanted to destroy are, in a literal sense, actually you.

“Since it’s impossible to live without these electronic extensions of ourselves, if you destroy Centillion, a replacement will just rise to take its place. It’s too late; the genie has long left the bottle. Churchill said that we shape our buildings, and afterward our buildings shape us. We made machines to help us think, and now the machines think for us.”

“So what do you want with us?” Jenny asked. “We won’t stop fighting you.”

“I want you to come and work for Centillion.”

Sai and Jenny looked at each other. “What?”

“We want people who can see through Tilly’s suggestions, detect her imperfections. For all that we’ve been able to do with AI and data mining, the Perfect Algorithm remains elusive. Because you can see her flaws, you’ll be the best at figuring out what Tilly’s still missing and where she’s gone too far. It’s the perfect match. You’ll make her better, more compelling, so that Tilly will do a better job.”

“Why would we do that?” Jenny asked. “Why would we want to help you run people’s lives with a machine?”

“Because as bad as you think Centillion is, any replacement is likely worse. It was not a mere PR move that I made ennobling the human race the mission of this company, even if you don’t agree with how I’ve gone about it.

“If we fail, who do you think will replace us? ShareAll? A Chinese company?”

Jenny looked away.

“And that is why we’ve gone to such extraordinary lengths to be sure that we have all the data we need to stop competitors as well as well-meaning, but naive, individuals like you from destroying all that Centillion has accomplished.”

“What if we refuse to join you but tell the world what you’ve done?”

“No one would believe you. We will make it so that whatever you say, whatever you write, no one will ever find it. On the Net, if it can’t be found by Centillion, it doesn’t exist.”

Sai knew that he was right.

“You thought Centillion was just an algorithm, a machine. But now you know that it’s built by people—people like me, people like you. You’ve told me what I’ve done wrong. Wouldn’t you rather be part of us so that you can try to make things better?

“In the face of the inevitable, the only choice is to adapt.”

*  *  *  *  *

Sai closed the door of the apartment behind him. The camera overhead followed.

“Will Jenny be coming over tomorrow for dinner?” Tilly asked.

“Maybe.”

“You really need to get her to start sharing. It will make planning much easier.”

“I wouldn’t count on it, Tilly.”

“You’re tired,” Tilly said. “How about I order you some hot organic cider for delivery and then you go to bed?”

That does sound perfect.

“No,” Sai said. “I think I prefer to just read for a while, in bed.”

“Of course. Would you like me to suggest a book?”

“I’d rather you take the rest of the night off, actually. But first, set the wake-up song to Sinatra’s ‘My Way.’ ”

“An unusual choice, given your taste. Is this a one-time experiment or would you like me to incorporate it into your music recommendations for the future?”

“Just this once, for now. Good night, Tilly. Please turn yourself off.”

The camera whirred, followed Sai to bed, and shut off.

But a red light continued to blink, slowly, in the darkness.