Starfish

"Okay," Scanlon said. "Does it feel better to perform reinforced behaviors, or unreinforced behaviors?"

The gel was silent for a moment or two. "Don't get the question."

"Which would you rather do?"

"Neither. No preference. Said that already."

Scanlon frowned. Why the sudden shift in idiom?

"And yet you're more likely to perform behaviors that have been reinforced in the past," he pressed.

No response from the gel. On the other side of the barrier Rowan sat down, her expression unreadable.

"Do you agree with my previous statement?" Scanlon asked.

"Yeah," drawled the gel, it's voice edging into the masculine.

"So you preferentially adopt certain behaviors, yet you have no preferences."

"Uh huh."

Not bad. It's figured out when I want confirmation of a declarative statement. "Seems like a bit of a paradox," Scanlon suggested.

"I think that reflects an inadequacy in the language as spoken." That time, the gel almost sounded like Rowan.

"Really."

"Hey," said the gel. "I could explain it to you if you wanted. Could piss you off though."

Scanlon looked at Rowan. Rowan shrugged. "It does that. Picks up bits and pieces of other people's speech patterns, mixes them up when it talks. We're not really sure why."

"You never asked?"

"Someone might have," Rowan admitted.

Scanlon turned back to the table. "Gel, I like your suggestion. Please explain to me how you can prefer without preference."

"Easy. Preference describes a tendency to… invoke behaviors which generate an emotional payoff. Since I lack the receptors and chemical precursors essential to emotional experience, I can't prefer. But there are numerous examples… of processes which reinforce behavior, but which… do not involve conscious experience."

"Are you claiming to not be conscious?"

"I'm conscious."

"How do you know?"

"I fit the definition." The gel had adopted a nasal, sing-song tone that Scanlon found vaguely irritating. "Self-awareness results from quantum interference patterns inside neuronal protein microtubules. I have all the parts. I'm conscious."

"So you're not going to resort to the old argument that you know you're conscious because you feel conscious."

"I wouldn't buy it from you."

"Good one. So you don't really like reinforcement?"

"No."

"Then why change your behavior to get more of it?"

"There… is a process of elimination," the gel admitted. "Behaviors which aren't reinforced become extinct. Those which are, are… more likely to occur in the future."

"Why is that?"

"Well, my inquisitive young tadpole, reinforcement lessens the electrical resistance along the relevant pathways. It just takes less of a stimulus to evoke the same behavior in future."

"Okay, then. As a semantic convenience, for the rest of our talk I'd like you to describe reinforced behaviors by saying that they make you feel good, and to describe behaviors which extinguish as making you feel bad. Okay?"

"Okay."

"How do you feel about your present functions?"

"Good."

"How do you feel about your past role in debugging the net?"

"Good."

"How do you feel about following orders?"

"Depends on order. Good if promotes a reinforced behavior. Else bad."

"But if a bad order were to be repeatedly reinforced, you would gradually feel good about it?"

"I would gradually feel good about it," said the gel.

"If you were instructed to play a game of chess, and doing so wouldn't compromise the performance of your other tasks, how would you feel?"

"Never played a game of chess. Let me check." The room fell silent for a few moments while some distant blob of tissue consulted whatever it used as a reference manual. "Good," it said at last.

"What if you were instructed to play a game of checkers, same caveat?"

"Good."

"Okay, then. Given the choice between chess and checkers, which game would you feel better playing?"

"Ah, better. Weird word, y'know?"

"Better means more good."

"Checkers," said the gel without hesitation.

Of course.

"Thank you," Scanlon said, and meant it.

"Do you wish to give me a choice between chess or checkers?"

"No thanks. In fact, I've already taken up too much of your time."

"Yes," said the gel.

Scanlon touched the screen. The link died.

"Well?" Rowan leaned forward on the other side of the barrier.

"I'm done here," Scanlon told her. "Thanks."

"What — I mean, what were you —»

"Nothing, Pat. Just — professional curiosity." He laughed briefly. "Hey, at this point, what else is there?"

Something rustled behind him. Two men in condoms were starting to spray down Scanlon's end of the room.

"I'm going to ask you again, Pat." Scanlon said. "What are you going to do with me?"

She tried to look at him. After a while, she succeeded. "I told you. I don't know."

"You're a liar, Pat."

"No, Dr. Scanlon." She shook her head. "I'm much, much worse."