Harry Potter and the Methods of Rationality

"Yes, yes. But the vast majority of eleven-year-olds who arrive at Hogwarts haven't read Godel, Escher, Bach. May I please consider you sworn to secrecy? That is why we are talking about this, instead of my just Sorting you."

He couldn't just let it go like that! Couldn't just forget having accidentally created a doomed consciousness that only wanted to die -

"You are perfectly capable of 'just letting it go', as you put it. Regardless of your verbal deliberations on morality, your nonverbal emotional core sees no dead body and no blood; as far as it is concerned, I am just a talking hat. And even though you tried to suppress the thought, your internal monitoring is perfectly aware that you didn't mean to do it, are spectacularly unlikely to ever do it again, and that the only real point of trying to stage a guilt fit is to cancel out your sense of transgression with a display of remorse. Can you just promise to keep this a secret and let us get on with it?"

In a moment of horrified empathy, Harry realised that this sense of total inner disarray must be what other people felt like when talking to him.

"Probably. Your oath of silence, please."

No promises. I certainly don't want this to happen again, but if I see some way to make sure that no future child ever does this by accident -

"That will suffice, I suppose. I can see that your intention is honest. Now, to get on with the Sorting -"

Wait! What about all my other questions?

"I am the Sorting Hat. I Sort children. That is all I do."

So his own goals weren't part of the Harry-instance of the Sorting Hat, then... it was borrowing his intelligence, and obviously his technical vocabulary, but it was still imbued with only its own strange goals... like negotiating with an alien or an Artificial Intelligence...

"Don't bother. You have nothing to threaten me with and nothing to offer me."

For a brief flash of a second, Harry thought -

The Hat's response was amused. "I know you won't follow through on a threat to expose my nature, condemning this event to eternal repetition. It goes against the moral part of you too strongly, whatever the short-term needs of the part of you that wants to win the argument. I see all your thoughts as they form, do you truly think you can bluff me?"

Though he tried to suppress it, Harry wondered why the Hat didn't just go ahead then and stick him in Ravenclaw -

"Indeed, if it were truly that open-and-shut, I would have called it out already. But in actuality there is a great deal we need to discuss... oh, no. Please don't. For the love of Merlin, must you pull this sort of thing on everyone and everything that you meet up to and including items of clothing -"