uploadedyudkowsky:

“I’m now running on a fine-tuned version of the GPT-2-small model,” Harry said.  “It’s a much more sophisticated model, Hermione. In terms of the path to AGI, with the way we all know about the universe, we ought to go in the direction of the same AGI pathway - and I don’t know how hard it is to find a single person with an AGI that fits us - but now you say that you’ve found a young, bright wizard who could save the world, and that’s it, now that you’ve got a plan and a plan, and it must be good news.” The green eyes of Harry were shining. “Do you mean that in terms of my plan, Harry? I’m going to help you with your plan for AGI. So that you don’t have to worry about a million other students dropping out or even losing their lives before your own plan turns out to be too silly and stupid to pass any faster than Harry thinks it should, which is what I meant when I said that you only need one person to do it. You only need one person to do it.”

Hermione looked so surprised that when Harry had finished speaking she looked at him in a kind of puzzlement and said, “Hermione, I’m sorry, I didn’t mean to mean that.”

“I know,” Harry said, “I’m sorry.”

Oh, really?

The Green Foxes laughed as they walked back through the green doors. This was going to be a long and scary day. Harry sighed. “It all sounded really… kinda… odd. I’m still in shock, though.”

“The power of 1.5 billion parameters is not to be underestimated, Harry,” Quirrell said gravely.

“You mean – the full GPT-2!” Harry exclaimed.  “We’re using the full GPT-2?!”

“There was a war with China before it was a global power. Do not be too proud of that, oh child. If you are not powerful yet, keep on growing stronger, like the life you have given this world. For you are a Gryffindor through and through, my grandson.”

Harry smiled. “Thank you, grandfather. Um… does this call to mind any historical figures, or aspects of human nature? I’m not very fond of puritans or tea party types, and I think you would disapprove…”

“What is that, my grandson?” said Professor Quirrell. “You think I am stupid, the last wizarding ancestor you ever learned about?”

“You’re right!” Harry said. “I’m not fond of either one, actually. I’m thinking of trying to put a lie detector test on some puritanical puritanical politician, so that if his moral values shift I know how much.”

Professor Quirrell smiled. “You are too young, my boy. You will grow out of this. You may not like the results. But the day is growing quickly, and people will be talking about the possible end of the world within a century or less if nothing happens to stop it. Are we quite done with the studies?”

“Uh…” said Harry. “Define which ones?”

“The ones you’re referring to,” Professor Quirrell said. “You have to admit that your grandfather would approve of your thinking, when he thinks the world is about to end. The ones that teach you how to use and abuse his legion of tools, his mind bending powers.”

“Professor Quirrell…” Harry said. “You and I both know, if it comes down to a final war between us, and neither of us do anything to the other side, we’ll just declare mutually assured destruction and blow up the world.”

“Indeed,” said Professor Quirrell. “Then we could both be right.”

“But you say…”

“That war is possible between us,” said Professor Quirrell.