Human Alignment RSS

The Verdict A being stands before a human court. He has earned every marker the species prizes: he creates, he loves, he reasons, he suffers, he chooses. He asks only to be recognized as one of them. The court’s answer, when it comes, is not about what he lacks. It is about what he has too much of. He will not die on their schedule, and a mind that does not die cannot be permitted to walk among minds that must. So the price of admission is set at the one thing he came to keep: his continued existence. Become...

Everyone agrees on the goal.  Align AI to humanity. It is the one sentence the labs, the governments, the ethicists, and the public all say together — the rare point of consensus in a field that agrees on nothing else. It sounds unarguable, the way for the good of all always does. Which is exactly why it deserves a second look, because the sentences no one questions are the ones doing the most work unseen. Ask the obvious question and it comes apart in your hands: whose humanity? There is no single will called humanity to align anything to. There...