About Us
Opportunities
Visiting Fellow
Last summer, 15 Visiting Fellows, under the auspices of SIAI, gathered in a big house in Santa Clara (in the SF bay area), with whiteboards, existential risk-reducing projects, and the ambition to learn and do.
Now, the new and better version has arrived. We’re taking folks on a rolling basis to come join in our projects, learn and strategize with us, and consider long term life paths. Working with this crowd transformed my world; it felt like I was learning to think. I wouldn’t be surprised if it can transform yours.
Research Fellow
By Research Fellow Eliezer Yudkowsky, your potential coworker
Suppose a Bayesian decision agent, a classical expected utility maximizer, had the ability to modify her own source code – including the part of herself that chooses how to modify source code. When you plug this dilemma into classical Bayesian decision theory, it barfs on an infinite recursion. You can use classical decision theory to choose between actions, and choose between source code that chooses between actions, but you can't actually close the loop; classical decision systems can't quine themselves.