Creating Friendly AI is ©2001 by Singularity Institute for Artificial Intelligence, Inc.  All rights reserved.

Next: END Bookmark
Up: Creating Friendly AI Monolithic
Prev: 4: Policy implications


5: Miscellaneous

5.1: Relevant literature

Nonfiction (background info):

The Origins of Virtue.  By Matt Ridley.  Dispels many common misconceptions about the evolutionary psychology of altruism.

The MIT Encyclopedia of the Cognitive Sciences (aka "MITECS").  Edited by Robert A. Wilson and Frank C. Keil.  The source of all the quotes sprinkled through CFAI and GISAI.  I've tried to refer to it whenever possible so you only need to buy or borrow the one book.  Moderately technical.

The Adapted Mind.  Edited by Jerome Barkow, Leda Cosmides, and John Tooby.  Moderately technical.  A good book generally, but especially noteworthy for Cosmides and Tooby's excellent The Psychological Foundations of Culture.

Metamagical Themas.  By Douglas R. Hofstadter.  Includes several articles constituting a good introduction to the game theory of altruism.  Superseded by Origins of Virtue above, but still a fun read.

The Tao Is Silent.  By Raymond Smullyan.  The dichotomy between Asimov Laws imposed in conflict with an AI's true nature, and Friendliness that is the AI's true nature, is similar to the dichotomy Raymond Smullyan discusses between Western and Eastern moral philosophy.  (I believe that philosophy should be derived from cognitive science rather than the other way around, but I understand that others may feel differently.)

Web (specifically about Friendly AI):

Ethics for Machines.  By J. Storrs Hall.  http://discuss.foresight.org/~josh/ethics.html

Ethics for Transhumans.  By Peter Voss.  Criticism of "Ethics for Machines".  http://www.optimal.org/peter/ethics_for_transhumans.htm

Fiction (FAI plot elements):

A Fire Upon the Deep.  By Vernor Vinge.  Especially noteworthy for the first seven pages; the rest of the novel is slower-paced, but still important.

Diaspora.  By Greg Egan.  A novel set in a community of uploaded citizens.  As reading material, chiefly useful for dissipating future shock.  No transhumans appear.

Quarantine.  By Greg Egan.  An excellent novel all 'round.  Especially noteworthy for postulating, and fairly dealing with, Asimov-coercive human mind control through neurotechnology.

Exiles at the Well of Souls and Quest for the Well of Souls.  By Jack L. Chalker.  Includes an Asimov-coerced, materially powerful computer as a character.

Queen of Angels.  By Greg Bear.  Heartwarming plot elements surrounding Jane, an AI.

Feet of Clay.  By Terry Pratchett.  Heartwarming plot elements surrounding Dorfl, a golem.

The Two Faces of Tomorrow.  By James P. Hogan.

Cyberiad.  By Stanislaw Lem.  (Very strange humor.)

Exegesis.  By Astro Teller.  (Light reading.)

Video (accurate and inaccurate depictions):

The Matrix.  Evil Hollywood AIs.  "Like the dinosaur, you have become obsolete..."  (Note:  This is an excellent movie.  It's just that the AIs depicted are not cognitively realistic.)

Terminator and T2.  The enemy AIs don't have enough personality to be Evil Hollywood AIs.  The good AI in T2 is depicted in the original theatrical version as having acquired human behaviors simply by association with humans.  However, there's about 20 minutes of cut footage which shows (a) John Connor extracting the Arnold's neural-network chip and flipping the hardware switch that enables neural plasticity and learning, and (b) John Connor explicitly instructing Arnold to acquire human behaviors.  The original version of T2 is a better movie - has more emotional impact - but the uncut version of T2 provides a much better explanation of the events depicted.  The cut version shows Arnold, the Good Hollywood AI, becoming human; the uncut version shows Arnold the internally consistent cognitive process modifying itself in accordance with received instructions.


Next: END
Up: Creating Friendly AI
Prev: 4: Policy implications