Comments on: Should ethicists be inside or outside a profession? http://singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/ The Singularity Institute exists to confront the challenge of powerful AI, both the opportunity and the risk. Thu, 15 Sep 2011 10:21:31 +0000 hourly 1 http://wordpress.org/?v=3.2.1 By: tony http://singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-104716 tony Sun, 28 Dec 2008 02:17:41 +0000 http://www.singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-104716 I seem to recall in RoboCop 2 an OCP public relations board filling Murphy with a huge number of conflicting directives. I think any governmental response would be roughly like that. I seem to recall in RoboCop 2 an OCP public relations board filling Murphy with a huge number of conflicting directives. I think any governmental response would be roughly like that.

]]> By: I want to achieve immortality by not dying « Entitled to an Opinion http://singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-18243 I want to achieve immortality by not dying « Entitled to an Opinion Tue, 04 Dec 2007 05:49:06 +0000 http://www.singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-18243 [...] about the “wisdom of repugnance”. Eliezer Yudkowsky dumps on those same bioethicists here, but he and I apparently disagree (I am not sure exactly how we differ) on how we regard ethics in [...] [...] about the “wisdom of repugnance”. Eliezer Yudkowsky dumps on those same bioethicists here, but he and I apparently disagree (I am not sure exactly how we differ) on how we regard ethics in [...]

]]> By: Eliezer Yudkowsky http://singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9523 Eliezer Yudkowsky Sun, 28 Oct 2007 01:51:16 +0000 http://www.singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9523 Robin Hanson had a nice way of putting this: We need <a href="http://www.overcomingbias.com/2007/04/expert_at_versu.html" rel="nofollow">experts at</a> AI ethics, not <a href="http://www.overcomingbias.com/2007/04/expert_at_versu.html" rel="nofollow">experts on</a> AI ethics. Robin Hanson had a nice way of putting this: We need experts at AI ethics, not experts on AI ethics.

]]> By: Joe Hunkins http://singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9324 Joe Hunkins Fri, 26 Oct 2007 08:52:40 +0000 http://www.singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9324 I think this is an important early question to ask the first conscious computers, and I suspect they'll say "inside or outside, it's all the same to us". I'll be OK with that answer. Of course if they say "What is ethics?" do we need to pull the plug before they figure out how to keep us from doing that? I think this is an important early question to ask the first conscious computers, and I suspect they’ll say “inside or outside, it’s all the same to us”. I’ll be OK with that answer.

Of course if they say “What is ethics?” do we need to pull the plug before they figure out how to keep us from doing that?

]]> By: Jeffrey Herrlich http://singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9280 Jeffrey Herrlich Fri, 26 Oct 2007 01:26:32 +0000 http://www.singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9280 I've recently become completely convinced that there is no such thing as "objective human morality". There are existence proofs of this, literally everywhere you look. So, since I've recently rejected "objective morality" I've also recently rejected "objective immorality". If it is not objective, then does immorality, in the platonic realm, have any meaning? I actually don't think so. To borrow a line from the movie "3:10 to Yuma" : "Every man is right by his own mind". I think there is great wisdom here. Before people misunderstand, I'm not saying that morality is unimportant. Just that we should be focusing on the pragmatic, not the romantic. That what matters most at this time is the *actions* of intelligent agents. Not the emotional/philosophical ruminations that lead humans to act and to claim what is ethical and what is unethical. Minds are deterministic. If people need someone to blame occasionally for the terrible injustices of the world, let them blame the mechanics of this Universe - for not having been a nicer, just place to begin with. Let's now focus on the technical problems of reshaping the Universe into a good place. The good place that we should have had from the beginning. I’ve recently become completely convinced that there is no such thing as “objective human morality”. There are existence proofs of this, literally everywhere you look. So, since I’ve recently rejected “objective morality” I’ve also recently rejected “objective immorality”. If it is not objective, then does immorality, in the platonic realm, have any meaning? I actually don’t think so. To borrow a line from the movie “3:10 to Yuma” : “Every man is right by his own mind”. I think there is great wisdom here. Before people misunderstand, I’m not saying that morality is unimportant. Just that we should be focusing on the pragmatic, not the romantic. That what matters most at this time is the *actions* of intelligent agents. Not the emotional/philosophical ruminations that lead humans to act and to claim what is ethical and what is unethical. Minds are deterministic. If people need someone to blame occasionally for the terrible injustices of the world, let them blame the mechanics of this Universe – for not having been a nicer, just place to begin with. Let’s now focus on the technical problems of reshaping the Universe into a good place. The good place that we should have had from the beginning.

]]> By: Jeffrey Herrlich http://singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9172 Jeffrey Herrlich Wed, 24 Oct 2007 20:22:18 +0000 http://www.singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9172 "Should ethicists be inside or outside a profession?" Considering that, in the future, a single researcher could ruin the entire Universe, I'd say that researchers should definitely consider the implications of what they are doing. If you'd like to label that consideration as "ethics" then go ahead. I used to spend more time thinking about what is "ethical" and what isn't. But when I realized that someone could potentially ruin the Universe forever, I decided that pragmatic thinking was more important at this point in time. “Should ethicists be inside or outside a profession?”

Considering that, in the future, a single researcher could ruin the entire Universe, I’d say that researchers should definitely consider the implications of what they are doing. If you’d like to label that consideration as “ethics” then go ahead. I used to spend more time thinking about what is “ethical” and what isn’t. But when I realized that someone could potentially ruin the Universe forever, I decided that pragmatic thinking was more important at this point in time.

]]> By: Roko http://singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9158 Roko Wed, 24 Oct 2007 16:32:03 +0000 http://www.singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9158 "Real AGI research will continue under cover of darkness, probably under a different label." Yes, that does sound plausible to me. And I think that would probably the worst possible outcome! “Real AGI research will continue under cover of darkness, probably under a different label.”

Yes, that does sound plausible to me. And I think that would probably the worst possible outcome!

]]> By: Peter de Blanc http://singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9122 Peter de Blanc Wed, 24 Oct 2007 08:41:08 +0000 http://www.singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9122 <i>In fact, I recall having heard you claim art was useless and a waste of time.</i> That would really surprise me if true. Can you provide a reference? In fact, I recall having heard you claim art was useless and a waste of time.

That would really surprise me if true. Can you provide a reference?

]]> By: Josh Brighton http://singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9091 Josh Brighton Tue, 23 Oct 2007 22:08:59 +0000 http://www.singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9091 How is it that someone, such as yourself, who knows nothing about "art" or painting, as one particular art, writes about art? In fact, I recall having heard you claim art was useless and a waste of time. How is it that someone, such as yourself, who knows nothing about “art” or painting, as one particular art, writes about art?

In fact, I recall having heard you claim art was useless and a waste of time.

]]> By: Keith Elis http://singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9088 Keith Elis Tue, 23 Oct 2007 21:19:16 +0000 http://www.singinst.org/blog/2007/10/21/should-ethicists-be-inside-or-outside-a-profession/#comment-9088 Eliezer, do you think it is possible for a non-professional to obtain adequate mastery of a subject matter such that his or her ethical commentary is not irrelevant (say, a patent clerk mastering physics)? If so, then this post doesn't seem to support its answer to the title question. Eliezer, do you think it is possible for a non-professional to obtain adequate mastery of a subject matter such that his or her ethical commentary is not irrelevant (say, a patent clerk mastering physics)?

If so, then this post doesn’t seem to support its answer to the title question.

]]>