Eli and Brian Update [Fwd: [>Htech] "Friendly AI" released for commentary]

From: Jeff Bone (jbone@jump.net)
Date: Thu Apr 19 2001 - 13:35:41 PDT

Cross-infecting from transhumantech, paper on "benevolent" AI by Eli
via Brian. It seems that, perhaps, our ancient thread on this may
have induced a small amount of moderation in the thinking...



attached mail follows:

"Friendly AI" Now Open For Commentary

The Singularity Institute has just announced that it has begun circulating a
preliminary version of "Friendly AI" for open commentary by the academic and
futurist communities. URL below.
"Friendly AI" is the first specific proposal for a set of design features
and cognitive architectures to produce a benevolent - "Friendly" -
Artificial Intelligence.[ The official launch is tentatively scheduled
for mid-June, but we hope to discuss the current paper with you at the
upcoming Foresight Gathering this weekend.]

With the publication of "Friendly AI", the topic has moved for the first time
beyond the realm of pure speculation, into the realm of technical speculation.
There is now a specific description of how a Friendly AI would operate, behave,
and make choices. In addition to increasing the safety of AI in the long run,
we hope that "Friendly AI" will raise the level of discussion in the
immediate debate about the long-term impact of very high technologies.

The Friendship architecture described in "Friendly AI" would not be
disrupted either by the ability of the AI to modify its own source code
(including goal-system source code), or by the AI moving beyond the point
of dependence on humans, two possibilities that are often treated as
synonymous with disaster in the current literature.


Brian Atkins
Director, Singularity Institute for Artificial Intelligence

-----BEGIN TRANSHUMANTECH SIGNATURE----- Post message: transhumantech@egroups.com Subscribe: transhumantech-subscribe@egroups.com Unsubscribe: transhumantech-unsubscribe@egroups.com List owner: transhumantech-owner@egroups.com List home: http://www.egroups.com/community/transhumantech/ Alt archive: http://www.planetx.com/majordomo/transhumantech/ Old archive: http://www.planetx.com/transhumantech/threads.html -----END TRANSHUMANTECH SIGNATURE-----

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/

This archive was generated by hypermail 2b29 : Sun Apr 29 2001 - 20:25:58 PDT