Interview on Future Blogger

Future Blogger recently interviewed Steve Omohundro about artificial intelligence. A summary of the interview is available here:
http://memebox.com/futureblogger/show/22
and the full transcript is here:
http://memebox.com/futureblogger/show/21

Paper on The Basic AI Drives

This paper is an intuitive presentation of the argument that advanced artificial intelligences will exhibit specific universal drives. It was published in the proceedings of the AGI-08 conference by IOS press: AGI-08 Workshop on the Sociocultural, Ethical and Futurological Implications of Artificial Intelligence . The PDF file for the paper (revised 1/25/08) is:
Stephen M. [...]

Foresight Vision Talk: Self-Improving AI and Designing 2030

On November 4, 2007 Steve Omohundro led a discussion at the Foresight Vision Weekend in which participants were asked to design the year 2030, assuming the existence of both self-improving artificial intelligence and productive nanotechnology. Great thanks to Drew Reynolds who filmed the talk, edited the video, and produced a transcript with the original slides. [...]

Stanford Computer Systems Colloquium Talk: Self-Improving AI and the Future of Computing

On October 24, 2007 Steve Omohundro gave the Stanford EE380 Computer Systems Colloquium on “Self-Improving Artificial Intelligence and the Future of Computing”. Great thanks to Drew Reynolds who filmed the talk, edited the video, and produced a transcript with the original slides. The video is available here:
http://video.google.com/videoplay?docid=635444280686112089&hl=en
The transcript and slides are available on the Accelerating [...]

Transcript of Singularity Summit Talk

Thanks to the efforts of Drew Reynolds, a transcript of Steve Omohundro’s September 8, 2007 Singularity Summit talk “The Nature of Self-Improving Artificial Intelligence” along with photographs and the original slides is now available:
http://www.acceleratingfuture.com/people-blog/?p=221
The Nature of Self-Improving Artificial Intelligence

I would like to talk about the “nature of self-improving artificial intelligence” and in this I mean [...]

What is rational behavior?

Much of our analysis of artificial and natural intelligence is based on the economic concept of rational behavior. This notion was introduced by von Neumann and Morgenstern in their landmark 1944 book “Theory of Games and Economic Behavior”. They only dealt with situations with objective probabilities, but their approach was later extended to subjective [...]

Paper on the Nature of Self-Improving Artificial Intelligence

An analysis of the likely behavior of self-improving systems was presented at the Singularity Summit 2007. The PDF file for the paper (revised 1/21/08) is:
Stephen M. Omohundro, “The Nature of Self-Improving Artificial Intelligence”
Abstract: Self-improving systems are a promising new approach to developing artificial intelligence. But will their behavior be predictable? Can we be sure [...]

AIs will want to self-improve whether they were designed to or not

The rational perspective on artificial intelligence leads to many important but sometimes unintuitive consequences. Details are described in the paper:
Stephen M. Omohundro, “The Nature of Self-Improving Artificial Intelligence”
but it seems worthwhile to flesh out some of the important ideas in separate blog posts.
Our primary focus is on systems which improve themselves. Many of the consequences [...]