We are at an amazing and critical juncture in human history. If we continue on our current path, we face many potential disasters: overpopulation, shortages of water, oil, and raw materials, financial instability, disease, terrorism, war, and the destruction of species and ecosystems (eg. see Jeffrey Sachs “Common Wealth: Economics for a Crowded Planet”). But the next few decades will also bring advances in science and technology which may dramatically improve our lives. It is remarkable that we are simultaneously on the verge of major revolutions in biology, neuroscience, psychology, artificial intelligence, nanotechnology, and fundamental physics.
The human genome was first sequenced in 2007 and biologists are now rapidly working to understand our 25,000 genes and the interacting network of proteins that they encode. This understanding is likely to lead to cures for many diseases and perhaps eliminate death. Molecular neuroscience is mapping the interconnection pattern and molecular mechanisms underlying brain function. Evolutionary psychology is identifying the historical pressures underlying our psychological makeup. Artificial intelligence is closing in on the algorithmic basis for intelligent action. Nanotechnology will soon allow us to manipulate matter atom by atom. New results in quantum physics and astrophysics are illuminating the fundamental nature of space, time, energy, and matter.
If we navigate this period of remarkable change with wisdom, we have the potential to create a future that uses these developments to support the best of our humanity. If we proceed blindly, there are many dangers and traps we might fall prey to.
Self-Aware Systems is a think tank based in Palo Alto devoted to bringing wisdom to emerging technologies. We are especially focused on analyzing and developing beneficial artificial intelligence. This has the potential to directly bring intelligence and human values into all our other technologies. This website contains a number of lectures and papers about our research. Good entry points are:
which one reviewer described as “the best piece of work on AI goals and behavior I saw in 2007″ and the more technical analysis:
The Nature of Self-Improving Artificial Intelligence
These issues are too important to be left solely to scientists. We need a global vision for the future we wish to create. If we can create a compelling vision, the new tools and understandings will make it a reality. We welcome your contribution!
Steve Omohundro
Send email to Steve Omohundro: