After the last three – rather damming – posts of mine, I thought a reconciliatory tone in an effort to being more constructive would be nice. In fact a great starting point for this will be to highlight what ‘we’ for the broadest definition of ‘we’ in fact do or even can want and have in common. Rational morality is an explicit effort to achieve good through reason and is based on two fundamental assumptions or axioms:
- existence is preferable over non-existence (or existence as necessary precondition for any want or desire)
- being rational is the best way to achieve one’s goals (including the goal of wanting to exist)
How about the SIAI et al? Not different at all it turns out:
In support of 1.)
- The notion of friendly AI is based on the crucial concept of the continued existence of humanity. Citing SIAI president Michael Vasser in a recent interview by the Skeptics Guide to the Universe @~41m:30s: “[...] for any given arbitrary preference function [acted upon by a powerful AI] it is very unlikely that [the result] includes us.”
- SIAI research fellow Anna Salamon stressing the prime importance of preventing an AI “who’s goals are not specifically, carefully rigged to be maximally fulfilled by our existence.” (around minute 28.)
- From the Lifeboat Foundation’s about page: “The Lifeboat Foundation is a nonprofit nongovernmental organization dedicated to encouraging scientific advancements while helping humanity survive existential risks”
- The entire concept of existential risks – championed by the founder of the Institute of Ethics and Emerging Technologies Nick Bostrom – is centered around the idea of “analyzing human extinction scenarios and related hazards”
- When you think about it, life extension is not much different – albeit focusing on individual’s continued existence or ’survival’ – with much of the same people advancing this cause as do the ones above.
In support of 2.)
- The entire notion of wanting to create greater than human intelligence is in the realization of the truth of assumption 2 and represented in quotes such as this one by Nick Bostrom: “Superintelligence may be the last invention humans ever need to make.”
- The matter being deemed of such great importance that the Singularity Institute and the Future of Humanity Institute have created LessWrong.com and devoted it to “refining the art of human rationality – the art of thinking”
I happen to be convinced that the power of these two statements combined is enough to ignore the is/ought problem and get away with it. Ayn Rand for example did a great job by at least stating the two fundamental values of ‘life’ or ‘existence’ and ‘reason’ explicitly. But where did she end up taking a wrong turn? In Michael Shermer’s view it is misplaced absolutism:
“The cultic flaw in Ayn Rand’s philosophy of Objectivism is not in the use of reason, or in the emphasis on individuality, or in the belief that humans are self motivated, or in the conviction that capitalism is the ideal system. The fallacy in Objectivism is the belief that absolute knowledge and final Truths are attainable through reason, and therefore there can be absolute right and wrong knowledge, and absolute moral and immoral thought and action.”
In my view her absolutism was not her downfall, but her simply being wrong by ignoring the implications of evolutionary dynamics as a crucial condistion of our existence. Her many character flaws – potentially driven by the key error in glorifying selfishness – in no way invalidate the basic insight however. Personally, I would never impose rational morality as an absolute on anyone, but would be quick to point out that if you do not want to exist nor have a desire to be rational then rational morality has in fact little to offer you. Non existence and irrational behavior being so trivial goals to achive after all that it would hardly require – nor value and thus seek for that mater – well thought out advice.
Entries (RSS)
November 12th, 2009 at 12:08 am
[...] « What do (can) we want? 12 11 2009 [...]
November 15th, 2009 at 8:25 pm
[...] our existence is a precondition for reaching any goal – including continued [...]
November 19th, 2009 at 9:58 pm
[...] two previous posts I highlighted the core similarities – wanting to ensure continued co-existence (unstated from the side of the mainstream) by [...]
November 23rd, 2009 at 7:08 am
[...] to provide a more constructive criticism I systematically worked out the as yet unrecognized fundamental similarities in regards to our shared goals when comparing my approach and that of mainstream futurist thought. Additionally I pointed out and [...]