<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	xmlns:unherd="https://www.unherd.com"
	>

	<channel>
		<title>Singularitarianism - UnHerd</title>
		<atom:link href="https://stage.unherd.com/tag/singularitarianism/feed/" rel="self" type="application/rss+xml" />
		<link>https://stage.unherd.com/tag/singularitarianism/</link>
		<description>think again</description>
		<lastBuildDate>Fri, 21 Dec 2018 13:09:23 +0000</lastBuildDate>
		<language>en-US</language>
		<sy:updatePeriod>hourly</sy:updatePeriod>
		<sy:updateFrequency>12</sy:updateFrequency>
		<generator>https://wordpress.org/?v=7.1.4</generator>

<image>
	<url>https://stage.unherd.com/wp-content/uploads/2019/09/cropped-favicon.jpg?w=32</url>
	<title>Singularitarianism - UnHerd</title>
	<link>https://stage.unherd.com/tag/singularitarianism/</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">241382538</site>				<item>
					<title>Silicon Valley&#8217;s &#8216;suicide pill&#8217; for mankind</title>
					<link>https://stage.unherd.com/2018/12/silicon-valleys-suicide-pill-mankind-2/?edition=us</link>
											<comments>https://stage.unherd.com/2018/12/silicon-valleys-suicide-pill-mankind-2/?edition=us#respond</comments>
										<unherd:featured_image>https://stage.unherd.com/wp-content/uploads/2018/08/GettyImages-634118910.jpg?w=525</unherd:featured_image>
										<unherd:main_theme></unherd:main_theme>
					<dc:creator>
						<![CDATA[Mark Piesing]]>
					</dc:creator>
					<unherd:creator_img>https://stage.unherd.com/wp-content/uploads/2018/07/piesing.jpg?w=96</unherd:creator_img>
																<unherd:article_ranking></unherd:article_ranking>
																<unherd:image_caption>
							<![CDATA[Credit: Carl Court/Getty Images]]>
						</unherd:image_caption>
						<unherd:twitter_bio>
							<![CDATA[<p>Mark Piesing writes about technology, culture and the intersection between the two.</p>
]]>
						</unherd:twitter_bio>
						<unherd:twitter_handle>markpiesing</unherd:twitter_handle>
															<unherd:author_bio>
						<![CDATA[Mark Piesing writes about technology, culture and the intersection between the two.]]>
					</unherd:author_bio>
										<pubDate>Mon, 31 Dec 2018 07:00:26 +0000</pubDate>
					<updated>Mon, 31 Dec 2018 07:00:26 +0000</updated>
							<category><![CDATA[Posthuman]]></category>
		<category><![CDATA[Silicon Valley]]></category>
		<category><![CDATA[Singularitarianism]]></category>
		<category><![CDATA[Transhumanism]]></category>
					<guid isPermaLink="false">http://old.unherd.com/?p=18020</guid>
																												<description>
								<![CDATA[]]>
							</description>
																		
																			<content:encoded>
								<![CDATA[<p>Last year, start-ups in America attracted more than $60 billion in venture capital funding. Of this, $12 billion alone was for artificial intelligence. Yet what the men and women who want to transform our society believe in has largely escaped our attention. It’s time we were told.</p>
<p>Silicon Valley is famous for its technological innovation. It’s less well known for being at the ideological cutting edge.</p>
<p>Two new technology-based ideologies that have been born in the Valley are transhumanism and posthumanism. It is hard to understand one without the other, and the boundaries between these two, still rather rough, sets of beliefs are very blurred.</p>
<p>Transhumanism has been <a href="https://foreignpolicy.com/2009/10/23/transhumanism/">described by Francis Fukuyama</a> as one of the greatest threats to the idea of human equality and says that transhumanists are &#8220;just about the last group I’d like to see live forever&#8221;. When <a href="https://www.wired.co.uk/article/creationists-vs-robots" target="_blank" rel="noopener">I wrote about transhumanism</a> for <em>Wired</em> back in 2014, many people thought I was a lunatic. Then, in the 2016 presidential election <a href="https://en.wikipedia.org/wiki/Zoltan_Istvan" target="_blank" rel="noopener">Zoltan Istvan</a> ran against Donald Trump as the Transhumanist Party’s candidate, and this year, Mark O’Connell’s book <a href="https://wellcomebookprize.org/book/be-machine" target="_blank" rel="noopener"><em>To Be a Machine</em></a> won the Wellcome Book Prize.</p>
<div class="inner-body-quote" data-type="quote">
	<div class="quote-open"></div>
	<div class="quote"><div class="inner">Transhumanism has become one of the de facto ideologies of the Silicon Valley establishment in that it justifies the Valley’s culture of &#8216;move fast, break things and make as much money as possible&#8217; 
	<div class="quote-close"></div></div>
	</div>
	
	<div class="attribution">- </div>
</div>
<p>It has been shaped by science-fiction, but the origins of transhumanism can be found as far back as the 1900s, or even earlier to the quest for immortality in the <a href="https://en.wikipedia.org/wiki/Epic_of_Gilgamesh" target="_blank" rel="noopener">Epic of Gilgamesh</a>, and the search for the Fountain of Youth. The first transhumanists formally met at the University of California, Los Angeles, in the early 1980s and quickly became the centre of transhumanist thinking. It now is a global movement with Italian <a href="https://www.newscientist.com/article/mg21528826-100-meet-the-worlds-first-transhumanist-politician/">Giuseppe Vatinno</a> the first elected transhumanist member of parliament.</p>
<p>Today, transhumanists count among their member&#8217;s influential figures such as futurist Raymond Kurzweil, Google’s Director of Engineering, Elon Musk, founder of Tesla and Space X, and Peter Thiel, founder of PayPal and the venture capitalist most people love to hate. Oxford University’s own Professor Nick Bostrom is co-cofounder of the World Transhumanist Association and author of the <em>New York Time</em>s best seller <em>Superintelligence: Paths, Dangers, Strategies,</em> which has been recommended by the likes of Bill Gates.</p>
<p>If you haven’t yet heard, transhumanism is a rather optimistic set of beliefs – a movement to liberate humanity – clustered around the core idea that technology will take us beyond the physical and intellectual limitations of being human. Technologies like nanotechnology, synthetic biology, robotics, AI and digital brain emulation will transform what it means to be human. Transhumanism of a sort is implied in the soft sell for self-driving cars, virtual reality and any kind of AI.</p>
<div class="ref-ar"><a href="https://stage.unherd.com/2018/07/robodoctor-will-see-now/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2018/07/robodoctor-will-see-now/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2018/07/GettyImages-939152960.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2018/07/robodoctor-will-see-now/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">More from this author</span></a><a href="https://stage.unherd.com/2018/07/robodoctor-will-see-now/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>The robodoctor will see you now</h5></a><p class="author"><a href="https://stage.unherd.com/2018/07/robodoctor-will-see-now/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Mark Piesing</a></p></div></a></div>
<p>Transhumanism, <a href="https://www.techvshuman.com/" target="_blank" rel="noopener">critics argue</a>, has become one of the de facto ideologies of the Silicon Valley establishment in that it justifies the Valley’s culture of &#8216;move fast, break things and make as much money as possible&#8217; – because &#8216;hey, what we are doing is liberating humanity&#8217;.</p>
<p>What is often left out of this explainer by those who want transhumanism to be taken seriously are the ‘wackier’ elements. The belief that this transformation will occur through the actual physical fusion of technology and humanity by body modification and enhancements. Or the belief that the exponential growth of technology is taking us on a journey far beyond our understanding of what it is to be human today, to a point when, in a literal sense, we become posthuman.</p>
<p>Our posthuman self could be an immortal digital entity able to download its consciousness into a synthetic body of its choice on Earth, or a robot exploring the moons of Jupiter. It could mean that we alter our very biology to enhance our bodies or become a <a href="https://www.nextnature.net/2016/02/homo-sapiens-homo-optimus/">new species of posthuman</a>. Other researchers have wondered if there is the need for an <a href="https://www.gefree.org.nz/assets/pdf/cloning.pdf">international treaty to save the endangered human.</a></p>
<p>Transhumanists call the almost mystical moment after which this fusion is possible &#8220;<a href="https://futurism.com/kurzweil-claims-that-the-singularity-will-happen-by-2045/" target="_blank" rel="noopener">The Singularity</a>&#8220;.</p>
<div class="ref-ar"><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2018/05/GettyImages-956745632.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">Further reading</span></a><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>The most influential religion you’ve never heard of</h5></a><p class="author"><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Peter Franklin</a></p></div></a></div>
<p>Then there is the belief in the inevitability of an AI takeover. This is a set of beliefs often confusingly called posthumanism. Rather than thinking about beyond humanity, this kind of posthumanism is more focused on the elimination of humanity. It is a darker, more extreme and pessimistic alternative to transhumanism. It shares many ideas with transhumanism such as the exponential growth of technology and a belief in The Singularity. But it removes the human agency behind technological change and believes in the inevitability of the creation of a superintelligent AI that replaces us in a very deterministic way.</p>
<p>According to this way of thinking, technology is evolving at an exponential rate driven by the constant need of capitalism to expand and it is inevitable that at some point along this curve the technological singularity will occur. This is the moment when humans create an artificial intelligence that surpasses the intellectual abilities of men and women, even a genius like Stephen Hawking. It is the last machine that humans will ever make.</p>
<p>With this level of intellectual firepower, the machine acquires the ability not only to reproduce itself but also to improve itself. The resulting <a href="https://intelligence.org/files/IE-EI.pdf" target="_blank" rel="noopener">“Intelligence Explosion”</a> leads to a runaway cycle of self-improving AI that results in a powerful, superintelligent computer that surpasses all human intelligence. Rather than physically fusing with this technology, the human era comes to an end in the Darwinian nightmare of the human race’s replacement by a superior intelligence that we ourselves have created.</p>
<p>At best we should just give a fatalistic shrug of our collective shoulders to our inevitable self-extermination. At worst, it is a suicide pill, since it is our evolutionary duty, believers argue, to create the AI that will replace us. Some posthumanists would even go so far as to argue that it would be a cosmic tragedy if we stopped this from happening.</p>
<p>Cosmists, as their name suggests, are in the &#8216;suicide pill&#8217; camp. Computer scientist <a href="https://agi-conf.org/2008/artilectwar.pdf" target="_blank" rel="noopener">Hugo de Garis argues</a> that humanity must build these “godlike super creatures”, which they call artilects, even if it risks the destruction of the human species. The assumption behind this is that the life of ordinary humans – whom they call Terrans – is worth less than that of artilects.</p>
<p>Cosmists like de Garis have started to argue that the drive to create these new godlike creatures will lead to the first “gigadeath war” – a war that kills billions of people. They believe that the war will start when ordinary humans try to prevent the creation of these superintelligent machines, and that the only way to survive alongside these new creatures is to become cyborgs.</p>
<p>These crazy-sounding beliefs are not, of course, universally accepted by the technology community, and there are different versions of each. There are also transhumanists like Elon Musk and Nick Bostrom who are aware of the risks of such a process of technological transformation. Others argue that The Singularity is already happening. What matters is that there are transhumanists and posthumanists in positions to decide where investment goes in the Valley and elsewhere.</p>
<div class="ref-ar"><a href="https://stage.unherd.com/2018/08/inhuman-politics-artificial-intelligence/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2018/08/inhuman-politics-artificial-intelligence/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2018/08/GettyImages-631826848.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2018/08/inhuman-politics-artificial-intelligence/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">Further reading</span></a><a href="https://stage.unherd.com/2018/08/inhuman-politics-artificial-intelligence/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>The inhuman politics of artificial intelligence</h5></a><p class="author"><a href="https://stage.unherd.com/2018/08/inhuman-politics-artificial-intelligence/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Jon Cruddas</a></p></div></a></div>
<p>Biohackers who try to alter their DNA at home or upgrade their own body with a neural interface may make the headline. But Peter Thiel has invested millions into biotechnology start-ups <a href="https://www.technocracy.news/paypal-founder-peter-thiel-pursuing-immortality-billions/">in search of a way to cheat death</a>. Then there is <a href="https://www.digitaltrends.com/cool-tech/neuralink-elon-musk/">Neuralink,</a> an American neurotechnology company founded by Elon Musk and eight others. It is reported to be developing implantable brain-computer cyborg-like interfaces that we see in sci-fi movies. It may even help humanity stay in control of AI.</p>
<p>‘Mind uploading’, otherwise known as whole brain emulation, has <a href="https://uk.businessinsider.com/this-startup-wants-to-upload-your-brain-to-the-cloud-but-it-has-to-kill-you-first-2018-3" target="_blank" rel="noopener">attracted millions of dollars of investment</a> from the billionaires of Silicon Valley and beyond. A leading venture capitalist told me that he is not worried about the AI research carried out in public in universities so much as the research that is going on in unregulated private laboratories.</p>
<p>In the end, we need to know what the researchers believe because to a posthuman the things that matter to us today, such as the privacy of our data, the health of our democracy and the survival of our local bookshop can too easily be seen as an outdated – as all too &#8216;human&#8217; concepts. The question is, do you?</p>
<style>
				a.appcomments {
					background: #FFF;
					border: 1px solid #446c76 !important;
					font-family: benton-sans,sans-serif;
					font-weight: 600;
					font-style: normal;
					font-size: 12px;
					color: #446c76 !important;
					padding: 12px 50px;
					text-transform: uppercase;
					letter-spacing: 1.5px;
					text-decoration: none;
					width: 100%;
					display: block;
					text-align: center !important;
				 }
			</style>
			<a href="https://stage.unherd.com/2018/12/silicon-valleys-suicide-pill-mankind-2/?edition=us?appcomments" class="appcomments">view comments</a>]]>
							</content:encoded>
																<unherd:comments_embed_url>https://stage.unherd.com/2018/12/silicon-valleys-suicide-pill-mankind-2/?edition=us?appcommentsnew</unherd:comments_embed_url>
											<wfw:commentRss>https://stage.unherd.com/2018/12/silicon-valleys-suicide-pill-mankind-2/?edition=us/feed/</wfw:commentRss>
															<post-id xmlns="com-wordpress:feed-additions:1">18020</post-id>				</item>
									<item>
					<title>Silicon Valley&#8217;s &#8216;suicide pill&#8217; for mankind</title>
					<link>https://stage.unherd.com/2018/08/silicon-valleys-suicide-pill-mankind/?edition=us</link>
											<comments>https://stage.unherd.com/2018/08/silicon-valleys-suicide-pill-mankind/?edition=us#comments</comments>
										<unherd:featured_image>https://stage.unherd.com/wp-content/uploads/2018/08/GettyImages-634118910.jpg?w=525</unherd:featured_image>
										<unherd:main_theme></unherd:main_theme>
					<dc:creator>
						<![CDATA[Mark Piesing]]>
					</dc:creator>
					<unherd:creator_img>https://stage.unherd.com/wp-content/uploads/2018/07/piesing.jpg?w=96</unherd:creator_img>
																<unherd:article_ranking></unherd:article_ranking>
																<unherd:image_caption>
							<![CDATA[Credit: Carl Court/Getty Images]]>
						</unherd:image_caption>
						<unherd:twitter_bio>
							<![CDATA[<p>Mark Piesing writes about technology, culture and the intersection between the two.</p>
]]>
						</unherd:twitter_bio>
						<unherd:twitter_handle>markpiesing</unherd:twitter_handle>
															<unherd:author_bio>
						<![CDATA[Mark Piesing writes about technology, culture and the intersection between the two.]]>
					</unherd:author_bio>
										<pubDate>Mon, 20 Aug 2018 08:10:34 +0000</pubDate>
					<updated>Mon, 20 Aug 2018 10:40:50 +0000</updated>
							<category><![CDATA[Posthuman]]></category>
		<category><![CDATA[Silicon Valley]]></category>
		<category><![CDATA[Singularitarianism]]></category>
		<category><![CDATA[Transhumanism]]></category>
					<guid isPermaLink="false">http://old.unherd.com/?p=15822</guid>
																												<description>
								<![CDATA[]]>
							</description>
																		
																			<content:encoded>
								<![CDATA[<p>Last year, start-ups in America attracted more than $60 billion in venture capital funding. Of this, $12 billion alone was for artificial intelligence. Yet what the men and women who want to transform our society believe in has largely escaped our attention. It’s time we were told.</p>
<p>Silicon Valley is famous for its technological innovation. It’s less well known for being at the ideological cutting edge.</p>
<p>Two new technology-based ideologies that have been born in the Valley are transhumanism and posthumanism. It is hard to understand one without the other, and the boundaries between these two, still rather rough, sets of beliefs are very blurred.</p>
<p>Transhumanism has been <a href="https://foreignpolicy.com/2009/10/23/transhumanism/">described by Francis Fukuyama</a> as one of the greatest threats to the idea of human equality and says that transhumanists are &#8220;just about the last group I’d like to see live forever&#8221;. When <a href="https://www.wired.co.uk/article/creationists-vs-robots" target="_blank" rel="noopener">I wrote about transhumanism</a> for <em>Wired</em> back in 2014, many people thought I was a lunatic. Then, in the 2016 presidential election <a href="https://en.wikipedia.org/wiki/Zoltan_Istvan" target="_blank" rel="noopener">Zoltan Istvan</a> ran against Donald Trump as the Transhumanist Party’s candidate, and this year, Mark O’Connell’s book <a href="https://wellcomebookprize.org/book/be-machine" target="_blank" rel="noopener"><em>To Be a Machine</em></a> won the Wellcome Book Prize.</p>
<div class="inner-body-quote" data-type="quote">
	<div class="quote-open"></div>
	<div class="quote"><div class="inner">Transhumanism has become one of the de facto ideologies of the Silicon Valley establishment in that it justifies the Valley’s culture of &#8216;move fast, break things and make as much money as possible&#8217; 
	<div class="quote-close"></div></div>
	</div>
	
	<div class="attribution">- </div>
</div>
<p>It has been shaped by science-fiction, but the origins of transhumanism can be found as far back as the 1900s, or even earlier to the quest for immortality in the <a href="https://en.wikipedia.org/wiki/Epic_of_Gilgamesh" target="_blank" rel="noopener">Epic of Gilgamesh</a>, and the search for the Fountain of Youth. The first transhumanists formally met at the University of California, Los Angeles, in the early 1980s and quickly became the centre of transhumanist thinking. It now is a global movement with Italian <a href="https://www.newscientist.com/article/mg21528826-100-meet-the-worlds-first-transhumanist-politician/">Giuseppe Vatinno</a> the first elected transhumanist member of parliament.</p>
<p>Today, transhumanists count among their member&#8217;s influential figures such as futurist Raymond Kurzweil, Google’s Director of Engineering, Elon Musk, founder of Tesla and Space X, and Peter Thiel, founder of PayPal and the venture capitalist most people love to hate. Oxford University’s own Professor Nick Bostrom is co-cofounder of the World Transhumanist Association and author of the <em>New York Time</em>s best seller <em>Superintelligence: Paths, Dangers, Strategies,</em> which has been recommended by the likes of Bill Gates.</p>
<p>If you haven’t yet heard, transhumanism is a rather optimistic set of beliefs – a movement to liberate humanity – clustered around the core idea that technology will take us beyond the physical and intellectual limitations of being human. Technologies like nanotechnology, synthetic biology, robotics, AI and digital brain emulation will transform what it means to be human. Transhumanism of a sort is implied in the soft sell for self-driving cars, virtual reality and any kind of AI.</p>
<div class="ref-ar"><a href="https://stage.unherd.com/2018/07/robodoctor-will-see-now/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2018/07/robodoctor-will-see-now/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2018/07/GettyImages-939152960.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2018/07/robodoctor-will-see-now/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">More from this author</span></a><a href="https://stage.unherd.com/2018/07/robodoctor-will-see-now/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>The robodoctor will see you now</h5></a><p class="author"><a href="https://stage.unherd.com/2018/07/robodoctor-will-see-now/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Mark Piesing</a></p></div></a></div>
<p>Transhumanism, <a href="https://www.techvshuman.com/" target="_blank" rel="noopener">critics argue</a>, has become one of the de facto ideologies of the Silicon Valley establishment in that it justifies the Valley’s culture of &#8216;move fast, break things and make as much money as possible&#8217; – because &#8216;hey, what we are doing is liberating humanity&#8217;.</p>
<p>What is often left out of this explainer by those who want transhumanism to be taken seriously are the ‘wackier’ elements. The belief that this transformation will occur through the actual physical fusion of technology and humanity by body modification and enhancements. Or the belief that the exponential growth of technology is taking us on a journey far beyond our understanding of what it is to be human today, to a point when, in a literal sense, we become posthuman.</p>
<p>Our posthuman self could be an immortal digital entity able to download its consciousness into a synthetic body of its choice on Earth, or a robot exploring the moons of Jupiter. It could mean that we alter our very biology to enhance our bodies or become a <a href="https://www.nextnature.net/2016/02/homo-sapiens-homo-optimus/">new species of posthuman</a>. Other researchers have wondered if there is the need for an <a href="https://www.gefree.org.nz/assets/pdf/cloning.pdf">international treaty to save the endangered human.</a></p>
<p>Transhumanists call the almost mystical moment after which this fusion is possible &#8220;<a href="https://futurism.com/kurzweil-claims-that-the-singularity-will-happen-by-2045/" target="_blank" rel="noopener">The Singularity</a>&#8220;.</p>
<div class="ref-ar"><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2018/05/GettyImages-956745632.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">Further reading</span></a><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>The most influential religion you’ve never heard of</h5></a><p class="author"><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Peter Franklin</a></p></div></a></div>
<p>Then there is the belief in the inevitability of an AI takeover. This is a set of beliefs often confusingly called posthumanism. Rather than thinking about beyond humanity, this kind of posthumanism is more focused on the elimination of humanity. It is a darker, more extreme and pessimistic alternative to transhumanism. It shares many ideas with transhumanism such as the exponential growth of technology and a belief in The Singularity. But it removes the human agency behind technological change and believes in the inevitability of the creation of a superintelligent AI that replaces us in a very deterministic way.</p>
<p>According to this way of thinking, technology is evolving at an exponential rate driven by the constant need of capitalism to expand and it is inevitable that at some point along this curve the technological singularity will occur. This is the moment when humans create an artificial intelligence that surpasses the intellectual abilities of men and women, even a genius like Stephen Hawking. It is the last machine that humans will ever make.</p>
<p>With this level of intellectual firepower, the machine acquires the ability not only to reproduce itself but also to improve itself. The resulting <a href="https://intelligence.org/files/IE-EI.pdf" target="_blank" rel="noopener">“Intelligence Explosion”</a> leads to a runaway cycle of self-improving AI that results in a powerful, superintelligent computer that surpasses all human intelligence. Rather than physically fusing with this technology, the human era comes to an end in the Darwinian nightmare of the human race’s replacement by a superior intelligence that we ourselves have created.</p>
<div class="inner-body-quote" data-type="quote">
	<div class="quote-open"></div>
	<div class="quote"><div class="inner">What matters is that there are transhumanists and posthumanists in positions to decide where investment goes in the Valley and elsewhere
	<div class="quote-close"></div></div>
	</div>
	
	<div class="attribution">- </div>
</div>
<p>At best we should just give a fatalistic shrug of our collective shoulders to our inevitable self-extermination. At worst, it is a suicide pill, since it is our evolutionary duty, believers argue, to create the AI that will replace us. Some posthumanists would even go so far as to argue that it would be a cosmic tragedy if we stopped this from happening.</p>
<p>Cosmists, as their name suggests, are in the &#8216;suicide pill&#8217; camp. Computer scientist <a href="https://agi-conf.org/2008/artilectwar.pdf" target="_blank" rel="noopener">Hugo de Garis argues</a> that humanity must build these “godlike super creatures”, which they call artilects, even if it risks the destruction of the human species. The assumption behind this is that the life of ordinary humans – whom they call Terrans – is worth less than that of artilects.</p>
<p>Cosmists like de Garis have started to argue that the drive to create these new godlike creatures will lead to the first “gigadeath war” – a war that kills billions of people. They believe that the war will start when ordinary humans try to prevent the creation of these superintelligent machines, and that the only way to survive alongside these new creatures is to become cyborgs.</p>
<p>These crazy-sounding beliefs are not, of course, universally accepted by the technology community, and there are different versions of each. There are also transhumanists like Elon Musk and Nick Bostrom who are aware of the risks of such a process of technological transformation. Others argue that The Singularity is already happening. What matters is that there are transhumanists and posthumanists in positions to decide where investment goes in the Valley and elsewhere.</p>
<div class="ref-ar"><a href="https://stage.unherd.com/2018/08/inhuman-politics-artificial-intelligence/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2018/08/inhuman-politics-artificial-intelligence/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2018/08/GettyImages-631826848.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2018/08/inhuman-politics-artificial-intelligence/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">Further reading</span></a><a href="https://stage.unherd.com/2018/08/inhuman-politics-artificial-intelligence/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>The inhuman politics of artificial intelligence</h5></a><p class="author"><a href="https://stage.unherd.com/2018/08/inhuman-politics-artificial-intelligence/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Jon Cruddas</a></p></div></a></div>
<p>Biohackers who try to alter their DNA at home or upgrade their own body with a neural interface may make the headline. But Peter Thiel has invested millions into biotechnology start-ups <a href="https://www.technocracy.news/paypal-founder-peter-thiel-pursuing-immortality-billions/">in search of a way to cheat death</a>. Then there is <a href="https://www.digitaltrends.com/cool-tech/neuralink-elon-musk/">Neuralink,</a> an American neurotechnology company founded by Elon Musk and eight others. It is reported to be developing implantable brain-computer cyborg-like interfaces that we see in sci-fi movies. It may even help humanity stay in control of AI.</p>
<p>‘Mind uploading’, otherwise known as whole brain emulation, has <a href="https://uk.businessinsider.com/this-startup-wants-to-upload-your-brain-to-the-cloud-but-it-has-to-kill-you-first-2018-3" target="_blank" rel="noopener">attracted millions of dollars of investment</a> from the billionaires of Silicon Valley and beyond. A leading venture capitalist told me that he is not worried about the AI research carried out in public in universities so much as the research that is going on in unregulated private laboratories.</p>
<p>In the end, we need to know what the researchers believe because to a posthuman the things that matter to us today, such as the privacy of our data, the health of our democracy and the survival of our local bookshop can too easily be seen as an outdated – as all too &#8216;human&#8217; concepts. The question is, do you?</p>
<style>
				a.appcomments {
					background: #FFF;
					border: 1px solid #446c76 !important;
					font-family: benton-sans,sans-serif;
					font-weight: 600;
					font-style: normal;
					font-size: 12px;
					color: #446c76 !important;
					padding: 12px 50px;
					text-transform: uppercase;
					letter-spacing: 1.5px;
					text-decoration: none;
					width: 100%;
					display: block;
					text-align: center !important;
				 }
			</style>
			<a href="https://stage.unherd.com/2018/08/silicon-valleys-suicide-pill-mankind/?edition=us?appcomments" class="appcomments">view comments</a>]]>
							</content:encoded>
																<unherd:comments_embed_url>https://stage.unherd.com/2018/08/silicon-valleys-suicide-pill-mankind/?edition=us?appcommentsnew</unherd:comments_embed_url>
											<wfw:commentRss>https://stage.unherd.com/2018/08/silicon-valleys-suicide-pill-mankind/?edition=us/feed/</wfw:commentRss>
															<post-id xmlns="com-wordpress:feed-additions:1">15822</post-id>				</item>
									<item>
					<title>The existential risks of AI</title>
					<link>https://stage.unherd.com/2018/05/existential-risks-ai/?edition=us</link>
											<comments>https://stage.unherd.com/2018/05/existential-risks-ai/?edition=us#respond</comments>
										<unherd:featured_image>https://stage.unherd.com/wp-content/uploads/2018/05/Ou-DongquXinhua-News-AgencyPA-Images.jpg?w=622</unherd:featured_image>
										<unherd:main_theme></unherd:main_theme>
					<dc:creator>
						<![CDATA[Nigel Cameron]]>
					</dc:creator>
					<unherd:creator_img>https://stage.unherd.com/wp-content/uploads/2018/01/nc-pic-stars.jpg?w=96</unherd:creator_img>
																<unherd:article_ranking></unherd:article_ranking>
																<unherd:image_caption>
							<![CDATA[Credit: Ou Dongqu/Xinhua News Agency/PA Images]]>
						</unherd:image_caption>
						<unherd:twitter_bio>
							<![CDATA[<p>Nigel Cameron writes about technology, society, and the future. In 2007 he founded the Washington think tank The Center for Policy on Emerging Technologies. His most recent book is Will Robots Take Your Job?</p>
]]>
						</unherd:twitter_bio>
						<unherd:twitter_handle>nigelcameron</unherd:twitter_handle>
															<unherd:author_bio>
						<![CDATA[Nigel Cameron writes about technology, society, and the future. In 2007 he founded the Washington think tank The Center for Policy on Emerging Technologies. His most recent book is Will Robots Take Your Job?]]>
					</unherd:author_bio>
										<pubDate>Tue, 29 May 2018 06:13:57 +0000</pubDate>
					<updated>Tue, 29 May 2018 06:13:57 +0000</updated>
							<category><![CDATA[Artificial intelligence]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[Silicon Valley]]></category>
		<category><![CDATA[Singularitarianism]]></category>
					<guid isPermaLink="false">https://old.unherd.com/?p=14323</guid>
																												<description>
								<![CDATA[]]>
							</description>
																		
																			<content:encoded>
								<![CDATA[<p>There’s been a long-running discussion among sci-fi writers and artificial intelligence researchers since the mid-20th century about what will happen when artificial intelligence (AI) gets really, really, smart. Many expect a sudden take-off moment when computers become superhumanly intelligent, creating, as <a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/" target="_blank" rel="noopener">Peter Franklin put it last week</a>, a &#8220;digital supreme being&#8221;. This scenario is referred to as the “singularity” – when the <a href="https://en.wikipedia.org/wiki/Moore%27s_law">Moore’s Law</a> curve goes near-vertical.[1. The basic idea? AI development is powered ultimately by <a href="https://en.wikipedia.org/wiki/Moore%27s_law">Moore’s Law</a> – the compounding impact of advances in digital processing power. It is therefore “inevitable” that, just as machines can already calculate and remember much better than humans, their power will soon match and then surpass the capacities of the human brain as a whole. Once that happens, machines will run the world.]
<p>Back in 2015, some of the top names in science and technology – including Stephen Hawking, Elon Musk, and Bill Gates – signed an <a href="https://futureoflife.org/ai-open-letter">Open Letter</a> warning that the risks of rogue AI go well beyond Amazon eaves-dropping in your living room (and recording your conversation, and sending it to someone else – which <a href="https://www.cnbc.com/2018/05/24/amazon-echo-recorded-conversation-sent-to-random-person-report.html" target="_blank" rel="noopener">happened to one couple</a> in Portland last week). As Musk, whose business empire spans Tesla electric cars and SpaceX rockets, <a href="https://techcrunch.com/2014/10/26/elon-musk-compares-building-artificial-intelligence-to-summoning-the-demon/?guccounter=1">put it</a>: “With artificial intelligence we’re summoning the demon.”</p>
<p>AI has already raised widespread fears about machines taking our jobs – although it&#8217;s a threat that governments have basically decided to ignore (U.S. Treasury Secretary Steven Mnuchin recently stated that it would be <a href="https://www.theatlantic.com/business/archive/2017/03/mnuchin-ai/520791/">50 or 100 years</a> before there was any impact). Less well recognised by the general public, but still causing concern, is the increasing concentration of power in the hands of a tiny elite, facilitated by this replacement of human labour by capital (in the shape of technology). Bill Joy, co-founder of Sun Microsystems, made this point in his stunning 2000 essay <a href="https://www.wired.com/2000/04/joy-2/">“Why the Future Doesn’t Need Us.”</a> At a practical level, it’s why there’s a rising cry among to break the growing power of the tech monopolies and their super-rich owners.</p>
<div class="ref-ar"><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2018/05/GettyImages-956745632.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">More on Singularitarianism...</span></a><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>The most influential religion you’ve never heard of</h5></a><p class="author"><a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Peter Franklin</a></p></div></a></div>
<p>But the fundamental threat posed by AI is “existential” – it’s a threat to human existence as we know it. Because we simply have no idea what will happen if machines really do become explosively smart and “take over.” Not just filch our jobs, not just give a handful of super-wealthy individuals the whip hand, but of they become the masters of the human species. Famed inventor and Google executive Ray Kurzweil, whose door-step volume <a href="https://en.wikipedia.org/wiki/The_Singularity_Is_Near">The Singularity is Near</a> has defined the debate, is as optimistic about the pace of change as he is about its benevolent outcomes.</p>
<p>Mathematics professor and sci-fi writer Vernor Vinge (pronounced Vingey), who is credited with coining the term “singularity” in this sense, agrees that &#8220;it will probably occur faster than any technical revolution seen so far&#8221;, but is less optimistic:</p>
<blockquote><p><em>And what happens a month or two (or a day or two) after that? I have only analogies to point to: The rise of humankind. We will be in the Posthuman era. And for all my technological optimism, I think I&#8217;d be more comfortable if I were regarding these transcendental events from one thousand years&#8217; remove . . . instead of twenty.</em>[2. Vernor Vinge, <a href="https://www.frc.ri.cmu.edu/~hpm/book98/com.ch1/vinge.singularity.html">‘Technological Singularity’</a>, presented at the VISION-21 Symposium, 1993]</blockquote>
<p>Founding editor of <em>Wired</em>, Kevin Kelly, is more skeptical. A long-time critic of Kurzweil and those who think like him, Kelly punches back against the core idea of the singularity – that machines will take charge and then be able to solve all our problems, including mortality itself.  He even suggests that Kurzweil’s obsession with the singularity is at root the result of his fear of death (the computer scientists uses such stratagems as caloric restriction and scoffing scores of vitamin tablets to try to slow the ageing process). And while Kelly agrees with the singularity crowd and the Open Letter crowd that we need to take the possibility of AI risk seriously, he’s a lot less worried about a singularity apocalypse.</p>
<div class="ref-ar"><a href="https://stage.unherd.com/2017/12/reported-now-proven-ability-ai-technology-outwit-us/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2017/12/reported-now-proven-ability-ai-technology-outwit-us/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2017/12/GettyImages-515690086.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2017/12/reported-now-proven-ability-ai-technology-outwit-us/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">Suggested reading</span></a><a href="https://stage.unherd.com/2017/12/reported-now-proven-ability-ai-technology-outwit-us/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>Under-reported: The now proven ability of AI technology to outwit us</h5></a><p class="author"><a href="https://stage.unherd.com/2017/12/reported-now-proven-ability-ai-technology-outwit-us/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Emily Thornberry</a></p></div></a></div>
<p>This critique is especially notable, since Kelly is not simply a tech enthusiast, he’s something of a fatalist about the future. His latest book, a roundup of the twelve tech trends shaping what comes next, is aptly titled <a href="https://www.amazon.com/Inevitable-Understanding-Technological-Forces-Future/dp/0143110373">The Inevitable</a>. But in singularity he sees a &#8220;<a href="https://www.newworldencyclopedia.org/entry/Cargo_cult" target="_blank" rel="noopener">cargo cult</a>&#8220;, based on false assumptions. He accuses singularity&#8217;s proponents of what he calls “thinkism” – the idea that human thinking is the be-all and end-all, and so if machines can do it better than we can they will solve all our problems in a burst of super-human intelligence. He calls it “the fallacy that future levels of progress are only hindered by a lack of thinking power.”</p>
<p>For one thing, he points out, the world does not lack for extraordinarily smart people. But curing cancer cannot come about through smart thoughts; however smart they are, it will need years of trials of treatments and medications. Moreover, there are many kinds of intelligence; it’s not just one thing.</p>
<blockquote><p><em>So the question is, where is the limit of intelligence? We tend to believe that the limit is way beyond us, way “above” us, as we are “above” an ant. Setting aside the recurring problem of a single dimension, what evidence do we have that the limit is not us? Why can’t we be at the maximum? Or maybe the limits are only a short distance away from us? Why do we believe that intelligence is something that can continue to expand forever?</em>[3. Kevin Kelly, <a href="https://www.wired.com/2017/04/the-myth-of-a-superhuman-ai/">‘The Myth of a Superhuman AI’</a>, <em>Wired</em>, April 2017; see also his blog: <a href="https://kk.org/thetechnium/the-singularity/">https://kk.org/thetechnium/the-singularity/</a>]</blockquote>
<p>In <a href="https://kk.org/thetechnium/the-singularity/">a thousand years’ time</a>, he reckons, we’ll still be expecting the singularity to occur soon.</p>
<div class="ref-ar"><a href="https://stage.unherd.com/2017/12/chinas-taking-quantum-leap-tech-rivalry-west/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2017/12/chinas-taking-quantum-leap-tech-rivalry-west/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2017/12/GettyImages-629391430.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2017/12/chinas-taking-quantum-leap-tech-rivalry-west/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">Suggested reading</span></a><a href="https://stage.unherd.com/2017/12/chinas-taking-quantum-leap-tech-rivalry-west/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>China’s taking a quantum leap in its tech rivalry with the West</h5></a><p class="author"><a href="https://stage.unherd.com/2017/12/chinas-taking-quantum-leap-tech-rivalry-west/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Peter Franklin</a></p></div></a></div>
<p>Concerns about AI risk have spawned a series of efforts to keep this smartest of human inventions under some kind of human control. Kelly himself <a href="https://kk.org/thetechnium/the-singularity/">calls for us</a> to engineer our values into AIs. U.S. congressman Brad Sherman once asked the Science and Technology Committee to fund “non-ambitious AI,” and then convened a hearing on the need for a non-proliferation approach to such technologies. [3. He told me this in personal conversation, and said fellow members of the committee responded by laughing. Here is the hearing, at which I testified: <a href="https://fas.org/irp/congress/2008_hr/genetics.pdf">https://fas.org/irp/congress/2008_hr/genetics.pdf</a>]
<p>The Hawking-Musk-Gates letter has helped boost other initiatives aimed at ensuring the safe and ethical development of AI, such as Cambridge University’s <a href="https://www.cser.ac.uk/">Centre for the Study of Existential Risk</a>, the <a href="https://lcfi.ac.uk/">Leverhulme Centre for the Future of Intelligence,</a> and the Berkeley<a href="https://humancompatible.ai/"> Center for Human-Compatible AI</a>.</p>
<p>“Welcome, singularitarians!” was how the conference chair opened proceedings at a cult-like singularity event I attended a decade back in New York City. Yet even among those most committed to the “singularity” analysis, there are clear differences of opinion, even if they are united in believing that this event will occur relatively soon (Kurzweil has suggested various dates; his latest prediction is for 2043). But they don’t all see things turning out quite as clearly as he does. Peter Thiel, long-time Kurzweil financial backer (and Facebook board member), made it plain when he addressed one recent singularity conference that he is more of a gradualist in his vision (in other words, like Kelly, he doesn’t really believe in the sudden, discrete, singularity idea at all – as some in the audience were quick to point out.) And they are by no means all as optimistic that its arrival will be good news.</p>
<p>So let’s give the last word to Vinge, who’s a much more interesting thinker than Kurzweil: “The longer we humans have our hand on the tiller, the better.”</p>
<div class="ref-ar"><a href="https://stage.unherd.com/2018/05/arent-worried-new-slave-economy/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2018/05/arent-worried-new-slave-economy/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2018/05/GettyImages-473876474.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2018/05/arent-worried-new-slave-economy/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">More from the author...</span></a><a href="https://stage.unherd.com/2018/05/arent-worried-new-slave-economy/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>Why aren&#039;t we more worried about the new slave economy?</h5></a><p class="author"><a href="https://stage.unherd.com/2018/05/arent-worried-new-slave-economy/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Nigel Cameron</a></p></div></a></div>
<style>
				a.appcomments {
					background: #FFF;
					border: 1px solid #446c76 !important;
					font-family: benton-sans,sans-serif;
					font-weight: 600;
					font-style: normal;
					font-size: 12px;
					color: #446c76 !important;
					padding: 12px 50px;
					text-transform: uppercase;
					letter-spacing: 1.5px;
					text-decoration: none;
					width: 100%;
					display: block;
					text-align: center !important;
				 }
			</style>
			<a href="https://stage.unherd.com/2018/05/existential-risks-ai/?edition=us?appcomments" class="appcomments">view comments</a>]]>
							</content:encoded>
																<unherd:comments_embed_url>https://stage.unherd.com/2018/05/existential-risks-ai/?edition=us?appcommentsnew</unherd:comments_embed_url>
											<wfw:commentRss>https://stage.unherd.com/2018/05/existential-risks-ai/?edition=us/feed/</wfw:commentRss>
															<post-id xmlns="com-wordpress:feed-additions:1">14323</post-id>				</item>
									<item>
					<title>The most influential religion you’ve never heard of</title>
					<link>https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us</link>
											<comments>https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us#respond</comments>
										<unherd:featured_image>https://stage.unherd.com/wp-content/uploads/2018/05/GettyImages-956745632.jpg?w=559</unherd:featured_image>
										<unherd:main_theme></unherd:main_theme>
					<dc:creator>
						<![CDATA[Peter Franklin]]>
					</dc:creator>
					<unherd:creator_img>https://stage.unherd.com/wp-content/uploads/2019/09/Peter-F.jpg?w=96</unherd:creator_img>
																<unherd:article_ranking></unherd:article_ranking>
																<unherd:image_caption>
							<![CDATA[Credit: Matt Card / Getty Images]]>
						</unherd:image_caption>
						<unherd:twitter_bio>
							<![CDATA[<p><strong>Peter Franklin</strong> is Associate Editor of <em>UnHerd</em>. He was previously a policy advisor and speechwriter on environmental and social issues.</p>
]]>
						</unherd:twitter_bio>
						<unherd:twitter_handle>peterfranklin_</unherd:twitter_handle>
															<unherd:author_bio>
						<![CDATA[ is Associate Editor of <em>UnHerd</em>. He was previously a policy advisor and speechwriter on environmental and social issues.]]>
					</unherd:author_bio>
										<pubDate>Mon, 21 May 2018 05:30:55 +0000</pubDate>
					<updated>Wed, 30 May 2018 09:37:08 +0000</updated>
							<category><![CDATA[Artificial intelligence]]></category>
		<category><![CDATA[Silicon Valley]]></category>
		<category><![CDATA[Singularitarianism]]></category>
		<category><![CDATA[UnPacked]]></category>
					<guid isPermaLink="false">https://old.unherd.com/?p=14180</guid>
																												<description>
								<![CDATA[]]>
							</description>
																		
																			<content:encoded>
								<![CDATA[<p>The folk who run our big tech companies are an odd lot.</p>
<p>For one thing, they&#8217;re super-wealthy and, as F Scott Fitzgerald warned us, the very rich &#8220;are different from you and me&#8221;. But while we might not know much about <i>their</i> lives, they know an awful about <i>ours</i> – thanks to their unprecedented control over the exchange of information. All-knowing and, hence, all-powerful, it&#8217;s been a long time since a ruling elite has appeared quite so&#8230; well, godlike. To add to their mystique it appears that many of them are followers of a weird religion.</p>
<p>Arguably all religions are weird. My own (Christianity, Roman Catholic flavour) is magnificently <a href="https://www.nytimes.com/2018/05/08/opinion/met-gala-catholic-church.html" target="_blank" rel="noopener">weird</a>. This is as it should be. After all, what would be the point of a metaphysical reality that can fit with ease into our puny human minds?</p>
<p>Those who condemn religion as irrational are missing the point, which is that there are some questions beyond the capacity of human reason to answer and that require us to engage other faculties. However, there exists, in Silicon Valley and elsewhere, a ‘secular religion&#8217; that proposes a very different solution to the limitations of human reason – which is that we should create artificial minds greater than our own.</p>
<p>In the <a href="https://www.economist.com/the-economist-explains/2018/05/14/what-is-the-singularity" target="_blank" rel="noopener"><i>Economist</i></a>, ‘T.C.’ writes about the &#8216;god&#8217; of this religion – a concept known as the &#8216;Singularity&#8217;:</p>
<blockquote><p>&#8220;The term has different definitions depending on whom you ask, and it often overlaps with ideas like transhumanism. But the broad idea is that the rate of technological progress is accelerating exponentially, and will continue to do so, to the point where it escapes all efforts at control&#8230;”</p></blockquote>
<p>It is hoped, though not necessarily assumed, that the resulting digital supreme being will provide us with the means to transcend our human limitations:</p>
<blockquote><p>&#8220;Optimists&#8230; conjure up an age of limitless material abundance and infinite leisure, with genetically modified humans bound together by brain implants into a solar-system spanning hivemind, or perhaps uploading their minds into a silicon utopia.&#8221;</p></blockquote>
<p>It has to be stressed that there are a lot of very senior people in the tech world who truly think this is going to happen. The <i>Economist</i> article mentions Masayoshi Son, not a denizen of Silicon Valley, but of Japan, where he is the founder, chairman and CEO of Softbank:</p>
<blockquote><p>&#8220;Robots will have IQs of 10,000 within the next 30 years, he says, and there will be as many of them on Earth as there are humans. Along with a group of science-fiction authors, futurists and computer programmers, Mr Son is an exponent of the idea of the Singularity.&#8221;</p></blockquote>
<p>That&#8217;s quite a claim because 30 years is not a lot of time. If you compare today&#8217;s world with the world in 1988, then, yes, there have been changes; but not, for those of us in the West, transformative changes. Our lives are basically the same. Thanks to <a href="https://stage.unherd.com/2018/01/lateral-thinking-can-save-us-economic-stagnation/" target="_blank" rel="noopener">Moore&#8217;s Law</a> – which underpins the expectation that the computer processing power available to us is increasing at an exponential rate (because it has done so far) – we have the internet and smart phones. Nevertheless our day-to-day experience of the real world is much as it was thirty years ago.</p>
<p>Those who think the Singularity will happen by 2048 must have faith in the continuation of Moore&#8217;s Law. They also need to believe that a further 30 years of it will make an immensely bigger difference than the previous 30 years.</p>
<div class="ref-ar"><a href="https://stage.unherd.com/2018/01/lateral-thinking-can-save-us-economic-stagnation/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2018/01/lateral-thinking-can-save-us-economic-stagnation/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2018/01/3FB8BE68-ADD9-4969-89BA-E7A89AFE9DC4.jpeg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2018/01/lateral-thinking-can-save-us-economic-stagnation/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">Further reading</span></a><a href="https://stage.unherd.com/2018/01/lateral-thinking-can-save-us-economic-stagnation/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>Only lateral thinking can save us from economic stagnation</h5></a><p class="author"><a href="https://stage.unherd.com/2018/01/lateral-thinking-can-save-us-economic-stagnation/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Peter Franklin</a></p></div></a></div>
<p>Hence the core dogma of Singularitarianism, which is that the continuation of exponential gains in processing power (plus related advances) will produce what Cross calls a &#8220;tipping point&#8221; i.e. the development of true artificial intelligence. Once that happens, AI will be harnessed to recursively improve upon itself in an upward spiral of ever-increasing digital brilliance.</p>
<p>However, I think the notion of robots with IQs of 10,000 rather gives the game away. A human being can solve an IQ puzzle that he or she has never seen before. A computer has to be told how to do it by its programmers – either in the form of a ready-made algorithm or by feeding it large amounts of labelled data. If presented with a different puzzle, the computer is completely clueless again.</p>
<p>To be intelligent in the way that people are intelligent requires creativity and consciousness. For all the exciting advances made in machine learning and &#8216;weak&#8217; artificial intelligence, the AI systems that actually exist are not in the slightest bit creative or conscious. The dream of somehow transmuting ‘weak AI’ into ‘strong AI’ owes more to alchemy than algorithms.</p>
<div class="ref-ar"><a href="https://stage.unherd.com/2017/11/alexa-turning-kid-brat/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2017/11/alexa-turning-kid-brat/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2017/11/amazon_echo-1.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2017/11/alexa-turning-kid-brat/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">Further reading</span></a><a href="https://stage.unherd.com/2017/11/alexa-turning-kid-brat/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>&#039;Alexa, are you turning my kid into a brat?&#039;</h5></a><p class="author"><a href="https://stage.unherd.com/2017/11/alexa-turning-kid-brat/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Peter Franklin</a></p></div></a></div>
<p>That&#8217;s why all talk of exponential increases in processing power is irrelevant. In terms of the progress we&#8217;ve made towards the &#8216;1&#8217; of the Singularity, our current position is precisely zero – despite decades of Moore’s Law in action.</p>
<p>Even if we double that progress every year for the next 30, 300 or 3,000 years, it will still be zero.</p>
<style>
				a.appcomments {
					background: #FFF;
					border: 1px solid #446c76 !important;
					font-family: benton-sans,sans-serif;
					font-weight: 600;
					font-style: normal;
					font-size: 12px;
					color: #446c76 !important;
					padding: 12px 50px;
					text-transform: uppercase;
					letter-spacing: 1.5px;
					text-decoration: none;
					width: 100%;
					display: block;
					text-align: center !important;
				 }
			</style>
			<a href="https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us?appcomments" class="appcomments">view comments</a>]]>
							</content:encoded>
																<unherd:comments_embed_url>https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us?appcommentsnew</unherd:comments_embed_url>
											<wfw:commentRss>https://stage.unherd.com/2018/05/influential-religion-youve-never-heard/?edition=us/feed/</wfw:commentRss>
															<post-id xmlns="com-wordpress:feed-additions:1">14180</post-id>				</item>
						</channel>
</rss>
