<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	xmlns:unherd="https://www.unherd.com"
	>

	<channel>
		<title>Nick Bostrom - UnHerd</title>
		<atom:link href="https://stage.unherd.com/tag/nick-bostrom/feed/" rel="self" type="application/rss+xml" />
		<link></link>
		<description>think again</description>
		<lastBuildDate>Tue, 10 Mar 2020 11:43:25 +0000</lastBuildDate>
		<language>en-US</language>
		<sy:updatePeriod>hourly</sy:updatePeriod>
		<sy:updateFrequency>12</sy:updateFrequency>
		<generator>https://wordpress.org/?v=7.1.4</generator>

<image>
	<url>https://stage.unherd.com/wp-content/uploads/2019/09/cropped-favicon.jpg?w=32</url>
	<title>Nick Bostrom - UnHerd</title>
	<link></link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">241382538</site>				<item>
					<title>Coronavirus is the wake-up call we need</title>
					<link>https://stage.unherd.com/2020/03/will-we-be-ready-for-the-next-pandemic/?edition=us</link>
											<comments>https://stage.unherd.com/2020/03/will-we-be-ready-for-the-next-pandemic/?edition=us#respond</comments>
										<unherd:featured_image>https://stage.unherd.com/wp-content/uploads/2020/03/GettyImages-93247292.jpg?w=507</unherd:featured_image>
										<unherd:main_theme></unherd:main_theme>
					<dc:creator>
						<![CDATA[Tom Chivers]]>
					</dc:creator>
					<unherd:creator_img>https://stage.unherd.com/wp-content/uploads/2019/09/chivers.jpg?w=96</unherd:creator_img>
																<unherd:article_ranking></unherd:article_ranking>
																<unherd:image_caption>
							<![CDATA[Innoculations during the A(H1N1) pandemic in 2009. Credit: AFP/AFP/Getty ]]>
						</unherd:image_caption>
						<unherd:twitter_bio>
							<![CDATA[<p><strong>Tom Chivers</strong> is a science writer. His second book, <em>How to Read Numbers</em>, is out now.</p>
]]>
						</unherd:twitter_bio>
						<unherd:twitter_handle>TomChivers</unherd:twitter_handle>
															<unherd:author_bio>
						<![CDATA[ is a science writer. His second book, <em>How to Read Numbers</em>, is out now.]]>
					</unherd:author_bio>
										<pubDate>Tue, 10 Mar 2020 00:10:00 +0000</pubDate>
					<updated>Tue, 10 Mar 2020 11:43:25 +0000</updated>
							<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[ai]]></category>
		<category><![CDATA[Climate change]]></category>
		<category><![CDATA[Coronavirus]]></category>
		<category><![CDATA[Foot and Mouth]]></category>
		<category><![CDATA[Nick Bostrom]]></category>
		<category><![CDATA[Superintelligent AI]]></category>
					<guid isPermaLink="false">https://old.unherd.com/?p=31191</guid>
																												<description>
								<![CDATA[The outbreak could help us avoid the complete annihilation of humanity ]]>
							</description>
																		
																			<content:encoded>
								<![CDATA[<p><span style="font-weight: 400;">Here are some numbers that are worth knowing. There are about 7.5 billion humans who are currently alive. That’s quite a lot: certainly more than have ever been alive at any point in the past. But it’s probably </span><a href="https://www.prb.org/howmanypeoplehaveeverlivedonearth/" target="_blank" rel="noopener noreferrer"><span style="font-weight: 400;">only about 7%</span></a><span style="font-weight: 400;"> of all the modern humans, </span><i><span style="font-weight: 400;">Homo sapiens,</span></i><span style="font-weight: 400;"> who have ever lived; there have been about 108 billion of those in the last 50,000 years.</span></p>
<p><span style="font-weight: 400;">(Depending where you draw the arbitrary line around “modern human”, of course.)</span></p>
<p><span style="font-weight: 400;">That’s just the beginning, though. What we really want to know is: how many will come after us?</span></p>
<p><span style="font-weight: 400;">The philosopher Nick Bostrom, building on work by the great Derek Parfit, </span><a href="https://www.existential-risk.org/concept.pdf" target="_blank" rel="noopener noreferrer"><span style="font-weight: 400;">had a go at answering this question</span></a><span style="font-weight: 400;">; you can also read about it </span><a href="https://smarturl.it/AIDoesNotHateYouHB" target="_blank" rel="noopener noreferrer"><span style="font-weight: 400;">in my own book</span></a><span style="font-weight: 400;">. The planet Earth will be able to support complex life for about a billion years. Say that the human population stabilises at a roomy one billion in the next thousand years or so; Bostrom works out that there will be about 10,000,000,000,000,000 people who follow us. That’s 10 quadrillion; about 1.3 million times as many people are currently alive.</span></p>
<p><span style="font-weight: 400;">Of course, that’s assuming we stay on Earth. If we leave the planet – if, at some point in the next million years or even more, we develop genuine space capability – it gets much more dramatic. If we can build craft that travel at 50% of lightspeed, we could reach about six quintillion stellar systems before the expansion of the universe puts the rest out of our reach; if we can reach 99% of lightspeed, that figure is more like 100 quintillion. </span></p>
<p><span style="font-weight: 400;">If, says Bostrom, 10% of those stars have habitable planets, each capable of supporting one billion humans for one billion years, then the number of human lives that could be supported is 1 followed by 35 zeroes. I could tell you how many times the current human population that is, but it would involve writing out some very long strings of noughts.</span></p>
<p><span style="font-weight: 400;">(Where it gets really weird, of course, is if we eventually learn how to build our own habitats from space rocks, so we’re not limited to existing planets; or upload human brains into computers, so we each take up a few picometres of circuitry rather than some number of thousands of square metres of planetary surface. Then you get some seriously huge numbers. But I don’t want to stretch your credulity here.)</span></p>
<div class="ref-ar"><a href="https://stage.unherd.com/2020/02/why-we-should-overreact-to-coronavirus/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2020/02/why-we-should-overreact-to-coronavirus/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2020/02/GettyImages-1198465048.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2020/02/why-we-should-overreact-to-coronavirus/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">Suggested reading</span></a><a href="https://stage.unherd.com/2020/02/why-we-should-overreact-to-coronavirus/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>Why we should be worried about coronavirus</h5></a><p class="author"><a href="https://stage.unherd.com/2020/02/why-we-should-overreact-to-coronavirus/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Peter Franklin</a></p></div></a></div>
<p><span style="font-weight: 400;">So, assuming we avoid killing ourselves or otherwise getting wiped out, there could be a lot of humans, or human-like beings, that follow us. If we think that those humans have any sort of moral value; if we think it is a good thing that they exist; that their joy or suffering matters, even a fraction as much as the joy or suffering of people alive now; then the lives of people who follow us matter an awful lot. </span></p>
<p><span style="font-weight: 400;">And what </span><i><span style="font-weight: 400;">that </span></i><span style="font-weight: 400;">means is that it really, really matters that we don’t let humanity go extinct. Some disaster – a nuclear war or pandemic, say – that killed 100% of humanity is not 1.0101…% worse than a disaster that killed 99%: it’s incomparably worse; millions of times worse.</span></p>
<p><span style="font-weight: 400;">The coronavirus outbreak is a disaster in its own right; the death toll could very easily reach the millions. The forecasting site Metaculus, which crowdsources predictions for wisdom-of-the-crowds purposes, has </span><a href="https://www.metaculus.com/questions/3530/how-many-people-will-die-as-a-result-of-the-2019-novel-coronavirus-covid-19-before-2021/" target="_blank" rel="noopener noreferrer"><span style="font-weight: 400;">a median estimate</span></a><span style="font-weight: 400;"> of 2.1 million deaths by 2021; its 95% certainty intervals are 210,000 and 27 million. This really could be the most dangerous pandemic in at least 100 years. </span></p>
<p><span style="font-weight: 400;">But it’s also a reminder that we could one day face something much worse. </span></p>
<p><span style="font-weight: 400;">Researchers at Oxford’s </span><a href="https://www.fhi.ox.ac.uk/" target="_blank" rel="noopener noreferrer"><span style="font-weight: 400;">Future of Humanity Institute</span></a> (FHI)<span style="font-weight: 400;">, and their Cambridge counterparts </span><a href="https://www.cser.ac.uk/research/" target="_blank" rel="noopener noreferrer"><span style="font-weight: 400;">the Centre for the Study of Existential Risk</span></a> (CSER)<span style="font-weight: 400;">, both look at ways that humanity could be destroyed. Climate change and, should it happen, nuclear war are highly likely to cause enormous damage, but</span> <a href="https://stage.unherd.com/2020/01/its-time-for-the-doom-mongers-to-clock-off/" target="_blank" rel="noopener noreferrer"><span style="font-weight: 400;">best estimates</span></a><span style="font-weight: 400;"> seem to suggest that they are unlikely to kill us all. We know that civilisation-destroying asteroids can’t happen all that often, because if there was even a 1% risk of one per century, it would be very unlikely that our species would have survived the 500 centuries it has so far.</span></p>
<div class="ref-ar"><a href="https://stage.unherd.com/2020/02/how-coronavirus-will-change-our-culture/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2020/02/how-coronavirus-will-change-our-culture/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2020/02/GettyImages-1208765870.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2020/02/how-coronavirus-will-change-our-culture/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">Suggested reading</span></a><a href="https://stage.unherd.com/2020/02/how-coronavirus-will-change-our-culture/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>Will coronavirus change the world?</h5></a><p class="author"><a href="https://stage.unherd.com/2020/02/how-coronavirus-will-change-our-culture/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Tom Chivers</a></p></div></a></div>
<p><span style="font-weight: 400;">Both CSER and FHI consider pandemics — specifically, genetically engineered pandemics, released either deliberately or accidentally — to be one of the two most likely ways for humanity to annihilate itself. The other is </span><a href="https://stage.unherd.com/2018/07/disney-shows-ai-apocalypse-possible/" target="_blank" rel="noopener noreferrer"><span style="font-weight: 400;">superintelligent AI</span></a><span style="font-weight: 400;">. </span><span style="font-weight: 400;">COVID-19 is not a genetically engineered pandemic. But it, among other things, can tell us a bit about how prepared the world is for one. The world has a much stronger response now than it did </span><a href="https://stage.unherd.com/thepost/chinas-coronavirus-will-not-be-the-next-black-death/"><span style="font-weight: 400;">even five years ago</span></a><span style="font-weight: 400;">; it is more coordinated, it shares data better. But there are still various things that are profoundly lacking. </span></p>
<p><span style="font-weight: 400;">The effective altruism movement focuses on the most effective ways to do good in the world, whether through your career or through charitable donations. The charity evaluator </span><a href="https://www.givewell.org/"><span style="font-weight: 400;">Givewell</span></a><span style="font-weight: 400;">, for instance, suggests that we ought to donate to charities that provide bed nets in countries at risk of malaria, because conservative estimates suggest that you can save a life for a couple of thousand pounds by doing so. But the “</span><a href="https://www.effectivealtruism.org/articles/cause-profile-long-run-future/"><span style="font-weight: 400;">long-termist</span></a><span style="font-weight: 400;">” parts of the movement focus on what we can do to reduce the risk of catastrophic disasters, because even a small reduction in the risk has a huge potential outcome when you’re dealing with numbers as big as those mentioned above. </span></p>
<p><span style="font-weight: 400;">Talking on the 80,000 Hours podcast, run by the Centre for Effective Altruism, FHI’s Cassidy Nelson, who studies catastrophic biological risks, lists</span><a href="https://80000hours.org/podcast/episodes/cassidy-nelson-12-ways-to-stop-pandemics/"><span style="font-weight: 400;"> 12 things</span></a><span style="font-weight: 400;"> that would help stop the next big outbreak. </span></p>
<p><span style="font-weight: 400;">At the moment, for example, it takes at least a year to get from new disease to patient-ready vaccine; that is a huge improvement over even a few years ago, but still, the timetable needs to come down enormously, probably via research into generic vaccines that can have the gene sequences of new diseases “plugged in”. Similarly, there are very few broad-spectrum antivirals in the same way that there are antibiotics. Screening for pathogens is very specific at the moment; improving ways to screen people and areas for any unknown new disease is vital. </span></p>
<p><span style="font-weight: 400;">Biosecurity, too, on even the most “secure” labs, is far short of what we’d want – the second foot-and-mouth outbreak in Britain was caused when </span><a href="https://en.wikipedia.org/wiki/Merial#Investigations"><span style="font-weight: 400;">a leaky pipe</span></a><span style="font-weight: 400;"> at a lab dripped active virus into the water supply of a farm. That lab was supposedly biosafety level 4 – the highest level. If it had been doing work on genetically engineered super-smallpox, it would not have been rated higher. And bafflingly, labs are not required to disclose accidents – such as that one – and are incentivised to keep them quiet so they don’t lose their BSL4 ratings. </span><span style="font-weight: 400;">There’s a huge lack of regulation over “dual-use” research – research into things like pathogens that could be used to help people but could also be used to cause harm.</span></p>
<p><span style="font-weight: 400;">There’s also the problem that synthetic biology – engineering DNA in labs – lacks oversight. In 2006 a <em>Guardian</em> reporter </span><a href="https://www.theguardian.com/science/2006/jun/23/weaponstechnology.guardianweekly"><span style="font-weight: 400;">ordered small sections</span></a><span style="font-weight: 400;"> of smallpox DNA from a private lab. It wasn’t enough to create the virus but it should have raised alarm bells. DNA sequencing is much more powerful now; regulation is even more important.</span></p>
<div class="ref-ar"><a href="https://stage.unherd.com/2020/03/how-coronavirus-plays-into-trumps-hands/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><a href="https://stage.unherd.com/2020/03/how-coronavirus-plays-into-trumps-hands/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><img decoding="async" src="https://stage.unherd.com/wp-content/uploads/2020/03/GettyImages-1148074927.jpg?w=300" /></a><div class="content"><a href="https://stage.unherd.com/2020/03/how-coronavirus-plays-into-trumps-hands/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span class="meta">Suggested reading</span></a><a href="https://stage.unherd.com/2020/03/how-coronavirus-plays-into-trumps-hands/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><h5>How coronavirus plays into Trump&#039;s hands</h5></a><p class="author"><a href="https://stage.unherd.com/2020/03/how-coronavirus-plays-into-trumps-hands/?edition=us&#038;ref=refinnar" class="text-decoration-none border-0"><span>By</span> Giles Fraser</a></p></div></a></div>
<p><span style="font-weight: 400;">None of these changes will be easy to make. Vaccines and antiviral drugs are not good money-spinners for pharmaceutical companies; encouraging their research will involve government or World Bank support. Perhaps incentivising them by creating research prizes would be a way to do it. Stronger world standards on biosecurity will need global coordination and leadership: labs and countries are often loath to reveal their own mistakes. But every small change we make will slightly increase the chance that humanity gets to enjoy the far future.</span></p>
<p><span style="font-weight: 400;">It’s worth talking about the huge potential future of humanity, as I did above, because we can get lost, sometimes, thinking about what are, in the end, short-term, local problems – Brexit, Trump, free-speech freakouts at university, trans rights. These things are important but they occupy an enormous amount of our attention, probably a disproportionate amount. But things that are much less fun to argue about get much less attention. Those things are sometimes prosaic, like antimalarial bed nets, and we don’t concentrate on them because </span><a href="https://slatestarcodex.com/2014/12/17/the-toxoplasma-of-rage/"><span style="font-weight: 400;">it doesn’t involve a big, satisfying fight</span></a><span style="font-weight: 400;">. But sometimes they’re big and weird, like existential risk; we get nervous of taking a position on them because we don’t want to look mad.</span></p>
<p><span style="font-weight: 400;">I don’t want to suggest that</span><span style="font-weight: 400;"> governments and research funding bodies</span><span style="font-weight: 400;"> drop everything and start focusing solely on preparing for the next pandemic; that would be as stupid as not doing anything at all. But I think it’s fair to say that civilisation is not as well prepared for big outbreaks as it could be, and that now is a good time – while everyone’s minds are focused – to improve things.</span><span style="font-weight: 400;"> Humans could be around for a billion years, or more, if we don’t screw it up. Coronavirus won’t be the thing that kills us all, but it’s a bloody good illustration of how something could.</span></p>
<style>
				a.appcomments {
					background: #FFF;
					border: 1px solid #446c76 !important;
					font-family: benton-sans,sans-serif;
					font-weight: 600;
					font-style: normal;
					font-size: 12px;
					color: #446c76 !important;
					padding: 12px 50px;
					text-transform: uppercase;
					letter-spacing: 1.5px;
					text-decoration: none;
					width: 100%;
					display: block;
					text-align: center !important;
				 }
			</style>
			<a href="https://stage.unherd.com/2020/03/will-we-be-ready-for-the-next-pandemic/?edition=us?appcomments" class="appcomments">view comments</a>]]>
							</content:encoded>
																<unherd:comments_embed_url>https://stage.unherd.com/2020/03/will-we-be-ready-for-the-next-pandemic/?edition=us?appcommentsnew</unherd:comments_embed_url>
											<wfw:commentRss>https://stage.unherd.com/2020/03/will-we-be-ready-for-the-next-pandemic/?edition=us/feed/</wfw:commentRss>
															<post-id xmlns="com-wordpress:feed-additions:1">31191</post-id>				</item>
						</channel>
</rss>
