Read Liars and Outliers Online
Authors: Bruce Schneier
In a blog post about the topic,
Clay Shirky referred
to the Supreme Court ruling in the Pentagon Papers case that said it's illegal to leak secrets but not illegal to publish leaks:
The legal bargain from 1971 simply does not and cannot produce the outcome it used to. This is one of the things freaking people in the US government out about the long-term change in the media environment—not that the law has changed, but that the world has. Industrial era law, applied to internet-era publishing, might allow for media outlets which exhibit no self-restraint around national sensitivities, because they are run by people without any loyalty to—or, more importantly, need of—national affiliation to do their jobs.
Foreign journalists pose a similar problem. The U.S. government has much less leverage to pressure
El Pais
or Al Jazeera to change its coverage than it does with the
New York Times.
That mattered less before the Internet could bring all those news sources to everyone so easily.
This unmooring of institutions from nationality is upending many societal pressures; things that used to work no longer do. We saw the same dynamic in international corporations, which can more easily skirt national laws by moving between different countries.
Now to the final change, which is organization behavior. In addition to allowing organizations to grow in size, and therefore power, and facilitating new types of organizational structures, information technology is also changing how organizations act.
There have been many books and articles discussing how corporations today are putting short-term stock prices above all
other business considerations
, including company health and long-term shareholder value. I've read lots of explanations for this change. That executives' bonuses are based on short-term numbers. That stocks are used more for short-term “bets” than for long-term investments. That mutual funds and complex index options further remove investors from the companies they invest in. And that
investors have access
to more information faster—and can act on that information faster.
You get what you measure,
6
and things like short-term profitability are much easier to measure than abstract concepts like long-term viability, or intangibles like customer satisfaction or reputation. An important facilitator for this dynamic—I don't know whether it's a cause or not—is information technology. Improved information technology makes the short-term numbers easier to monitor, so investors monitor them much more closely than ever before. This continuous monitoring makes them easier to optimize. We are better able to predict what a company's balance sheet will look like next week, and because we're so quick to trade one company for another, we care much less what it will look like in five years. This necessarily changes how investing works and how organizations behave: and the two are locked in a positive-feedback loop.
All these effects of ever-faster information technology affect other organizations at every scale, from the smallest groups to the entire world.
Modern large and technological trade-offs between group interest and competing interest are what social planners call
wicked problems
. These are problems that are difficult (or impossible) to solve because of incomplete, poorly understood, contradictory, or changing requirements; because of complex interdependencies; and because of their uniqueness and novelty. Examples include global climate change, AIDS and pandemics in general, nuclear waste, terrorism and homeland security, drug trafficking and other international smuggling, and national healthcare. All of those problems involve societal pressures, and all of their solutions involve coercing people into following group norms ahead of other competing interests.
But—and this is important—all of the big societal pressure problems are about more than trust and security. They're interdependent with other societal dilemmas. They're interdependent with other societal systems. They have moral, social, economic, and political dimensions. Their solutions involve answering questions about how society organizes itself, the role of national and international government, the extent of individual liberties, and what sort of outcomes are optimal and desirable. And these aspects of the problems are far more important, and difficult, than the trust aspects. It's not simply a matter of implementing the best societal pressures to induce broad cooperation; everything else matters more. The geopolitics that results in terrorism matter much more than any particular security measure against terrorists. The politics in which multinational corporations thrive matter much more than the societal pressures to ensure those corporations cooperate. The politics surrounding drug laws, tax laws, laws protecting civil liberties, and our social safety net matter much more than the societal pressures to ensure that those laws are followed. Look back to the figure in Chapter 15; the “constraints” and the “other considerations” are more important than the primary loop.
Here's one example. In 2011, science fiction author Charles Stross gave a talk on the
ubiquity of data
that's coming in the near future, from technologies like genetic mapping, “lifeblogging”—the audio and video recording of everything that happens to you—sensors on everyone and everything. Nothing he said required anything more than mild extrapolation. And then he talked about the issues that society is going to have to wrestle with once this data exists:
Is losing your genomic privacy an excessive price to pay for surviving cancer and evading plagues? (Broad analysis of everyone's genetic data will result in significant new understanding about disease, and a flurry of medical results that will significantly benefit everyone. At the same time, an individual's genetic data is both personal and private—even more so when companies start using it to prejudge people.)
Is compromising your sensory privacy through lifeblogging a reasonable price to pay for preventing malicious impersonation and apprehending criminals? (Lifeblogs have the potential to be a valuable police tool, not just by allowing victims to record crimes, but in the incidental recording of events in the background that later could be instrumental in identifying criminals.)
Is letting your insurance company know exactly how you steer and hit the gas and brake pedals, and where you drive, an acceptable price to pay for cheaper insurance? (Once insurance companies have all of this data, they could more easily offer differing insurance policy to different types of drivers.)
These are all societal dilemmas about how to balance group interest with self-interest. But before figuring out what kind of societal pressures to deploy to solve the problem, society first has to agree what the group interest is. We can't start talking about what kind of societal pressures to set up to prevent people from keeping their genome secret, or protecting the privacy of their lifeblog, or limiting access to their car's “black box” data, until we agree on what it means to cooperate and what it means to defect in these situations. It's difficult to solve societal dilemmas while society itself is changing so quickly.
This isn't the first time technological change has caused social changes that forced us to rethink society, and it won't be the last. The trick will be getting societal pressure right in a society that's moving so fast that getting it wrong is an increasingly dangerous option. This means getting faster and better at setting societal pressure knobs. It means setting them right the first time, and then correcting them quickly in response to feedback, delays, and technological changes. To that end, here is a list of principles for designing effective societal pressures:
We're currently in a period of history where technology is changing faster than it ever has. The worry is that if technology changes too fast, the defectors will be able to innovate so much faster than society can that the imbalances become even greater—increased scope of defection leading to an even more increased scope of defection—which can cause large societal failures. Think of what would happen to the Red Queen Effect if the stoats evolved faster than the rabbits: they would become significantly faster than the rabbits, then eat all the rabbits, and then all starve (assume there's no other prey). Defectors in societal dilemmas can have the same effect if they evolve too quickly: they overwhelm the cooperators, which means there are no more cooperators, and the defectors themselves lose. Remember, parasites need society to be there in order to benefit from defecting; and being a parasite is a successful strategy only if you don't take too many resources from your host.
On the other hand, we're also in a period of history where the ability for large-scale cooperation is greater than it ever has been before. In 2011, law professor
Yochai Benkler
published a book that is in many ways a companion volume to this one:
The Penguin and The Leviathan: How Cooperation Triumphs Over Self-Interest.
Benkler writes that the Internet can and has enabled cooperation on a scale never seen before, and that politics—backed by science—is ready to embrace this new cooperation: