Superintelligence: Paths, Dangers, Strategies (71 page)

somatic gene therapy
42

sovereign AI
148
–
158
,
187
,
226
,
285

speech recognition
15
–
16
,
46

speed superintelligence
52
–
58
,
75
,
270
,
271

definition
53

Strategic Defense Initiative (“Star Wars”)
86

strong AI
18

stunting
135
–
137
,
143

sub-symbolic processing,
see
connectionism

superintelligence;
see also
collective superintelligence, quality superintelligence
and
speed superintelligence

definition
22
,
52

forms
52
,
59

paths to
22
,
50

predicting the behavior of
108
,
155
,
302

superorganisms
178
–
180

superpowers
52
–
56
,
80
,
86
–
87
,
91
–
104
,
119
,
133
,
148
,
277
,
279
,
296

types
94

surveillance
15
,
49
,
64
,
82
–
85
,
94
,
117
,
132
,
181
,
232
,
253
,
276
,
294
,
299

Szilárd, Leó
85

T

TD-Gammon
12

Technological Completion Conjecture
112
–
113
,
229

technology race
80
–
82
,
86
–
90
203
–
205
,
231
,
246
–
252
,
302

teleological threads
110

Tesauro, Gerry
12

TextRunner (system)
71

theorem prover
15
,
266

three laws of robotics
139
,
284

Thrun, Sebastian
19

tool-AI
151
–
158

definition
151

treacherous turn
116
–
119
,
128

Tribolium castaneum
154

tripwires
137
–
143

Truman, Harry
85

Turing, Alan
4
,
23
,
29
,
44
,
225
,
265
,
271
,
272

U

unemployment
65
,
159
–
180
,
287

United Nations
87
–
89
,
252
–
253

universal accelerator
233

unmanned vehicle,
see
drone

uploading,
see
whole brain emulation (WBE)

utility function
10
–
11
,
88
,
100
,
110
,
119
,
124
–
125
,
133
–
134
,
172
,
185
–
187
,
192
–
208
,
290
,
292
,
293
,
303

V

value learning
191
–
198
,
208
,
293

value-accretion
189
–
190
,
207

value-loading
185
–
208
,
293
,
294

veil of ignorance
150
,
156
,
253
,
285

Vinge, Vernor
2
,
49
,
270

virtual reality
30
,
31
,
53
,
113
,
166
,
171
,
198
,
204
,
300

von Neumann probe
100
–
101
,
113

von Neumann, John
44
,
87
,
114
,
261
,
277
,
281

W

wages
65
,
69
,
160
–
169

Watson (IBM)
13
,
71

WBE,
see
whole brain emulation (WBE)

Whitehead, Alfred N.6

whole brain emulation (WBE)
28
–
36
,
50
,
60
,
68
–
73
,
77
,
84
–
85
,
108
,
172
,
198
,
201
–
202
,
236
–
245
,
252
,
266
,
267
,
274
,
299
,
300
,
301

Wigner, Eugene
85

windfall clause
254
,
303

Winston, Patrick
18

wire-heading
122
–
123
,
133
,
189
,
194
,
207
,
282
,
291

wise-singleton sustainability threshold
100
–
104
,
279

world economy
2
–
3
,
63
,
74
,
83
,
159
–
184
,
274
,
277
,
285

Y

Yudkowsky, Eliezer
70
,
92
,
98
,
106
,
197
,
211
–
216
,
266
,
273
,
282
,
286
,
291
,
299