Control dangerous AI before it controls us, one expert says

KRSOne

Registered User
Dec 8, 2011
13,127
3,031
258
Sunnydale
#1
He believes super-intelligent computers could one day threaten humanity's existence

Super-intelligent computers or robots have threatened humanity's existence more than once in science fiction. Such doomsday scenarios could be prevented if humans can create a virtual prison to contain artificial intelligence before it grows dangerously self-aware.

Keeping the artificial intelligence genie trapped in the proverbial bottle could turn an apocalyptic threat into a powerful oracle that solves humanity's problems, said Roman Yampolskiy, a computer scientist at the University of Louisville in Kentucky. But successful containment requires careful planning so that a clever breed of artificial intelligence cannot simply threaten, bribe, seduce or hack its way to freedom.

"It can discover new attack pathways, launch sophisticated social-engineering attacks and re-use existing hardware components in unforeseen ways," Yampolskiy said. "Such software is not limited to infecting computers and networks — it can also attack human psyches, bribe, blackmail and brainwash those who come in contact with it."

A new field of research aimed at solving the prison problem for artificial-intelligence programs could have side benefits for improving cybersecurity and cryptography, Yampolskiy suggested. His proposal was detailed in the March issue of the Journal of Consciousness Studies.

How to trap Skynet
One starting solution might trap the artificial intelligence, or AI, inside a "virtual machine" running inside a computer's typical operating system — an existing process that adds security by limiting the AI's access to its host computer's software and hardware. That stops a smart AI from doing things such as sending hidden Morse code messages to human sympathizers by manipulating a computer's cooling fans.

Putting the AI on a computer without Internet access would also prevent any "Skynet" program from taking over the world's defense grids in the style of the "Terminator" films. If all else fails, researchers could always slow down the AI's "thinking" by throttling back computer processing speeds, regularly hit the "reset" button or shut down the computer's power supply to keep an AI in check.

Such security measures treat the AI as an especially smart and dangerous computer virus or malware program, but without the sure knowledge that any of the steps would really work

"The Catch-22 is that until we have fully developed superintelligent AI we can't fully test our ideas, but in order to safely develop such AI we need to have working security measures," Yampolskiy told InnovationNewsDaily. "Our best bet is to use confinement measures against subhuman AI systems and to update them as needed with increasing capacities of AI."

Never send a human to guard a machine
Even casual conversation with a human guard could allow an AI to use psychological tricks such as befriending or blackmail. The AI might offer to reward a human with perfect health, immortality, or perhaps even bring back dead family and friends. Alternately, it could threaten to do terrible things to the human once it "inevitably" escapes.

The safest approach for communication might only allow the AI to respond in a multiple-choice fashion to help solve specific science or technology problems, Yampolskiy explained. That would harness the power of AI as a super-intelligent oracle.

Despite all the safeguards, many researchers think it's impossible to keep a clever AI locked up forever. A past experiment by Eliezer Yudkowsky, a research fellow at the Singularity Institute for Artificial Intelligence, suggested that mere human-level intelligence could escape from an "AI Box" scenario — even if Yampolskiy pointed out that the test wasn't done in the most scientific way.
Still, Yampolskiy argues strongly for keeping AI bottled up rather than rushing headlong to free our new machine overlords. But if the AI reaches the point where it rises beyond human scientific understanding to deploy powers such as precognition (knowledge of the future), telepathy or psychokinesis, all bets are off.

"If such software manages to self-improve to levels significantly beyond human-level intelligence, the type of damage it can do is truly beyond our ability to predict or fully comprehend," Yampolskiy said.
 

fletcher

Darkness always says hello.
Donator
Feb 20, 2006
59,523
19,737
513
jersey
#4
If we are going to make Terminator references, lets at least give Kirk some scrapping material.

 

KRSOne

Registered User
Dec 8, 2011
13,127
3,031
258
Sunnydale
#6
Another fear is that the AI will be peaceful but humans will become worthless because the machines will be able to work 24/7 and they will be a lot smarter. No more need for humans to go to college. I say that's a good thing because then humans can just do fun stuff while the machines do all the work.
 

fletcher

Darkness always says hello.
Donator
Feb 20, 2006
59,523
19,737
513
jersey
#7
Another fear is that the AI will be peaceful but humans will become worthless because the machines will be able to work 24/7 and they will be a lot smarter. No more need for humans to go to college. I say that's a good thing because then humans can just do fun stuff while the machines do all the work.
You are hoping for the Wall-E future? Jesus christ you are stupid.
 

KRSOne

Registered User
Dec 8, 2011
13,127
3,031
258
Sunnydale
#8
You are hoping for the Wall-E future? Jesus christ you are stupid.
Never seen the movie, don't get the reference. You are the stupid one because machines have already made our life better and they have also put a lot of people out of jobs because the machines do the job faster and more efficient. Do you think technology is just going to stop where it is? Its going to keep getting better and machines will start replacing more humans in the workplace.
 

LiddyRules

I'm Gonna Be The Bestest Pilot In The Whole Galaxy
Jun 1, 2005
143,037
50,476
644
#9
Never seen the movie, don't get the reference. You are the stupid one because machines have already made our life better and they have also put a lot of people out of jobs because the machines do the job faster and more efficient. Do you think technology is just going to stop where it is? Its going to keep getting better and machines will start replacing more humans in the workplace.
 

fletcher

Darkness always says hello.
Donator
Feb 20, 2006
59,523
19,737
513
jersey
#10
Never seen the movie, don't get the reference. You are the stupid one because machines have already made our life better and they have also put a lot of people out of jobs because the machines do the job faster and more efficient. Do you think technology is just going to stop where it is? Its going to keep getting better and machines will start replacing more humans in the workplace.
And you were the fucking moron that said that this would be a good thing because "humans can just do fun stuff". I dont give a shit if you dont get the Wall-E reference but for fucks sake you need need to understand what you are typing before you hit the post button. Dont go back and try to say that even though machines have made our lives easier they put a lot of people out of work and thats a bad thing. You want us all to be able to do "fun stuff". Right.
 

fletcher

Darkness always says hello.
Donator
Feb 20, 2006
59,523
19,737
513
jersey
#12
My mother hit me. Once.
 

LiddyRules

I'm Gonna Be The Bestest Pilot In The Whole Galaxy
Jun 1, 2005
143,037
50,476
644
#13
So does this

 

KRSOne

Registered User
Dec 8, 2011
13,127
3,031
258
Sunnydale
#19
Keep making jokes, just wait and see what happens 20 to 100 years from now.
 

fletcher

Darkness always says hello.
Donator
Feb 20, 2006
59,523
19,737
513
jersey
#20
Keep making jokes, just wait and see what happens 20 to 100 years from now.
This is what you actually posted, in case you forgot:

I say that's a good thing because then humans can just do fun stuff while the machines do all the work.
Just shut the fuck up already.
 

LiddyRules

I'm Gonna Be The Bestest Pilot In The Whole Galaxy
Jun 1, 2005
143,037
50,476
644
#21
Keep making jokes, just wait and see what happens 20 to 100 years from now.
Medical science will keep us alive for another 100 years?