Reconstructing Images from Brain Activity

Neon

ネオン
Donator
Mar 23, 2008
51,773
18,521
513
Kingdom of Charis
#1
This is some seriously fucked up future shit.

The left clip is a segment of the movie that the subject viewed while in the magnet. The right clip shows the reconstruction of this movie from brain activity measured using fMRI. The reconstruction was obtained using only each subject's brain activity and a library of 18 million seconds of random YouTube video. (In brief, the algorithm processes each of the 18 million clips through the brain model, and identifies the clips that would have produced brain activity as similar to the measured brain activity as possible. The clips used to fit the model, those used to test the model and those used to reconstruct the stimulus were entirely separate.) Brain activity was sampled every one second, and each one-second section of the viewed movie was reconstructed separately.
For a related video see: http://www.youtube.com/watch?v=KMA23JJ1M1o
For more information about this work, please check our lab web site: http://gallantlab.org
[video=youtube;nsjDnYxJ0bo]http://www.youtube.com/watch?v=nsjDnYxJ0bo[/video]

If I understand this correctly, the reconstructed footage doesn't come from the brain, but from random other video footage that closely matches the brain stimulus. Kinda like cutting out individual letters from a newspaper and using them to spell something from memory.
 

ShooterMcGavin

Go back to your shanties.
May 25, 2005
18,028
1,380
643
#2
Didn't they do this in that Will Smith movie?