This artificial intelligence turns your brain waves into amazing videos

In order to better understand our cognitive mechanisms, researchers are trying to reconstruct human vision from the activities of our brain. Although recent research has already had great success reconstructing still images from non-invasive brain recordings, there has been a lack of work on restoring continuous visual experiences as videos.

The MinD-Video project makes it possible to reconstruct high-quality video from brain recordings. The peer-reviewed study can be found on the pre-publication platform arxiv. Based on artificial intelligence, the new model gradually learns spatio-temporal information from videos, that from brain signals (from continuous fMRI scanner data thanks to designdesign hidden from the brain).

A biologically acceptable and interpretable model

The result presents video images that are very close to reality, which once again demonstrates the remarkable capabilities of artificial intelligence. ” Attention analysis revealed correspondences with the visual cortex and higher cognitive networks, indicating that our paradigm is biologically plausible and interpretable. Researchers note.

Their analysis highlights it in particular a lighta light The primary role of the visual cortex in the processing of spatio-temporal visual information. Moreover, the encoderencoder It works in hierarchical layers: the initial layers focus on structural information, while the deeper layers focus on learning more abstract visual features.