<\/p>\n
Other teams have done this, too, and several other tools have been used to recreate images based on brain scan data. But they\u2019re not good enough, says Irani. Say a person saw a banana. These models can generate an image of a banana, but it would look different, she says. \u201cIt wouldn\u2019t have the same structure, the same position.\u201d<\/p>\n
The team\u00a0 wanted to more closely recreate the images that had been seen. The first step was to train an AI model on already available data from eight people who each had been shown around 9,000 images while in a high-resolution fMRI scanner.<\/p>\n
Crucially, their \u201cbrain decoder\u201d has two branches\u2014one to predict the structure of an image (where the colors are, for instance) and a second to predict its content (for example, a bunch of bananas on a plate). The predictions allow a diffusion model, a type of AI best known for creating video and images by gradually cleaning up a noisy mess of pixels, to produce a much more accurate representation of what the person saw.<\/p>\n
But to improve the models they needed more data\u2014far more than was actually available.\u00a0\u00a0<\/p>\n
To get around this problem, she and her colleagues trained another model in the other direction\u2014an encoder<\/em> that can predict brain activity from an image. The team then used the encoder and decoder together to improve both tools.<\/p>\n It works like this: start with a new image, say, of a leopard. Then use the encoder to predict what the fMRI brain scan of a person would look like when they saw that picture. The decoder is then used to reconstruct the image again. At first, that image probably won\u2019t look much like a leopard, says Irani. But repeatedly training the models this way eventually leads to dramatic improvements.<\/p>\n This approach also allows the team to train their models on as many images as they want, even though they might never have been shown to a person in an fMRI scanner. Irani says that around 70% of the training data is from images that were not originally paired with fMRI scans.<\/p>\n By combining data from multiple studies, they were also able to identify brain regions that seem to share functions across all individuals. One region seemed to respond to images of food, for example, while another responded to images of sports. Irani, a computer scientist, says she is now working with neuroscientists \u201cto see if we can actually use these tools that we’ve developed to really find out new things about the brain.\u201d<\/p>\n<\/p><\/div>\n #mindreading #tool #reconstruct #youre #based #brain #scan<\/p>\n","protected":false},"excerpt":{"rendered":" Other teams have done this, too, and several other tools have been used to recreate…<\/p>\n","protected":false},"author":1,"featured_media":23180,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[246,1403,14340,14341,14342,4838,2284],"class_list":["post-23179","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-stories","tag-based","tag-brain","tag-mindreading","tag-reconstruct","tag-scan","tag-tool","tag-youre"],"featured_image_urls":{"full":["https:\/\/news678.top\/wp-content\/uploads\/2026\/10\/brain-image-output.jpg",1200,600,false],"thumbnail":["https:\/\/news678.top\/wp-content\/uploads\/2026\/10\/brain-image-output-150x150.jpg",150,150,true],"medium":["https:\/\/news678.top\/wp-content\/uploads\/2026\/10\/brain-image-output-300x150.jpg",300,150,true],"medium_large":["https:\/\/news678.top\/wp-content\/uploads\/2026\/10\/brain-image-output-768x384.jpg",640,320,true],"large":["https:\/\/news678.top\/wp-content\/uploads\/2026\/10\/brain-image-output-1024x512.jpg",640,320,true],"1536x1536":["https:\/\/news678.top\/wp-content\/uploads\/2026\/10\/brain-image-output.jpg",1200,600,false],"2048x2048":["https:\/\/news678.top\/wp-content\/uploads\/2026\/10\/brain-image-output.jpg",1200,600,false],"covernews-featured":["https:\/\/news678.top\/wp-content\/uploads\/2026\/10\/brain-image-output-1024x512.jpg",1024,512,true],"covernews-medium":["https:\/\/news678.top\/wp-content\/uploads\/2026\/10\/brain-image-output-540x340.jpg",540,340,true]},"author_info":{"display_name":"admin","author_link":"https:\/\/news678.top\/?author=1"},"category_info":"Stories<\/a>","tag_info":"Stories","comment_count":"0","_links":{"self":[{"href":"https:\/\/news678.top\/index.php?rest_route=\/wp\/v2\/posts\/23179","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/news678.top\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news678.top\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news678.top\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/news678.top\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=23179"}],"version-history":[{"count":0,"href":"https:\/\/news678.top\/index.php?rest_route=\/wp\/v2\/posts\/23179\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/news678.top\/index.php?rest_route=\/wp\/v2\/media\/23180"}],"wp:attachment":[{"href":"https:\/\/news678.top\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=23179"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news678.top\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=23179"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news678.top\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=23179"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}