I kind of like the idea that memory doesn't reside in the brain per say.
However, it's also true that doctors have not found the exact spot of a brain that hold a memory. That it appears to be holographic in a way. Each bit of the brain stores content as much as all the other bits. I hope this is not misinformation.
Then, from here we can take the leap that the universe is a holographic form such that anything we take in our brain is also showing up everywhere else

! now that's a theory, ha?