yeah, i doubt everything is stored. if everything is, in what format? photo? words? i mean, you learn new languages and new building blocks. your memory can be redefined many times due to that. how can you have an obsolute memory then?
i believe there are too many problems with this hypothesis. plus, if you cannot retrieve the info, might as well not be there. in all pragmatic sense, a memory is as useful as you can recall it. a memory that cannot be recalled is like a lost file. you can count it gone.
You may argue, there probably may be ways to retrieve your lost memory. that would be very interesting but when do, once again, in what form will be the memory? does that fullfill the platonistic epistimology? or Lockian? or other? are you born with building blocks for learning or do you build them while you are young. so many questions that will answer.