In this scene from The Avengers(2012) we see Cap remembering his old memories while he boxes which was a badass scene.
We see him remembering this, which is quite possible as he was there.
The same scene in the Hydra Base.
And this while he talks to Peggy before his plain crashed
But the main question is how come he remembers this? He was unconscious and partially frozen.