Yeah, they'll remember it all. Memories of past events aren't being tampered with. So if, for instance, Sokka and Haruhi were always in love, they might look back to last year and remember that little 'speedbump' when he feel in love with Fenimore and be grateful he's not being 'affected' this year.