Alexis, I think George was probably in his "added 6th" phase. You and poor Paul are stuck! The note never bothered me; I just took it as an artistic flourish, but it is definitely jarring.
About the "I'll Follow the Sun" solo, it's hard to think of what you might put in such a gentle, low-key song for 6 seconds. If these same notes were played on a flute, it would certainly match the mood. I think George was going for a dreamy little fill that would not take you out of the song.