I always thought it was Paul, but actually... it sounds like John does join in, to me anyway. Sort of in the way John says "yeah", but the voice singing "She loves you. . . " sounds like Paul's.
...great song, that. :O
Things they do look awful c-c-cold... yeah,I hope I die before I get old.