In the UK there were loads of singles (plus B-sides) that weren't on LPs.
1963
From Me To You - I'll Get You
She Loves You - Thank You Girl
I Want To Hold Your Hand - This Boy
1964
I Feel Fine - She's A Woman
1965
(Ticket To Ride) - Yes It Is
(Help!) - I'm Down
We Can Work It Out - Day Tripper
1966
Paperback Writer - Rain
1967
Penny Lane - Strawberry Fields Forever
All You Need Is Love - Baby You're A Rich Man
Hello Goodbye - I Am The Walrus (available on MMT EP)
1968
Lady Madonna - The Inner Light
Hey Jude - Revolution (alternative version on 'White Album')
1969
Get Back (longer than Let It Be version) - Don't Let Me Down
The Ballad of John and Yoko - Old Brown Shoe
1970
Let It Be (different version to the Let It Be LP) - You Know My Name (Look Up The Number)
Remember, Magical Mystery Tour was only released as a double EP in the UK - the US LP was padded with extra tracks.
I hope this info is correct, as I wrote it in work from memory!!