You need more than that and, despite having such a short career, there is now a lot of Velvets product out there.
Personally, all the 'influential to Roxy Music, Bowie, punk etc. etc.' angle passes me by (who cares?) - I just listen to the records as I listen to The Small Faces' records; they shouldn't be blamed for all the dire stuff they influenced!
The two jewels, for me, are 'White Light/White Heat' and the 3rd LP (just called 'Velvet Underground').
'Nico' (still brilliant) is dragged down slightly by its huge reputation - not unlike 'Sgt. Pepper's'.
Some swear by it, but 'Loaded' I can live without, although the deluxe version does have some great demos from '69 on it, like the brilliant 'Ocean'.
I can't honestly say I've owned a Lou Reed solo record, 'cos I haven't!