Why summer colds are the worst

Catching a cold in the summer isn't all that different from a winter cold, so why do they feel so much worse?