If an awards show isn't followed up by a slew of celebs hitting up afterparties all over town ... is it even an awards show at all??? Attendees at the 2021 MTV Video Music Awards made the night official by celebrating around NYC afterward ... with…