Many close to the President believe the events hurt him more than they help him, with Thursday’s episode being the prime example