He says residents who stayed home should seek refuge as a Category 4 hurricane heads toward the panhandle