Once strangers but now family, they celebrated their fifth Thanksgiving together, but this year there was an empty seat at the table