“True to their intention, the couple tried to keep as much of the original building as they could, and even went to the property’s estate sale to buy George’s furniture back.”