Harry loses royal home