A distinctive old house on Dornoch Terrace was built by a man, estranged from his family, for his new companion but it was taken from her after his death by the Supreme Court.