Built in 1881, The Payne Mansion belonged to Theodore Fryatt Payne and his wife Mary Pauline O'Brien, an heiress who amassed a fortune from her silver-baron uncle.