Prince Andrew's reputation was deemed "irrecoverable" following his Newsnight interview, according to his former senior aide.