Prince Andrew is in despair over his inheritance