The Duke's Children by Anthony Trollope

Lady Glencora, the wife of Plantagenet Palliser, the Duke of Omnium, dies unexpectedly, leaving the Duke to deal with their grownup children, with whom he has a somewhat distant relationship. As the government in which he is Prime Minister has also fallen, the Duke is left bereft of both his beloved wife and his political position.