Granville George Leveson-Gower, 2. Earl Granville