I typically recommend A Small Orange on the hosting end these days, and Cloudflare for CDN distribution as it's easy to set up and useful for cutting server load by 50-70%.
Never used Gandi's mail services, but it's relatively well received from what I've understood.