I'm in a "normal" cost of living city, though prices keep going up. We'd make slightly more in CA, but all the other expenses would go up, at least proportionally.
For how much we spend here, we can afford to fly, stay in a hotel, and in effect vacation in CA multiple times per year to see family, and still come out ahead. If we moved to CA, sure, some family would be close, but then we probably would be less able to afford flying back to see other family. For that reason, we're staying put, even though the wife loves CA (I grew up there, and hope to never move back.)