Along the lines of what Prarie Stash said, if you can reduce your usage in the first place - all LED lights, ultra efficient washer and fridge, lose or barely use the dryer and full-sized freezers, non-electric heat, non-electric hot water, everything else on power strips to stop phantom drain - and then watch craigslist for used solar panels, or even just start off with a few cheapies from Harbor Freight, and DIY. I especially think that it's a good idea to start with a couple of hundred dollars of harbor freight panels and some deep cycle batteries and just get your feet wet, try it out. You will learn so much, not just about solar power, but about if it's something YOU actually would want. Not everyone would, and that's okay.
I think there are two big hurdles with the current view of "going solar," and that is 1) continuing to run your electrical life the way you did in the past, and 2) thinking that going new and professional, full-on is the only option.
Craigslist doesn't always have solar stuff available, but if you watch, they come up halfway frequently. DOn't just watch your town, especially if you're in a metro area - watch statewide and bordering states. If you find a good deal, it's totally worth travel to get them. Estate sales, especially in rural or hobby-farm areas, can net you a good find. I'm betting that in the metro areas there would be opportunities to purchase used solar equipment from folks who have tried it and find it's not what they wanted.
Your heat and your hot water are your two biggest energy draws. Shift them away from electric. Again, Craigslist is your friend. Wood stoves, pellet woodstoves, in-floor radient heating with a non-electric source for heating the water. Solar water panels (there's a proper term, can't think of it right now, LOL) for heating water. If you are running a woodstove for heat in winter, and don't get enough sunshine for solar hotwater, consider thermo-siphon hot water heated by the woodstove.
Seriously, there's TONS of options, and almost always, the most cost-efficient way to utilize them is to go in a little at a time, DIY everything, and buy used. Yes, the efficiency per watt of used solar panels isn't as high as brand new, but it's still a significantly lower cost to get in, and it will help you fine-tune your usage end of things.