Making my own wine has been one of the best cost saving adjustments I've made. Plus, it's a cool hobby. Right now I have close to 30 gallons in the basement. Many of the supplies are cheap or free. The recipes are easy, the timing is forgiving, the product is delicious. And when it's not delicious it gets distilled or turned into vinegar.
What should be free with a little work: Fruit, recipes, advice and glass jugs. Ask your local cooperative for old one gallon glass jugs. Save the ones that apple juice comes in. Unlike money, fruit does grow on trees. Right now I can pick blackberries, blue berries, elderberries, pears, figs, and plums all 100% for free. I can usually get enough of all of these to make 5 gallons of blackberries, and 5 gallons of plums. In the late spring I make: Lilac, dandelion, raspberry, strawberry and beet wine.
What costs money: Sugar $2-3 per gallon, Yeast $1 per batch, Other "stuff" $1 per gallon. Apart from that, you'll need a siphon (plastic tube), a jug cleaner thingabob $2, and a food grade bucket. I like working in larger batches, so a 5 gallon carboy is not a bad investment. Cleanliness in wine making is important.