Another no. I never have cash on me, and I don't hesitate to say so when I'm asked for cash. A few months ago one man followed me, suggesting that I withdraw some cash for him from my credit or debit card. As another small woman, I was anxious, but I still don't think it's ok not to acknowledge someone just because s/he is panhandling.
As for giving food, many years ago, during my first week in the little town of a big state university, a pair of men asked my help outside a Burger King, so I went inside and bought burgers, which the shorter man threw back at me. 18-year-old me was already a vegetarian (which has saved me tons over the years), so I felt a bit like Carrie at the prom.
These days I volunteer with my church when it participates in my city's emergency shelter program, which also receives health-and-beauty stuff I get with coupons. Like other posters, I also volunteer at the food bank, a couple weeks ago assembling seemingly endless racks of "backpack" rations for kids who would otherwise not be able to eat ovet the holidays.
No matter how big the stash o' (invested, so not really) cash grows, I'm always aware that a concatenation of misfortune could make me turn to panhandling.