It can really, really depend. Certain supplements are very valuable for certain medical conditions- ex., there is a specific yeast strain I take due to a GI problem I have (well, GI presentation of an autoimmune disease, to be specific). This is per the advice of my doctor. And I have seen the prescribed several times to help with the resolution of C. Diff. The science is really compelling on this, and so the line between 'supplement' and 'medicine' is blurry here. I think the same goes for Vitamin D. We can test vitamin D levels, if they are low, we prescribe vitamin D supplments, and they resolve. Evidence shows a strong association between Vitamin D and a lot of autoimmune diseases and cancers. So again- where does 'supplement' end and 'medicine' begin?
Something like a mutlivitamin is a much more complex issue. There is very little evidence it helps, and a lot of evidence that they often harbor heavy metal contamination and do not contain the products they advertise. So people who say they 'do no harm, may do some good, so why not take them'- that is your answer. They are not regulated like medicines are, and can be dangerous, mislabeled, etc.
Emptor Cavete and all that.