My thinking on stuff like this is: necessity, frequency, alternatives, opportunity cost.
So basically is Item X a necessity, or near enough? I'd put my phone in this category. I'm not going without a smart phone, which means I'm supporting some kind of chinese manufacturing no matter what. All that stuff at the Dollar Bin at Target - all made in China plastic trinkets, that kind of thing - basically total crap with absolutely no redeeming necessity.
Frequency: how often do I make this purchase. I get a new phone about every 4 years. That seems to be how long they last without totally breaking down on me. So that's fairly infrequent. Compare this to something like food/snacks, etc, which one might purchase several times a week.
Alternatives: how reasonable is it to source an alternative that might be manufactured more in keeping with my values? In the case of some stuff, like tech, it's nearly impossible. Some items, like clothing, it's difficult but not impossible. Some items, like food, there are many readily available products that are locally produced or at least are imported from countries with a better reputation.
Opportunity cost: the opportunity cost of buying exclusively made in America or similar clothing is often too high for me. The cost is typically much higher, the style options far more limited, and frankly the quality of made in the USA clothing almost never compensates for the higher pricetag. YMMV.
As someone who thinks about the role her dollar plays in shaping the world around her, I consider this kind of stuff - probably too much. But I've come to think that at the end of the day we can only do the best we can. There are no black and whites here, and living in society means we are a little bit screwed no matter how ethical we try to be in our purchasing - because the system will always raise some up and hold some down unfairly and that's just the way it is.
I personally would not say that a well researched purchase of a cycling jersey is immoral. In fact, I could argue that if you buy it, and owning this jersey encourages you to cycle more and drive less, you are helping reduce the demand for oil and therefore doing a very ethical thing - since demand for oil leads to all kinds of human atrocities.
This kind of stuff is so damned sticky.
TL;DR - it's ok man. Get your jersey.