You could say the same about Queens or the Bronx or Bed-Stuy or Bushwick or.... etc. Plus a lot of people don't entertain at home much (I never do). PATH runs to Hoboken every 10-12 minutes most of the time and is a shorter commute from downtown than Harlem or Washington Heights or most of Brooklyn. I don't really get the "inconvenience" factor.
Everyone has to find their balance between a short commute, a neighborhood they enjoy, and price. In some cities, you can have it all. But price in NYC can be absolutely outrageous, so unless you're willing and able to spend a ton of cash, you will have to make some compromises - roommates, a longer commute, a less desirable neighborhood, low savings rates, etc.