Yes I've ridden PNX and Scottsdale! I love rocks and technical trails. Ironically I also grew up on the MD/PA border.
Brevard is technical in a different way than your used to. Roots, rocks, stream crossings, rain, drops. I personally enjoy it more because you can truly do all day epics and never hit the same trail in a week. There is one huge difference in Pisgah. You climb Up! Then you go down! Big climbs depending on your legs you can get 5000+ ft climbing in one day. Now you can also do much more toned down loops, like me! The other thing, for the most part you won't see much trail info on the inter web, it's sort of snobbish for e-bikers. You hit LBS and they won't shut up about trails and conditions, good and bad. But with that said MTB is very much a personal thing. I'm still in China but if I am back and in the area I can take you around. I would definitely scout it out prior to going all in...
As for riding around Brevard there are four areas all within 15 to 30 minutes from Brevard.
Bent Creek- about 30 minutes from Brevard and closest to US26 and Asheville. This is single speed 29er heaven. These are buff fun trails all man made. Nice change of pace from normal tech, this is north of Brevard. In the Experimental portion of Pisgah National Park, not bike able from Brevard.
Mills River- about 15 minutes from Brevard, north. Not bike able from Brevard. This has some technical classics! Pilot, Trace Ridge, And a couple more that are slipping my mind. I like this area. This is half way between the highway and Brevard. There are definitely houses there for sale that are essentially suburbs of Asheville.
Ranger Station/Fish Hatchery- this is Pisgah!!! This is about 5 minutes from downtown. Trails are rideable from your house if you don't mind a road spin, otherwise you can drive into the forest. This is the good stuff. You can ride for 5-6 days and not repeat.
DuPont State Forest- about 15 minutes east of Brevard. Have to drive. This is like a mixture of Bent Creek and Pisgah rolled into one. This is just a fun place to ride. It keeps you honest with technical riding and has berms and man made trails to boot. You can make a 50 mile loop out there and not repeat. There are houses really close to there but you sacrifice the ease of walking to downtown Brevard for beers or dinner and must drive for groceries.
For us we are thinking a 3 mile radius around downtown Brevard. I'm not too concerned about driving to the trail head. I would rather be able to walk to get groceries and to the music etc...
Within 4 hours is three downhill parks, Tsali, Delhonga Ga, FATS, Chattanooga, Bear Creek, Wilsons (this is super tough but it holds the goods! Must have a local to show you around, I still get lost), I'm sure I am missing something, Charlotte also has some pretty decent trails, oh yeah, Warrior Creek. You get the picture.