YMMV, but please pay attention to the figures below. I'd stay and continue to enjoy the appreciation on your purchase, particularly since it sounds like renting is not considerably cheaper than staying (or maybe not cheaper at all). Probably the only thing that would change my opinion of this is if you believed your area is in decline.
Here's the deal: Even at a very modest appreciation, you will be getting wealthier at an astounding rate. Here are some examples of how much more wealth you'd build based on your low-end estimated value of $320k, using some modest appreciation rates. I give an example for only 4 years, the money would continue to snowball in later years:
At 2% annual increase: +6400 in 1 year, $6528 Year 2, $6658 Year 3, $6791 Year 4 (Total = $26,378)
At 4% annual increase: +12,800 Year 1, $13,312 Year 2, $13,844 Year 3, $14,398 Year 4 (Total = $54,354)
At 6% annual increase: $19,200 Year 1, $20,352 Year 2, $21,573 Year 3, $22,867 Year 4 (Total = $83,992)
All of that increase in value/wealth is in addition to the equity you're building by paying down the principal. So unless you have another way to use the money already invested in your house to earn $26,000 - $84,000 in 4 years, it pays to stay put (or if your interest on your loans exceeds that amount).
You have an awesome fixed rate at 3.75% -- what an excellent hedge against inflation as you continue to build equity. As mentioned, you could consider tapping your current equity to pay off the higher interest student loans.
Of course betting on future appreciation is speculative, so again YMMV. But a lot of people get wealthy pretty easily just by owning a nice home in a good area, all while enjoying a roof over your head that you can suit to your own needs. You're one of the fortunate people who have been able to get in on this boondoggle (many people never earn enough or save enough to buy a house), I would not give up on that now unless you think your area is headed to the crapper.