My God, I'd be out of there so fast, I'd form a time warp vacuum. The upside is SO HUGE, and the downside, NONE... I'd burn the $4800 max extra for rent, to have privacy (esp w/ a girlfriend), not having to share a kitchen/bathroom/anything, and not have to put up with any BS in my home; plenty of opportunity outside of your place for that. If you want company, seek it out - so much better than not wanting company, and nothing you can do about it.
I pay $700/mo for rent for an old tiny 2 BR home with basement, and a single stall garage, and live on less than $25k a year... I would not know what in the hell to do with $96K, event though my stache hovers right around $2MM. So put me in the 100000000% get out of where you are camp, and congratulations on your very good SR. Good luck.