I just refinanced a few properties, closing costs were insane. So my vote would be to just pay it off.
I'm unfamiliar with PMI rules regarding FHA loans, are you saying it never goes away regardless of the loan to value? As i type this that makes sense, you get to put very little skin in the game that has to come with a price. Which is guess is PMI.