The $5k balance is a previously deducted balance. If that's still in the IRA (or already converted to Roth) in the year you make the conversion the non-deductible IRA balance to Roth (backdoor Roth), you'll owe tax on the conversion in the proportion (pro-rata) of the previously deducted balance to the total balance. So if you have $5k previously deducted, you contribute $5k that you don't deduct, and convert $5k, then 50% ($2500) of the conversion would be taxable. It sounds like you want to convert the whole thing ($10k in my example), so 50% will still be taxable ($5k) and in future years you won't have any previously deducted balance, so you'll be able to make the contribution/conversion without paying tax.
By rolling over most of it's not a big deal either way at this point, but to be totally optimal you'd roll over that $5K that you'd owe tax on before December 31st of the year you do the deduction so you wouldn't owe any tax since you're currently in a high tax bracket.
You'll indicate the amount of the rollover that's taxable and the amount that's not on form 8606.