Depreciation is not tied to a loan.
you will lose the tax "benefit" of mortgage interest to offset your rental income.