To be clear, you need to distinguish between moving the money out of the investment account, e.g. the IRA/401k, and changing what investments the account is holding (like changing from one mutual fund to another). The latter are not taxable for retirement accounts, but for the former there are restrictions as ixtap said.