Revert "ARM: uniphier: move lowlevel debug init code after page table switch"