arm: am4x: fix build dependency for secure devices