Blackfin: only initialize the RTC when actually used