media: vimc: Fix gpf in rmmod path when stream is active