Fix the clock divisor calc for imx6 sdcard bus speed.

Quick exit after setting the clock control register.