mmc: sdhci-pci-o2micro: Restore the SD clock's base clock frequency

Drop the SD clock's base clock for an SDR104 card, as frequency is wrong when
inserting and SD2.0/SDR50 card.

Signed-off-by: Fred Ai <fred.ai@bayhubtech.com>
Acked-by: Adrian Hunter <adrian.hunter@intel.com>
Link: https://lore.kernel.org/r/20211216060824.357-2-fred.ai@bayhubtech.com


Signed-off-by: Ulf Hansson <ulf.hansson@linaro.org>