soundwire: Revert "soundwire: intel_auxdevice: start the bus at default frequency"

Now, we can support more than 1 soundwire bus clock frequency.

This reverts commit c3263561 ("soundwire: intel_auxdevice: start
the bus at default frequency")

Signed-off-by: Bard Liao <yung-chuan.liao@linux.intel.com>
Reviewed-by: Ranjani Sridharan <ranjani.sridharan@linux.intel.com>
Reviewed-by: Péter Ujfalusi <peter.ujfalusi@linux.intel.com>
Reviewed-by: Pierre-Louis Bossart <pierre-louis.bossart@linux.dev>
Link: https://lore.kernel.org/r/20250205074232.87537-3-yung-chuan.liao@linux.intel.com


Signed-off-by: Vinod Koul <vkoul@kernel.org>