Revert "ALSA: usb-audio: Properly refcounting clock rate"

This reverts commit 539493f1 which is
commit 9a737e7f upstream.

It breaks the Android kernel abi and can be brought back in the future
in an abi-safe way if it is really needed.

Bug: 161946584
Change-Id: I3b6c2cf476c83c1f0a49ae39e2317bf090a2567c
Signed-off-by: Greg Kroah-Hartman <gregkh@google.com>