Revert "spi: Fix use-after-free with devm_spi_alloc_*"

This reverts commit c7fabe37 which is
commit 794aaf01 upstream as it breaks
the kabi.

This should not be needed for android devices as they do not remove SPI
devices under normal operation.

Bug: 161946584
Signed-off-by: Greg Kroah-Hartman <gregkh@google.com>
Change-Id: I0909978867a4e4e7304fd0d21ebff77c35468cd3