Revert "xhci: cleanup xhci_hub_control port references"

This reverts commit ea6c19c7 which is
commit faaae019 upstream.

It breaks the Android kernel abi and can be brought back in the future
in an abi-safe way if it is really needed.

Bug: 161946584
Change-Id: Id29f82e491e7bf665c17098a55fcaafd73ac82ba
Signed-off-by: Greg Kroah-Hartman <gregkh@google.com>