gpio: gpio-vf610: use u32 mask to handle 32 number gpios

This gpio controller support up to 32 pins per port. And all the
register width is 32 bit. So here use u32 to replace the original
unsigned long.

Signed-off-by: Haibo Chen <haibo.chen@nxp.com>
Reviewed-by: Stefan Wahren <wahrenst@gmx.net>
Link: https://lore.kernel.org/r/20240801093028.732338-2-haibo.chen@nxp.com


Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>