pinctrl: at91: remove #ifdef CONFIG_PM

Remove #ifdef CONFIG_PM and use pm_ptr() macro instead.

Signed-off-by: Claudiu Beznea <claudiu.beznea@microchip.com>
Link: https://lore.kernel.org/r/20220704101253.808519-2-claudiu.beznea@microchip.com


Signed-off-by: Linus Walleij <linus.walleij@linaro.org>