Windows SSH Agent for Ansible from WSL unreliable?

I’m using Bitwarden Desktop on Windows and have followed this method to glue the Windows SSH-Agent socket into WSL using socat and npiperelay. I can use my regular CLI tools like ssh just fine from within WSL2 and they use the Bitwarden Agent as they should.

I’m also using Ansible to run playbooks against a handful of servers. This is also working but it seems to be unreliable. Running a simple playbook executing ansible.builtin.ping against all hosts in the inventory sometimes yields

[ERROR]: Task failed: Failed to connect to the host via ssh: user@hostname: Permission denied (publickey,password).

typically for one of hosts but not always the same one. Subsequent runs usually succeed. I don’t see any obvious pattern here. Has anybody had similar issues and found a root cause / fix?