Encountered the same thing on https://login.gov/, but I have the ability to replace the key on https://passkeys.io. Not sure what the difference is between these two websites but the passkey that it thinks it has already generated for the government’s login website is completely useless without manually copying and deleting the whole entry.
Attempting to add Passkey for the government’s login website after failed attempt:
