The existence of carrier-grade-NAT makes source-address filtering an unsustainable solution unless you are renting a public IP from your ISP and avoiding mobile devices.
Much more sustainable are mTLS (which the Bitwarden client does not yet support – vote for it), communicating over a client-to-site VPN, or using a strong Master Password and trusting Bitwarden’s encryption.