Vaultwarden is the way to go. What is your issue with it?

I’ll take that tiny amount of traffic telling scanners there’s no password auth over having to remember port settings for ssh, scp and rsync any day.