You could also use ssh forwarding for the web UI port, e.g. ssh -L 8080:192.168.0.1:80 user@myvps.com

Docker, dude.

You could also install NixOS on all your headless servers and set it declaratively: https://search.nixos.org/options?channel=26.05&query=services.qbittorrent.serverConfig&type=options#show=option%253Aservices.qbittorrent.serverConfig

For instance:

{
  LegalNotice.Accepted = true;
  Preferences = {
    WebUI = {
      Username = "user";
      Password_PBKDF2 = "generated ByteArray.";
    };
    "WebUI/Address" = "<url>";
    General.Locale = "en";
  };
}