Note that to verify the source code for an upgradeable contract, use the implementation address.
You can get the implementation address from the proxy using console.log(await upgrades.erc1967.getImplementationAddress(proxyAddress));
See How to verify a contract on Etherscan/BscScan/PolygonScan for more info (details are for Etherscan but the concepts should still be relevant).