Help me to verifying proxy contract in Mumbai Testnet Network

As far as I can tell best you can do right now is to show support for the feature request in the GitHub issue I mentioned.

Another option is to do a manual proxy deployment with a single-file proxy contract that you will then be able to verify. We won’t be able to help with this though.