Hi @dappCoder,
For higher level tests interacting with the upgradeable contract you can use the following:
https://docs.openzeppelin.com/upgrades-plugins/1.x/hardhat-upgrades#test-usage
A complete example is shown in:
OpenZeppelin Upgrades: Step by Step Tutorial for Hardhat