Creating an openzeppelin-contracts-upgradeable Smart Contract

Yes, I think so.

And you can have a look at this tutorial: