Hey you could do something like what's shown in this thread - basically use something like:
ERC1967Proxy proxy = new ERC1967Proxy(
tokenImplementation,
abi.encodeWithSelector(MyTokenUpgradeable(address(0)).initialize.selector, name, symbol, initialSupply, owner)
);