Hi @viraj124,
If I understand correctly you want one proxy per user (address) and you want to track this.
You can add tracking to your factory contract that inherits from ProxyFactory, such as having a mapping that maps user (addresses) to proxy contracts.
@msolomon4 was doing something along these lines: Issues initializing EIP-1167 minimal proxies deployed with factory contract
Let me know if I have missed something in your question or if you have more questions.