Solidity Optimizer Advice

I still see that auditors recommend against using the optimizer when compiling which is a different message than what I see on twitter from the solidity team.

For my own use, is it still considered unsafe to enable the optimizer?