Can't you change the other cap values to be more akin to the one you like?

And compressors will amplify any noise upstream of it once you start lowering the threshold and the electronics auto-adding make-up gain. It's just the way compressors work.