Simple and obvious question: how much % performance gain does this typically give?

You can just skim the green text at the end of each section in the article to see the performance improvements of the various techniques.

It depends on the application. For several SPEC results on different processors see: http://gcc.opensuse.org/