I realize that we can make * / * * rules but once you choose a website to be domain or site specific it removes those rules.

In certain cases, such as when a third party (wp.com) is very common on a lot of websites, it may make sense to have them globally allowed even on a site with a more specific ruleset.