There are a number of changes you can make to your policy rules to reduce the number of policy matches including:
Avoid using wildcards (*)
Always use the full protocol, hostname and port number where ever possible in your policy rules rather than using a wildcard (*).
For example, instead of using: http*://*/test/test.dll/* to cover multiple policy rules, you can separate them out and make them more specific to reduce policy matches, for example:
Use the not enforced URL list
You should also ensure the Fetch Attributes for Not Enforced URLs option is not enabled unless specifically required.