Why are modules test paths added to depending modules classpaths?

I have a project with multiple modules. Module A depends on module B.

I cannot run tests in module A, since B's test output path is added to A's classpath. The wrong configuration files are therefore loaded by the tests of module A.

How do I exclude B's test output path from A's classpath? I have checked "Exclude output paths".

I'm running build 5131.