Multiple projects in a single windows with multiple run configurations

So i'm building a PHP application which exists out of multiple independent packages. Using the "multiple projects functionality" i opened both packages in the same PHPStorm windows.

Both packages have pestphp required as a local dependency.
I am also using the PestPHP plugin to create the PestPHP run configuration.

Running tests on package #1 works fine.

Running tests on package #2 (the attached project):
- The configuration points to the pest binary of package #1
- This binary most likely autoloads the vendor of package #1
- The configuration tries to run tests in package #2 thus autoloading all packages
- PestPHP is loaded for the second time and thus resulting in a redeclaration of a function

Before using the multiple project setup i was using separate PHPStorm windows. This seemed to work perfectly since i could configure a separate "test framework" and point to a different pest binary for each project.

The solutions i thought of:
1. Being able to configure test framework for both attached projects in the current window
2. Being able to point to a custom test binary in the runner configurations

I hope i was somewhat clear in my explanation. Any help would be greatly appreciated :)