Can't Truly Exclude Directories From Project

We have some huge directories under our Project directory that IntelliJ doesn't need to even look at. With these directories included in the intelliJ project, a simple right click on the top Project element in the Project tree will hang for several minutes.

I tried going into the Project Structure and marking them as Excluded but they still appear in the Project Tree and also are still impacting performance.