Warning not removed in Run Configuration setting

I have a run config. I raise a warning in the checkConfiguration() method of a class extending

JarApplicationConfiguration 

Specifically I do

public void checkConfiguration() throws RuntimeConfigurationException {
    if (StringUtil.isEmptyOrSpaces(getPath())) {
        throw new RuntimeConfigurationWarning("Path not defined");
    }
...

This results in:

The problem is that after that I set the path, the warning doesn't disappear even if the checkConfiguration is completed with no exceptions.

If I press apply, same as above. The only way to clear the list of errors/warning is to close by clicking on ok.

What am I doing wrong?