How to limit what File Watchers runs over?

How do I restrict File Watchers to only run for files under certain dirs/files (whitelist), or to exclude certain dirs/files (blacklist)?  Esp. such that the initial cmd-shift-A action doesn't process various extraneous non-source .coffee files in various places in the project dir.  Thanks.