Plugin suggestion : Apache Spark highlighter Follow
I have an idea for a plugin for Apache Spark.
Imagine an highlighter which would tell you that
- everything inside the `map` is running inside the executors
- Some transformation are wide vs narrow
- highlight the method which trigger materialization ( action vs transformation )
Please sign in to leave a comment.