What is the right way to debug/run a Spark job with Java directly from Intellij?

I'm quite new with Spark and Java and I would like to know what it is the right way to debug/run a spark job from Intellij (I'm using the community edition).

I have tried to run my main as usually with some arguments but when I'm doing a query with HiveContext (hc.sql), it can't find my table. So, I think I may be wrong trying to run/debug my spark job this way.

Can someone help me please?

I'm looking for tutorials, links, advices, anything, ...

Thank you very much.

1

Please sign in to leave a comment.