Using IntelliJ to develop Hadoop jobs

Answered

I'm looking for a tutorial on how to write/debug Hadoop programs (in Java) using IntelliJ.

Thanks.

Sudip

3 comments
Comment actions Permalink

Hello Sudip,

A Hadoop job is simply a Java class packed in a .jar file; there is nothing
specific to Hadoop in that, and there is no Hadoop specific tutorial for
IntelliJ IDEA.

I'm looking for a tutorial on how to write/debug Hadoop programs (in
Java) using IntelliJ.


--
Dmitry Jemerov
Development Lead
JetBrains, Inc.
http://www.jetbrains.com/
"Develop with Pleasure!"


0
Comment actions Permalink

To explain the original question, what are the steps to configure intellij (community) for building .jar file which will be capable of execution  ($hadoop jar …) on a system with installed Hadoop , let say v2.6.

What are the files that need to be retrieved and placed in the folders of computer running Intellij ? 

Granted, these file might be added as dependencies from File->Project Structure ->Dependencies + [Jar | Lib...], but which ones?

Would installing maven or gradle  help?

Is there a separate plugin that simplifies configuration.

Could there be a complete project with pem.xml which could be used as an demo to import and configure?

0

Please sign in to leave a comment.