Using IntelliJ to develop Hadoop jobs
Answered
I'm looking for a tutorial on how to write/debug Hadoop programs (in Java) using IntelliJ.
Thanks.
Sudip
Please sign in to leave a comment.
Hello Sudip,
A Hadoop job is simply a Java class packed in a .jar file; there is nothing
specific to Hadoop in that, and there is no Hadoop specific tutorial for
IntelliJ IDEA.
--
Dmitry Jemerov
Development Lead
JetBrains, Inc.
http://www.jetbrains.com/
"Develop with Pleasure!"
To explain the original question, what are the steps to configure intellij (community) for building .jar file which will be capable of execution ($hadoop jar …) on a system with installed Hadoop , let say v2.6.
What are the files that need to be retrieved and placed in the folders of computer running Intellij ?
Granted, these file might be added as dependencies from File->Project Structure ->Dependencies + [Jar | Lib...], but which ones?
Would installing maven or gradle help?
Is there a separate plugin that simplifies configuration.
Could there be a complete project with pem.xml which could be used as an demo to import and configure?
Hello,
Please check this tutorial: https://tokluo.wordpress.com/2016/01/31/using-intellij-to-write-your-application/