Hadoop Single Node Cluster Setup On Ubuntu

Video is ready, Click Here to View ×


This video will guide on how to setup a single node cluster for Hadoop from scratch and how can you interact with the HDFS.

45 Comments

  1. sir please explain this error

    tahir@tubuntu:/$ hdfs dfs -ls /
    17/05/13 16:56:23
    WARN util.NativeCodeLoader: Unable to load native-hadoop library for
    your platform… using builtin-java classes where applicable

    all nodes are active
    i am using vm

  2. Hello Sir.. The video was helpful and I was able to successfully setup single node cluster.. But the next time when I started the cluster.. I was not able to access Web Gui of namenode (localhost:50070), it showed http error.. (Problem accessing dfshealth.jsp Reason: Not Found). Daemons were started though.. and when I execute stop-all.sh , it shows (localhost: no datanode to stop)

  3. Please help me with the symbol (-/) that you have used on 17.05-17.10 mins …please tell me how to use it what symbol by normal computer keyboard , is it it's not clear …Thank you

  4. guys i am stuck ,when ever i hit hadoop version it is saying

    "Warning: $HADOOP_HOME is deprecated.
    Downloads/hadoop-1.2.1/bin/hadoop: line 350: usr/lib/java/jdk1.8.0_65/bin/java: No such file or directory
    Downloads/hadoop-1.2.1/bin/hadoop: line 434: /home/phani/usr/lib/java/jdk1.8.0_65/bin/java: No such file or directory"

    what should i do?????

  5. I followed your presentation step by step other then using a newer version of java and hadoop but when I try to run start-dfs.sh it tells me that command is not found. any ideas would be appreciated

  6. Hi Veera/All,

    Need one help.Even though I have move the extract JDk file to the path /usr/lib/java and then run the commands like sudo update-alternatives –install "/usr/bin/java" "java" "/usr/lib/java/jdk1.8.0_60/bin/java" 1 to intimate the linux that we have installed JDk on doing so also when I am entering the command like java -version,it is not showing anything and stating there is no such directory. Pease help me in understand issue behind it

    Thanks in advance

  7. Hi Veera,
    Thanks many millions, I was finding this kind of clear demonstration, at last got your excellent presentation. Thanks veera I was able to configure single node. May God bless you & your family

  8. I face a problem that when I type hadoop version the terminal gives a permission problem

    bash: /media/hadoop/linux/soft/hadoop-1.2.1/bin/hadoop: Permission denied

    so how can I overcome it????

  9. hi sir, wheneve iam typing

    start-all.sh
    it is displaying the below content.
    then it is not displaying hadoop services.
    please help me
    /home/linux/Desktop/hadoop-1.2.1/bin/hadoop-daemon.sh: line 62: [: localhost: integer expression expected
    starting namenode, logging to /home/linux/Desktop/hadoop-1.2.1/libexec/../logs/hadoop-linux-namenode-127.0.0.1
    Error: Could not find or load main class localhost
    localhost: /home/linux/Desktop/hadoop-1.2.1/bin/hadoop-daemon.sh: line 62: [: localhost: integer expression expected
    localhost: starting datanode, logging to /home/linux/Desktop/hadoop-1.2.1/libexec/../logs/hadoop-linux-datanode-127.0.0.1
    localhost: Error: Could not find or load main class localhost
    localhost: /home/linux/Desktop/hadoop-1.2.1/bin/hadoop-daemon.sh: line 62: [: localhost: integer expression expected
    localhost: starting secondarynamenode, logging to /home/linux/Desktop/hadoop-1.2.1/libexec/../logs/hadoop-linux-secondarynamenode-127.0.0.1
    localhost: Error: Could not find or load main class localhost
    /home/linux/Desktop/hadoop-1.2.1/bin/hadoop-daemon.sh: line 62: [: localhost: integer expression expected
    starting jobtracker, logging to /home/linux/Desktop/hadoop-1.2.1/libexec/../logs/hadoop-linux-jobtracker-127.0.0.1
    Error: Could not find or load main class localhost
    localhost: /home/linux/Desktop/hadoop-1.2.1/bin/hadoop-daemon.sh: line 62: [: localhost: integer expression expected
    localhost: starting tasktracker, logging to /home/linux/Desktop/hadoop-1.2.1/libexec/../logs/hadoop-linux-tasktracker-127.0.0.1
    localhost: Error: Could not find or load main class localhost

  10. Great Video Sir. You are the Best Hadoop Teacher that i have come across till now. The errors you made were also useful for me as it clarified all my douts that aroused in my mind when i saw other 'hadoop setup videos'.
    You saved our Day!!!!
    Keep up the Good Work…

  11. I have a problem with the namenode datanode etc. when i type "jsp" it comes up with java jdk. not all the daemon names. Ive followed this tutorial exactly. What could be the problem. 

  12. Boss! i have been trying to get this concept from almost 6 videos including CBT n Edureka, but you are the best. i understood it completely. Thanks a ton!! keep up the good work! Also i would really appriceate if you also do the same work for MULTI node cluster.

  13. Hello Sir,
    Thank You Very Much. I did not leave any comment for any other YouTube videos so far.  I want to comment on this…

    For me this video is awesome. I followed from start till end. So far I watched many videos in YouTube, I felt this is VERY VERY good for the beginners like me who wants to setup single node hadoop cluster.

    small finding: I removed "set" while assigning JAVA_HOME global variable similar to HADOOP_HOME variable, It worked fine for me.

    I will watch other videos you have uploaded.

  14. sudo update-alternatives –install "/usr/bin/java" "java" "/usr/lib/java/jdk1.8.0_2/bin/java" 1
    sudo update-alternatives –install "/usr/bin/java" "javac" "/usr/lib/java/jdk1.8.0_2/bin/javac" 1
    sudo update-alternatives –install "/usr/bin/java" "javaws" "/usr/lib/java/jdk1.8.0_2/bin/javaws" 1

  15. Sir,Indeed this video is good.
    But when I have downloaded Ubuntu 14 Version and Jdk1.8.0_05 instead of Jdk1.7.0_04 and working on that,I got problem in Update alternatives command.
    Can U please help.

Leave a Reply

Your email address will not be published.


*