Saturday, May 16, 2015

HDInsight Emulator - Troubleshooting Hadoop 2.0 installed on Windows 8

Issue #1: Apache Hadoop Datanode in Stopped state (or frequently stopping)

Error: Live Nodes 0 (Decommissioned: 0)

Steps for resolution:

1. Stop the Hadoop Cluster
    C:\hdp> stop_local_hdp_services

2. Delete contents of the following folders residing in C:\hdpdata\hdfs:
    a. dd
    b. nn
    c. snn

3. Delete contents inside C:\hdp\temp\hadoop

4. Format Name Node
    C:\hdp\hadoop-2.4.0.2.1.3.0-1981> hadoop namenode -format

5. Start the Hadoop Cluster
    C:\hdp> start_local_hdp_services

---

Issue #2: Unable to browse HDFS (File System on HDInsight)

Error:
    C:\hdp\hadoop-2.4.0.2.1.3.0-1981>hadoop fs -ls
    ls: `.': No such file or directory

Steps for resolution:

1. Create new directory in HDFS
    C:\hdp\hadoop-2.4.0.2.1.3.0-1981> hadoop fs -mkdir -p /
    C:\hdp\hadoop-2.4.0.2.1.3.0-1981> hadoop fs -mkdir -p /users

Now we should be able to browse the HDFS:
    C:\hdp\hadoop-2.4.0.2.1.3.0-1981> hadoop fs -ls
    Found 1 items
    drwx------   - arvindpc hdfs          0 2015-05-16 13:18 .staging


For HDInsight Installation, refer to the link (http://azure.microsoft.com/en-gb/documentation/articles/hdinsight-hadoop-emulator-get-started/)

---

No comments:

Post a Comment