Issue #1: Apache Hadoop Datanode in Stopped state (or frequently stopping)
Error: Live Nodes 0 (Decommissioned: 0)
Steps for resolution:
C:\hdp\hadoop-2.4.0.2.1.3.0-1981> hadoop fs -mkdir -p /users
Now we should be able to browse the HDFS:
C:\hdp\hadoop-2.4.0.2.1.3.0-1981> hadoop fs -ls
Found 1 items
drwx------ - arvindpc hdfs 0 2015-05-16 13:18 .staging
For HDInsight Installation, refer to the link (http://azure.microsoft.com/en-gb/documentation/articles/hdinsight-hadoop-emulator-get-started/)
---
Error: Live Nodes 0 (Decommissioned: 0)
Steps for resolution:
1. Stop the Hadoop Cluster
C:\hdp> stop_local_hdp_services
2. Delete contents of the following folders residing in C:\hdpdata\hdfs:
a. dd
b. nn
c. snn
3. Delete contents inside C:\hdp\temp\hadoop
4. Format Name Node
C:\hdp\hadoop-2.4.0.2.1.3.0-1981> hadoop namenode -format
5. Start the Hadoop Cluster
C:\hdp> start_local_hdp_services
C:\hdp> stop_local_hdp_services
2. Delete contents of the following folders residing in C:\hdpdata\hdfs:
a. dd
b. nn
c. snn
3. Delete contents inside C:\hdp\temp\hadoop
4. Format Name Node
C:\hdp\hadoop-2.4.0.2.1.3.0-1981> hadoop namenode -format
5. Start the Hadoop Cluster
C:\hdp> start_local_hdp_services
---
Issue #2: Unable to browse HDFS (File System on HDInsight)
Error:
C:\hdp\hadoop-2.4.0.2.1.3.0-1981>hadoop fs -ls
ls: `.': No such file or directory
Steps for resolution:
1. Create new directory in HDFS
C:\hdp\hadoop-2.4.0.2.1.3.0-1981> hadoop fs -mkdir -p /C:\hdp\hadoop-2.4.0.2.1.3.0-1981> hadoop fs -mkdir -p /users
Now we should be able to browse the HDFS:
C:\hdp\hadoop-2.4.0.2.1.3.0-1981> hadoop fs -ls
Found 1 items
drwx------ - arvindpc hdfs 0 2015-05-16 13:18 .staging
For HDInsight Installation, refer to the link (http://azure.microsoft.com/en-gb/documentation/articles/hdinsight-hadoop-emulator-get-started/)
---
No comments:
Post a Comment