1. 环境
- 操作系统: Windows 7
- JDK版本: 1.8.0_221
- Hadoop版本: 2.6.0
2. 下载
3. 前期准备
3.1. 配置JAVA环境变量
4. 安装部署
4.1. 解压,提示报有错误发生不影响
4.2. 更改配置文件
- hadoop-env.cmd - 添加JAVA_HOME环境变量
set JAVA_HOME=C:\PROGRA~1\Java\jdk1.8.0_221
- .\etc\hadoop\core-site.xml
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://127.0.0.1:8020</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/E:/soft_work/hadoop-2.6.0/data/hdfs</value>
</property>
</configuration>
- .\etc\hadoop\hdfs-site.xml
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
4.3. 格式化namenode
.\bin\hdfs.cmd namenode -format
下面是成功信息,出现 has been successfully formatted.
2020-10-14 13:10:51,919 INFO common.Storage: Storage directory E:\soft_work\hado
op-2.6.0\data\hdfs\dfs\name has been successfully formatted.
2020-10-14 13:10:51,930 INFO namenode.FSImageFormatProtobuf: Saving image file E
:\soft_work\hadoop-2.6.0\data\hdfs\dfs\name\current\fsimage.ckpt_000000000000000
0000 using no compression
2020-10-14 13:10:52,043 INFO namenode.FSImageFormatProtobuf: Image file E:\soft_
work\hadoop-2.6.0\data\hdfs\dfs\name\current\fsimage.ckpt_0000000000000000000 of
size 389 bytes saved in 0 seconds.
2020-10-14 13:10:52,060 INFO namenode.NNStorageRetentionManager: Going to retain
1 images with txid >= 0
2020-10-14 13:10:52,066 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at jfp/172.18.16.29
************************************************************/
4.4. 启动HDFS
.\sbin\start-dfs.cmd
- 排坑之后 启动完成 namenode 和 datanode 均启动成功
4.5. 查看UI界面 启动成功
5. 拓展
5.1 通过jps查看 namenode 和 datanode进程
C:\Users\user>jps
5968 Jps
6776 NameNode
9816 DataNode
6. 安装启动HADOOP
如果想同时启动HDFS,Yarn,MapReduce,执行以下步骤:
6.1修改配置文件
- .\etc\hadoop\yarn-site.xml
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.resourcemanager.hostname</name>
<value>localhost</value>
</property>
</configuration>
- .\etc\hadoop\mapred-site.xml
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>
6.2 启动全部
.\sbin\start-all.cmd
6.3 查看启动进程
启动成功
C:\Users\user>jps
10096 NodeManager
10304 Jps
11240 NameNode
14856 ResourceManager
12892 DataNode