0
点赞
收藏
分享

微信扫一扫

hadoop安装配置——伪分布模式

大沈投资笔记 2022-08-21 阅读 139

1. 安装

这里以安装hadoop-0.20.2为例

先安装java,参考这个

​​去着​​下载hadoop

解压

tar -xzf hadoop-0.20.2

 

2. 配置

修改环境变量

vim ~/.bashrc
export HADOOP_HOME=/home/rte/hadoop-0.20.2 #这里为实际hadoop解压的目录位置
export PATH=$PATH:$HADOOP_HOME/bin
source ~/.bashrc

配置hadoop-env.sh

vim conf/hadoop-env.sh
export JAVA_HOME=/home/rte/Software/java/jdk1.6.0_27

配置conf/core-site.xml、conf/hdfs-site.xml、conf/mapred-site.xml文件

文件:core-site.xml

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>

文件:mapred-site.xml

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
<name>mapred.job.tracker</name>
<value>localhost:9001</value>
</property>
</configuration>

文件:hdfs-site.xml

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
<name>dfs.replication</name>
<value>2</value>
</property>
</configuration>

 

3. 开启关闭

通过NameNode格式化HDFS文件系统

cd hadoop-0.20.2/conf
hadoop namenode -format

开启hadoop

cd hadoop-0.20.2/bin
sh start-all.sh

hadoop安装配置——伪分布模式_xml

通过jps命令检查期望的hadoop进程是否运行

hadoop安装配置——伪分布模式_hdfs_02

关闭hadoop

cd hadoop-0.20.2/bin
sh stop-all.sh

hadoop安装配置——伪分布模式_xml_03

 

4. 参考

​​Running Hadoop on Ubuntu Linux (Single-Node Cluster)​​

hadoop三个配置文件的参数含义说明

​​hadoop安装配置​​



举报

相关推荐

0 条评论