0
点赞
收藏
分享

微信扫一扫

配置yarn方法

嚯霍嚯 2022-04-03 阅读 57

1.etc/hadoop/mapred-site.xml:

<configuration>
    <property>
        <name>mapreduce.framework.name</name>     --框架配置
        <value>yarn</value>
    </property>
    <property>
        <name>mapreduce.application.classpath</name>
        <value>$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*</value>
    </property>      --这个可以不用配
</configuration>

2.etc/hadoop/yarn-site.xml:

<configuration>
    <property>
        <name>yarn.nodemanager.aux-services</name>    --配置服务
        <value>mapreduce_shuffle</value>
    </property>
    <property>
        <name>yarn.nodemanager.env-whitelist</name>
        <value>JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PREPEND_DISTCACHE,HADOOP_YARN_HOME,HADOOP_HOME,PATH,LANG,TZ,HADOOP_MAPRED_HOME</value>
    </property>
</configuration>

注:为了防止被挖矿,得配置端口来代替8088端口:

<property>
              <name>yarn.resourcemanager.webapp.address</name>
                <value>${yarn.resourcemanager.hostname}:9527</value>
 </property>

举报

相关推荐

0 条评论