0
点赞
收藏
分享

微信扫一扫

hadoop报错总结01_李孟_新浪博客

静悠 2022-03-23 阅读 129

1.进行矩阵计算的时候,由于持续时间长,往往会出现超时的错误,错误内容如下: INFO mapreduce.Job: Task Id : attempt_1422500209602_0008_m_000000_0, Status : FAILED

AttemptID:attempt_1422500209602_0008_m_000000_0 Timed out after 600 secs


有两种办法可以修复

1)解决办法是在代码中定时report  context.progress();

2)in mapred-site.xml添加或者修改

mapred.task.timeout

 1800000


2.You have an error in your SQL syntax; check the manual that corresponds to your MySQL serv

er version for the right syntax to use near 'OPTION SQL_SELECT_LIMIT=DEFAULT' at line 1


Mysql-connector-java.jar版本太低,方法不支持


3.Current usage: 280.1 MB of 1 GB physical memory used; 2.7 GB of 2.1 GB virtual me

mory used. Killing container.

清除jvm

Jvm分配情况,清除mapred-site.xml配置

<property>

  <name>mapred.child.java.opts</name>

  <value>-Xmx1024m</value>

</property>

这个配置影响


举报

相关推荐

0 条评论