FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

刘超 3月前 ⋅ 4714 阅读   编辑

一、描述

  执行如下hivesql

select * 
from(
  select operator,(count(hashedoperaid) over(partition by countrycode)) as countryNum,(count(hashedoperaid) over(partition by countrycode,operator)) as operatorNum,(row_number() over(partition by countrycode,operator)) as rowNum 
  from(
      select hashedoperaid,countrycode,lv.operator from log_adx_request lateral view explode(split(operator,',')) lv as operator where day between 20200601 and 20200607 and countrycode='NG' 
  ) b 
) a 
where rowNum =1

  报如下错误

Task with the most failures(4): 
-----
Task ID:
  task_1582757194275_232355_r_000471

URL:
  http://n17-07-04:8088/taskdetails.jsp?jobid=job_1582757194275_232355&tipid=task_1582757194275_232355_r_000471
-----
Diagnostic Messages for this Task:
AttemptID:attempt_1582757194275_232355_r_000471_3 Timed out after 600 secs
Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143


FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched: 

二、分析

  1、添加--hiveconf hive.root.logger=DEBUG,console,打印出来如下日志

20/06/17 10:11:28 [Thread-49]: DEBUG ipc.ProtobufRpcEngine: Call: getTaskAttemptCompletionEvents took 0ms

Examining task ID: task_1582757194275_234075_m_007248 (and more) from job job_1582757194275_234075

20/06/17 10:11:28 [Thread-49]: ERROR exec.Task: Examining task ID: task_1582757194275_234075_m_007248 (and more) from job job_1582757194275_234075

20/06/17 10:11:28 [Thread-49]: WARN shims.HadoopShimsSecure: Can't fetch tasklog: TaskLogServlet is not supported in MR2 mode.

20/06/17 10:11:28 [Thread-49]: WARN shims.HadoopShimsSecure: Can't fetch tasklog: TaskLogServlet is not supported in MR2 mode.

  没找到问题所在

  


注意:本文归作者所有,未经作者允许,不得转载

全部评论: 0

    我有话说: