1

我使用 Cloudera VM (cdh3u2) 作为模拟分布式文件系统。为了从 Web 服务器执行文件创建和写入,我将 fs.http.address 属性更改为指向 VM IP。此功能运行良好。当 HIVE 执行 map reduce 工作时会出现问题

SELECT COUNT(*) FROM tmp2;

我得到的信息是:

hive> select count(*) from tmp2;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapred.reduce.tasks=<number>
Starting Job = job_201111301538_0001, Tracking URL = http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201111301538_0001
Kill Command = /usr/lib/hadoop/bin/hadoop job  -Dmapred.job.tracker=0.0.0.0:8021 -kill job_201111301538_0001
2011-11-30 16:01:21,773 Stage-1 map = 0%,  reduce = 0%
2011-11-30 16:01:43,064 Stage-1 map = 100%,  reduce = 100%
Ended Job = job_201111301538_0001 with errors
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask

Hive 执行以下 SQL(不需要 map reduce 作业)没有问题:

SHOW TABLES;
SELECT * FROM tmp2;
4

1 回答 1

0

Hive 不响应 IP。更改为 dns 名称

于 2012-10-16T06:40:00.973 回答