启动hadoop Job Tracker时出错 [英] Error in starting hadoop Job Tracker
问题描述
我可以启动namenode。
然而jobtracker的开始失败,但是例外:
致命mapred.JobTracker:java.lang.IllegalArgumentException:不包含一个有效的主机:端口权限:本地
在org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:162)
在org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils .java:128)
at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:2560)
at org.apache.hadoop.mapred.JobTracker。< init>(JobTracker。 java:2200)
at org.apache.hadoop.mapred.JobTracker。< init>(JobTracker.java:2192)
at org.apache.hadoop.mapred.JobTracker。< init>( JobTracker.java:2186)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTrack er.java:291)
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
我尝试了所有可能的方法来解决这个问题,但徒劳无功。任何指针都会帮助我。
Hdfs-site.xml配置:
<配置>< br>
<属性>
< name> fs.default.name< /名称>
< value> hdfs:// localhost:9100< /值>
< / property>
<属性>
< name> mapred.job.tracker< /名称>
< value> localhost:9101< /值GT;
< / property>
<属性>
< name> dfs.replication< /名称>
<值> 1< /值>
< / property>
< / configuration>
> mapred-site.xml 和NOT hdfs-site.xml,
< property>
<名称> mapred.job.tracker< / name>
< value> localhost:9101< /值>
< / property>
顺便说一句,你为什么要在Windows中运行Hadoop?为了发展?你没有Linux机器或者不愿安装一个?另外一件事,你通常把这个属性放在core-site.xml中而不是hdfs-site.xml ,
< property>
<名称> fs.default.name< /名称>
< value> hdfs:// localhost:9100< /值>
< / property>
I tried to run a simple program in hadoop using Windows-Cygwin.
I am able to start the namenode .
The jobtracker start however fails with exception :
FATAL mapred.JobTracker: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: local
at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:162)
at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:128)
at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:2560)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2200)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
I tried all possible methods to resolve this ,but in vain. Any pointers will greatly help me.
Hdfs-site.xml configurations :
<configuration><br>
<property>
<name>fs.default.name< /name>
<value>hdfs://localhost:9100</value>
</property>
<property>
<name>mapred.job.tracker< /name>
<value>localhost:9101< /value>
</property>
<property>
<name>dfs.replication< /name>
<value>1</value>
</property>
</configuration>
The problem is the following lines should on into mapred-site.xml and NOT hdfs-site.xml,
<property>
<name>mapred.job.tracker</name>
<value>localhost:9101</value>
</property>
By the way why are you trying to run Hadoop in Windows? For development? You don't have a linux machine or reluctant to install one?
One more thing, you usually put this property in core-site.xml not hdfs-site.xml,
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9100</value>
</property>
这篇关于启动hadoop Job Tracker时出错的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!