Hbase 设置配置:HMaster 未运行 [英] Hbase setup configuration: HMaster is not running

查看：42
本文介绍了Hbase 设置配置:HMaster 未运行的处理方法，对大家解决问题具有一定的参考价值，需要的朋友们下面随着小编来一起学习吧！

问题描述

我正在尝试以完全分布式模式设置 HBase:由 1 个主服务器和 2 个区域服务器组成.我在 hbase-env.sh 中设置了 HBASE_MANAGES_ZK = true.hadoop集群在集群上运行，配置如下:

主:节点主区域服务器 1:节点 1Regionserver2:node2

当我启动 HBase 时，我可以看到 RegionServers 正在启动，并且 HQuorumPeer 也在 master 上，但 HMaster 没有显示.

请找到以下日志:掌握 hbase-site.xml

<预><代码><配置><财产><name>hbase.master</name><value>nodemaster.hbasecluster.com:60000</value><description>HBase master 运行所在的主机和端口.'local' 的值在单个 </description> 中运行 master 和 regionserver.</属性><财产><name>hbase.rootdir</name><value>hdfs://nodemaster.hbasecluster.com:9000/hbase</value><description>区域服务器共享的目录.</description></属性><财产><name>hbase.cluster.distributed</name><值>真</值><description>集群将处于的模式.可能的值为 false:使用托管 Zookeeper 的独立和伪分布式设置 true:使用非托管 Zookeeper Quorum 完全分布式(请参阅 hbase-env.sh)</description></属性><财产><name>hbase.zookeeper.distributed</name><值>真</值></属性><财产><name>hbase.zookeeper.property.dataDir</name><value>/usr/local/zookeeper</value></属性><财产><name>hbase.zookeeper.property.clientPort</name><value>2181</value> 属性来自 ZooKeeper 的配置 zoo.cfg.客户端将连接的端口.</描述></属性><财产><name>hbase.zookeeper.quorum</name><value>nodemaster.hbasecluster.com</value> 逗号分隔的 ZooKeeper Quorum 中的服务器列表.</描述></属性><财产><name>hbase.tmp.dir</name><value>/hbase/tmp</value><description>本地文件系统上的临时目录.</description></属性></配置>

/etc/hosts 在主服务器上

127.0.0.1 本地主机192.168.2.154 nodemaster.hbasecluster.com 节点主192.168.2.186 node1.hbasecluster.com node1192.168.2.187 node2.hbasecluster.com node2

登录 regionserver1

星期五 8 月 17 日 12:32:15 IST 2018 在 node1.hbasecluster.com 上启动 regionserver核心文件大小(块，-c)0数据段大小(千字节，-d)无限制调度优先级 (-e) 0文件大小(块，-f)无限制待处理信号 (-i) 15701最大锁定内存 (kbytes, -l) 64最大内存大小 (kbytes, -m) 无限制打开文件 (-n) 10000管道大小(512 字节，-p)8POSIX 消息队列(字节，-q)819200实时优先级 (-r) 0堆栈大小(千字节，-s)8192cpu时间(秒，-t)无限制最大用户进程数 (-u) 15701虚拟内存(千字节，-v)无限制文件锁 (-x) 无限制2018 年 8 月 17 日 12:32:15,420 信息 [主要] regionserver.HRegionServer:启动 executorService HRegionServer2018-08-17 12:32:15,422 信息 [main] util.VersionInfo: HBase 2.1.02018-08-17 12:32:15,422 INFO [main] util.VersionInfo: 源代码库 git://zhangduo-Gen8/home/zhangduo/hbase/code revision=e1673bb0bbfea21d6e5dba73e013b09b8b49b89b2018-08-17 12:32:15,422 INFO [main] util.VersionInfo:由 zhangduo 于 2018 年 7 月 10 日星期二 17:26:48 编译2018-08-17 12:32:15,422 INFO [main] util.VersionInfo:来自带有校验和的源 c8fb98abf2988c0490954e15806337d72018-08-17 12:32:15,703 信息 [main] util.ServerCommandLine: hbase.tmp.dir:/tmp/hbase-root2018-08-17 12:32:15,703 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://nodemaster.hbasecluster.com:9000/hbase2018-08-17 12:32:15,703 信息 [main] util.ServerCommandLine: hbase.cluster.distributed: true2018-08-17 12:32:15,703 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: nodemaster.hbasecluster.com2018-08-17 12:32:15,703 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-root-regionserver-node1.hbasecluster.com.log2018-08-17 12:32:15,704 INFO [main] util.ServerCommandLine: env:PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games2018-08-17 12:32:15,704 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd642018-08-17 12:32:15,704 信息 [main] util.ServerCommandLine: env:LANG=en_US.UTF-82018-08-17 12:32:15,704 信息 [main] util.ServerCommandLine: env:XDG_SESSION_ID=1822018-08-17 12:32:15,704 信息 [main] util.ServerCommandLine: env:MAIL=/var/mail/root2018-08-17 12:32:15,704 信息 [main] util.ServerCommandLine: env:LOGNAME=root2018-08-17 12:32:15,704 信息 [main] util.ServerCommandLine: env:HBASE_REST_OPTS=2018-08-17 12:32:15,704 信息 [main] util.ServerCommandLine: env:PWD=/root2018-08-17 12:32:15,704 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA2018-08-17 12:32:15,704 信息 [main] util.ServerCommandLine: env:SHELL=/bin/bash2018-08-17 12:32:15,704 信息 [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true2018-08-17 12:32:15,704 信息 [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=root2018-08-17 12:32:15,704 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/tmp/hbase-root-regionserver.znode2018-08-17 12:32:15,704 INFO [main] util.ServerCommandLine: env:SSH_CLIENT=192.168.2.154 46760 222018-08-17 12:32:15,704 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-root-regionserver-node1.hbasecluster.com2018-08-17 12:32:15,704 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/root/install/hbase-2.1.0/bin/../logs2018-08-17 12:32:15,704 信息 [main] util.ServerCommandLine: env:USER=root2018-08-17 12:32:15,705 INFO [main] util.ServerCommandLine: root/install/hbase-2.1.0/bin/../lib/spymemcached-2.12.2.jar:/root/install/hbase-2.1.0/bin/../lib/validation-api-1.1.0.Final.jar:/root/install/hbase-2.1.0/bin/../lib/xmlenc-0.52.jar:/root/install/hbase-2.1.0/bin/../lib/xz-1.0.jar:/root/install/hbase-2.1.0/bin/../lib/zookeeper-3.4.10.jar:/root/install/hbase-2.1.0/bin/../lib/client-looking-thirdparty/audience-annotations-0.5.0.jar:/root/install/hbase-2.1.0/bin/../lib/client-face-thirdparty/commons-logging-1.2.jar:/root/install/hbase-2.1.0/bin/../lib/client-looking-thirdparty/findbugs-annotations-1.3.9-1.jar:/root/install/hbase-2.1.0/bin/../lib/client-looking-thirdparty/htrace-core4-4.2.0-incubating.jar:/root/install/hbase-2.1.0/bin/../lib/client-looking-thirdparty/log4j-1.2.17.jar:/root/install/hbase-2.1.0/bin/../lib/client-looking-thirdparty/slf4j-api-1.7.25.jar:/root/install/hbase-2.1.0/bin/../lib/client-looking-thirdparty/htrace-core-3.1.0-incubating.jar:/root/install/hbase-2.1.0/bin/../lib/client-looking-thirdparty/slf4j-log4j12-1.7.25.jar2018-08-17 12:32:15,705 信息 [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=true2018-08-17 12:32:15,705 信息 [main] util.ServerCommandLine: env:SSH_CONNECTION=192.168.2.154 46760 192.168.2.186 222018-08-17 12:32:15,705 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/tmp/hbase-root-regionserver.autostart2018-08-17 12:32:15,705 信息 [main] util.ServerCommandLine: env:HBASE_NICENESS=02018-08-17 12:32:15,705 INFO [main] util.ServerCommandLine: env:HBASE_OPTS= -XX:+UseConcMarkSweepGC -Dhbase.log.dir=/root/install/hbase-2.1.0/bin/../日志 -Dhbase.log.file=hbase-root-regionserver-node1.hbasecluster.com.log -Dhbase.home.dir=/root/install/hbase-2.1.0/bin/.. -Dhbase.id.str=root -Dhbase.root.logger=INFO,RFA -Dhbase.security.logger=INFO,RFAS2018-08-17 12:32:15,705 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS2018-08-17 12:32:15,705 INFO [main] util.ServerCommandLine: env:XDG_RUNTIME_DIR=/run/user/02018-08-17 12:32:15,705 信息 [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS=2018-08-17 12:32:15,705 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/root/install/hbase-2.1.0/bin/..2018-08-17 12:32:15,705 信息 [main] util.ServerCommandLine: env:SHLVL=32018-08-17 12:32:15,705 信息 [main] util.ServerCommandLine: env:HOME=/root2018-08-17 12:32:15,705 信息 [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=42018-08-17 12:32:15,706 INFO [main] util.ServerCommandLine:vmName=OpenJDK 64 位服务器 VM，vmVendor=Oracle Corporation，vmVersion=25.171-b112018-08-17 12:32:15,707 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -XX:+UseConcMarkSweepGC, -Dhbase.log.dir=/root/install/hbase-2.1.0/bin/../logs, -Dhbase.log.file=hbase-root-regionserver-node1.hbasecluster.com.log, -Dhbase.home.dir=/root/install/hbase-2.1.0/bin/.., -Dhbase.id.str=root, -Dhbase.root.logger=INFO,RFA, -Dhbase.security.logger=INFO,RFAS]2018-08-17 12:32:21,194 INFO [main] metrics.MetricRegistries:加载的 MetricRegistries 类 org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl2018 年 8 月 17 日 12:32:21,245 警告 [main] util.NativeCodeLoader:无法为您的平台加载本机 Hadoop 库...在适用的情况下使用内置 Java 类2018-08-17 12:32:21,489 INFO [main] regionserver.RSRpcServices: regionserver/node1:16020 服务器端连接重试=452018-08-17 12:32:21,503 INFO [main] ipc.RpcExecutor:实例化 default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue;numCallQueues=3，maxQueueLength=300，handlerCount=302018-08-17 12:32:21,505 INFO [main] ipc.RpcExecutor:实例化 priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue;numCallQueues=2，maxQueueLength=300，handlerCount=202018-08-17 12:32:21,505 INFO [main] ipc.RpcExecutor:实例化的 replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue;numCallQueues=1，maxQueueLength=300，handlerCount=32018-08-17 12:32:21,639 INFO [main] ipc.RpcServerFactory:创建 org.apache.hadoop.hbase.ipc.NettyRpcServer 托管 hbase.pb.ClientService、hbase.pb.AdminService2018-08-17 12:32:21,832 INFO [main] io.ByteBufferPool:使用 bufferSize=64 KB 和 maxPoolSize=1.88 KB 创建2018-08-17 12:32:21,937 ERROR [main] regionserver.HRegionServer:RegionServer 构建失败java.lang.UnsupportedOperationException:构造函数为 org.apache.hadoop.hbase.ipc.NettyRpcServer 抛出异常在 org.apache.hadoop.hbase.util.ReflectionUtils.instantiate(ReflectionUtils.java:66)在 org.apache.hadoop.hbase.util.ReflectionUtils.instantiateWithCustomCtor(ReflectionUtils.java:45)在 org.apache.hadoop.hbase.ipc.RpcServerFactory.createRpcServer(RpcServerFactory.java:66)在 org.apache.hadoop.hbase.regionserver.RSRpcServices.createRpcServer(RSRpcServices.java:1271)在 org.apache.hadoop.hbase.regionserver.RSRpcServices.(RSRpcServices.java:1238)在 org.apache.hadoop.hbase.regionserver.RSRpcServices.(RSRpcServices.java:1191)在 org.apache.hadoop.hbase.regionserver.HRegionServer.createRpcServices(HRegionServer.java:733)在 org.apache.hadoop.hbase.regionserver.HRegionServer.(HRegionServer.java:571)在 sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)在 sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)在 sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)在 java.lang.reflect.Constructor.newInstance(Constructor.java:423)在 org.apache.hadoop.hbase.regionserver.HRegionServer.constructRegionServer(HRegionServer.java:2991)在 org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:63)在 org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:87)在 org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)在 org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:149)在 org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:3009)引起:java.lang.reflect.InvocationTargetException在 sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)在 sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)在 sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)在 java.lang.reflect.Constructor.newInstance(Constructor.java:423)在 org.apache.hadoop.hbase.util.ReflectionUtils.instantiate(ReflectionUtils.java:58)……还有 17 个引起:org.apache.hbase.thirdparty.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use在 org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newIOException(Errors.java:117)在 org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.bind(Socket.java:285)在 org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel.doBind(AbstractEpollChannel.java:714)在 org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollServerSocketChannel.doBind(EpollServerSocketChannel.java:70)在 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:558)在 org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1283)在 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:501)在 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:486)在 org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:989)在 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel.bind(AbstractChannel.java:254)在 org.apache.hbase.thirdparty.io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:364)在 org.apache.hbase.thirdparty.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)在 org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTask​​s(SingleThreadEventExecutor.java:403)在 org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:309)在 org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)在 org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)在 java.lang.Thread.run(Thread.java:748)2018-08-17 12:32:21,940 错误 [main] regionserver.HRegionServerCommandLine:区域服务器退出java.lang.RuntimeException:Regionserver 的构建失败:类 org.apache.hadoop.hbase.regionserver.HRegionServer在 org.apache.hadoop.hbase.regionserver.HRegionServer.constructRegionServer(HRegionServer.java:2994)在 org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:63)在 org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:87)在 org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)在 org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:149)在 org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:3009)引起:java.lang.reflect.InvocationTargetException在 sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)在 sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)在 sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)在 java.lang.reflect.Constructor.newInstance(Constructor.java:423)在 org.apache.hadoop.hbase.regionserver.HRegionServer.constructRegionServer(HRegionServer.java:2991)……还有 5 个引起:java.lang.UnsupportedOperationException: Constructor throw an exception for org.apache.hadoop.hbase.ipc.NettyRpcServer在 org.apache.hadoop.hbase.util.ReflectionUtils.instantiate(ReflectionUtils.java:66)在 org.apache.hadoop.hbase.util.ReflectionUtils.instantiateWithCustomCtor(ReflectionUtils.java:45)在 org.apache.hadoop.hbase.ipc.RpcServerFactory.createRpcServer(RpcServerFactory.java:66)在 org.apache.hadoop.hbase.regionserver.RSRpcServices.createRpcServer(RSRpcServices.java:1271)在 org.apache.hadoop.hbase.regionserver.RSRpcServices.(RSRpcServices.java:1238)在 org.apache.hadoop.hbase.regionserver.RSRpcServices.(RSRpcServices.java:1191)

我在 org.apache.hadoop.hbase.regionserver.HRegionServer.createRpcServices(HRegionServer.java:733)在 org.apache.hadoop.hbase.regionserver.HRegionServer.(HRegionServer.java:571)……还有 10 个引起:java.lang.reflect.InvocationTargetException在 sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)在 sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)在 sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)在 java.lang.reflect.Constructor.newInstance(Constructor.java:423)在 org.apache.hadoop.hbase.util.ReflectionUtils.instantiate(ReflectionUtils.java:58)……还有 17 个引起:org.apache.hbase.thirdparty.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use在 org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newIOException(Errors.java:117)在 org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.bind(Socket.java:285)在 org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel.doBind(AbstractEpollChannel.java:714)在 org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollServerSocketChannel.doBind(EpollServerSocketChannel.java:70)在 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:558)在 org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1283)在 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:501)在 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:486)在 org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:989)在 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel.bind(AbstractChannel.java:254)在 org.apache.hbase.thirdparty.io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:364)在 org.apache.hbase.thirdparty.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)在 org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTask​​s(SingleThreadEventExecutor.java:403)在 org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:309)在 org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)在 org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)在 java.lang.Thread.run(Thread.java:748)

regionserver hbase-site.xml

<预><代码><配置><财产><name>hbase.master</name><value>nodemaster.hbasecluster.com:60000</value><description>HBase master 运行所在的主机和端口.'local' 的值在单个 </description> 中运行 master 和 regionserver.</属性><财产><name>hbase.rootdir</name><value>hdfs://nodemaster.hbasecluster.com:9000/hbase</value><description>区域服务器共享的目录.</description></属性><财产><name>hbase.cluster.distributed</name><值>真</值><description>集群将采用的模式.可能的值为 false:使用托管 Zookeeper 的独立和伪分布式设置 true:使用非托管 Zookeeper Quorum 完全分布式(请参阅 hbase-env.sh)</description></属性><财产><name>hbase.zookeeper.property.clientPort</name><value>2181</value> 属性来自 ZooKeeper 的配置 zoo.cfg.客户端将连接的端口.</描述></属性><财产><name>hbase.zookeeper.quorum</name><value>nodemaster.hbasecluster.com</value> 属性来自 ZooKeeper 的配置 zoo.cfg.客户端将连接的端口.</描述></属性><财产><name>hbase.zookeeper.distributed</name><值>真</值></属性></配置>

/etc/hosts 文件在 regionserver1 中

127.0.0.1 本地主机192.168.2.154 nodemaster.hbasecluster.com 节点主192.168.2.186 node1.hbasecluster.com node1192.168.2.187 node2.hbasecluster.com node2

主节点 jps 输出:

19717 SecondaryNameNode20441 HQuorumPeer20781 日元19470 名称节点19887 资源管理器

regionserver jps 输出:

28404 NodeManager28185 数据节点28844 日元28687 HRegionServer

我试图运行 ./bin/start-hbase.sh.当我使用命令 ./bin/hbase-daemon.sh start master 时，我的 master 日志中出现以下错误.

2018-08-20 11:50:42,742 ERROR [main] regionserver.HRegionServer: 构建失败 RegionServerjava.lang.NoClassDefFoundError: org/apache/htrace/SamplerBuilder在 org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:635)在 org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)在 org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)在 org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2669)在 org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:94)在 org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2703)在 org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2685)在 org.apache.hadoop.fs.FileSystem.get(FileSystem.java:373)在 org.apache.hadoop.fs.Path.getFileSystem(Path.java:295)在 org.apache.hadoop.hbase.util.CommonFSUtils.getRootDir(CommonFSUtils.java:358)在 org.apache.hadoop.hbase.util.CommonFSUtils.isValidWALRootDir(CommonFSUtils.java:407)在 org.apache.hadoop.hbase.util.CommonFSUtils.getWALRootDir(CommonFSUtils.java:383)在 org.apache.hadoop.hbase.regionserver.HRegionServer.initializeFileSystem(HRegionServer.java:691)在 org.apache.hadoop.hbase.regionserver.HRegionServer.(HRegionServer.java:600)在 org.apache.hadoop.hbase.master.HMaster.(HMaster.java:484)在 sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)在 sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)在 sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)在 java.lang.reflect.Constructor.newInstance(Constructor.java:423)在 org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2965)在 org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:236)在 org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:140)在 org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)在 org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:149)在 org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2983)引起:java.lang.ClassNotFoundException:org.apache.htrace.SamplerBuilder在 java.net.URLClassLoader.findClass(URLClassLoader.java:381)在 java.lang.ClassLoader.loadClass(ClassLoader.java:424)在 sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)在 java.lang.ClassLoader.loadClass(ClassLoader.java:357)……还有 25 个2018-08-20 11:50:42,744 错误 [main] master.HMasterCommandLine: Master 退出

zookeeper 能够创建与从站的连接，并且区域服务器在每个从站上运行.

解决方案

希望你是用bin/hbase-daemon.sh start master来启动master，如果是的话应该还有日志在主服务器关闭之前告诉您 ERROR/FATAL 的实际问题，并且您应该在主服务器启动时在日志中看到类似的行 "master.HMaster: STARTING service HMaster"

在 regionserver 中的日志行下方表示 regionserver 端口 (16020) 被另一个 regionserver 或应用程序使用.可能您在再次启动 regionserver 时已经看到了这一点.

Caused by: org.apache.hbase.thirdparty.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use在 org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newIOException(Errors.java:117)在 org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.bind(Socket.java:285)在 org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel.doBind(AbstractEpollChannel.java:714)

I am trying to setup HBase in a fully distributed mode: consisting of 1 master and 2 region servers. I have set HBASE_MANAGES_ZK = true in hbase-env.sh. The hadoop cluster is running on the cluster with following configurations:

Master: node-master Regionserver1: node1 Regionserver2: node2

When I am starting HBase, I can see that RegionServers are getting started and HQuorumPeer on master also, but HMaster is not showing.

Please find the logs as below: Master hbase-site.xml

<configuration>
        <property>
            <name>hbase.master</name>
            <value>nodemaster.hbasecluster.com:60000</value>
            <description>The host and port that the HBase master runs at.A value of ‘local’ runs the master and a regionserver in a single </description>
        </property>
        <property>
             <name>hbase.rootdir</name>
             <value>hdfs://nodemaster.hbasecluster.com:9000/hbase</value>
             <description>The directory shared by region servers.</description>
        </property>
        <property>
             <name>hbase.cluster.distributed</name>
             <value>true</value>
             <description>The mode the cluster will be in. Possible values are false: standalone and pseudo-distributed setups with managed Zookeeper true: fully-distributed with unmanaged Zookeeper Quorum (see hbase-env.sh) </description>
        </property>
        <property>
             <name>hbase.zookeeper.distributed</name>
             <value>true</value>
        </property>
        <property>
             <name>hbase.zookeeper.property.dataDir</name>
             <value>/usr/local/zookeeper</value>
        </property>
        <property>
             <name>hbase.zookeeper.property.clientPort</name>
             <value>2181</value>
             <description>Property from ZooKeeper’s config zoo.cfg. The port at which the clients will connect. </description>
        </property>
        <property>
             <name>hbase.zookeeper.quorum</name>
             <value>nodemaster.hbasecluster.com</value>
             <description>Comma separated list of servers in the ZooKeeper Quorum. </description>
        </property>
        <property>
             <name>hbase.tmp.dir</name>
             <value>/hbase/tmp</value>
             <description>Temporary directory on the local filesystem.</description>
        </property>
</configuration>

/etc/hosts on master

127.0.0.1 localhost
192.168.2.154 nodemaster.hbasecluster.com node-master
192.168.2.186 node1.hbasecluster.com node1
192.168.2.187 node2.hbasecluster.com node2

Logs on regionserver1

Fri Aug 17 12:32:15 IST 2018 Starting regionserver on node1.hbasecluster.com
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 15701
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 10000
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 15701
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
2018-08-17 12:32:15,420 INFO  [main] regionserver.HRegionServer: STARTING executorService HRegionServer
2018-08-17 12:32:15,422 INFO  [main] util.VersionInfo: HBase 2.1.0
2018-08-17 12:32:15,422 INFO  [main] util.VersionInfo: Source code repository git://zhangduo-Gen8/home/zhangduo/hbase/code revision=e1673bb0bbfea21d6e5dba73e013b09b8b49b89b
2018-08-17 12:32:15,422 INFO  [main] util.VersionInfo: Compiled by zhangduo on Tue Jul 10 17:26:48 CST 2018
2018-08-17 12:32:15,422 INFO  [main] util.VersionInfo: From source with checksum c8fb98abf2988c0490954e15806337d7
2018-08-17 12:32:15,703 INFO  [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-root
2018-08-17 12:32:15,703 INFO  [main] util.ServerCommandLine: hbase.rootdir: hdfs://nodemaster.hbasecluster.com:9000/hbase
2018-08-17 12:32:15,703 INFO  [main] util.ServerCommandLine: hbase.cluster.distributed: true
2018-08-17 12:32:15,703 INFO  [main] util.ServerCommandLine: hbase.zookeeper.quorum: nodemaster.hbasecluster.com
2018-08-17 12:32:15,703 INFO  [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-root-regionserver-node1.hbasecluster.com.log
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:LANG=en_US.UTF-8
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:XDG_SESSION_ID=182
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:MAIL=/var/mail/root
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:LOGNAME=root
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:HBASE_REST_OPTS=
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:PWD=/root
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:SHELL=/bin/bash
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=root
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/tmp/hbase-root-regionserver.znode
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:SSH_CLIENT=192.168.2.154 46760 22
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-root-regionserver-node1.hbasecluster.com
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/root/install/hbase-2.1.0/bin/../logs
2018-08-17 12:32:15,704 INFO  [main] util.ServerCommandLine: env:USER=root
2018-08-17 12:32:15,705 INFO  [main] util.ServerCommandLine: root/install/hbase-2.1.0/bin/../lib/spymemcached-2.12.2.jar:/root/install/hbase-2.1.0/bin/../lib/validation-api-1.1.0.Final.jar:/root/install/hbase-2.1.0/bin/../lib/xmlenc-0.52.jar:/root/install/hbase-2.1.0/bin/../lib/xz-1.0.jar:/root/install/hbase-2.1.0/bin/../lib/zookeeper-3.4.10.jar:/root/install/hbase-2.1.0/bin/../lib/client-facing-thirdparty/audience-annotations-0.5.0.jar:/root/install/hbase-2.1.0/bin/../lib/client-facing-thirdparty/commons-logging-1.2.jar:/root/install/hbase-2.1.0/bin/../lib/client-facing-thirdparty/findbugs-annotations-1.3.9-1.jar:/root/install/hbase-2.1.0/bin/../lib/client-facing-thirdparty/htrace-core4-4.2.0-incubating.jar:/root/install/hbase-2.1.0/bin/../lib/client-facing-thirdparty/log4j-1.2.17.jar:/root/install/hbase-2.1.0/bin/../lib/client-facing-thirdparty/slf4j-api-1.7.25.jar:/root/install/hbase-2.1.0/bin/../lib/client-facing-thirdparty/htrace-core-3.1.0-incubating.jar:/root/install/hbase-2.1.0/bin/../lib/client-facing-thirdparty/slf4j-log4j12-1.7.25.jar
2018-08-17 12:32:15,705 INFO  [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=true
2018-08-17 12:32:15,705 INFO  [main] util.ServerCommandLine: env:SSH_CONNECTION=192.168.2.154 46760 192.168.2.186 22
2018-08-17 12:32:15,705 INFO  [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/tmp/hbase-root-regionserver.autostart
2018-08-17 12:32:15,705 INFO  [main] util.ServerCommandLine: env:HBASE_NICENESS=0
2018-08-17 12:32:15,705 INFO  [main] util.ServerCommandLine: env:HBASE_OPTS= -XX:+UseConcMarkSweepGC   -Dhbase.log.dir=/root/install/hbase-2.1.0/bin/../logs -Dhbase.log.file=hbase-root-regionserver-node1.hbasecluster.com.log -Dhbase.home.dir=/root/install/hbase-2.1.0/bin/.. -Dhbase.id.str=root -Dhbase.root.logger=INFO,RFA -Dhbase.security.logger=INFO,RFAS
2018-08-17 12:32:15,705 INFO  [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS
2018-08-17 12:32:15,705 INFO  [main] util.ServerCommandLine: env:XDG_RUNTIME_DIR=/run/user/0
2018-08-17 12:32:15,705 INFO  [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS=
2018-08-17 12:32:15,705 INFO  [main] util.ServerCommandLine: env:HBASE_HOME=/root/install/hbase-2.1.0/bin/..
2018-08-17 12:32:15,705 INFO  [main] util.ServerCommandLine: env:SHLVL=3
2018-08-17 12:32:15,705 INFO  [main] util.ServerCommandLine: env:HOME=/root
2018-08-17 12:32:15,705 INFO  [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4
2018-08-17 12:32:15,706 INFO  [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.171-b11
2018-08-17 12:32:15,707 INFO  [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -XX:+UseConcMarkSweepGC, -Dhbase.log.dir=/root/install/hbase-2.1.0/bin/../logs, -Dhbase.log.file=hbase-root-regionserver-node1.hbasecluster.com.log, -Dhbase.home.dir=/root/install/hbase-2.1.0/bin/.., -Dhbase.id.str=root, -Dhbase.root.logger=INFO,RFA, -Dhbase.security.logger=INFO,RFAS]
2018-08-17 12:32:21,194 INFO  [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2018-08-17 12:32:21,245 WARN  [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2018-08-17 12:32:21,489 INFO  [main] regionserver.RSRpcServices: regionserver/node1:16020 server-side Connection retries=45
2018-08-17 12:32:21,503 INFO  [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30
2018-08-17 12:32:21,505 INFO  [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20
2018-08-17 12:32:21,505 INFO  [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3
2018-08-17 12:32:21,639 INFO  [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService
2018-08-17 12:32:21,832 INFO  [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB
2018-08-17 12:32:21,937 ERROR [main] regionserver.HRegionServer: Failed construction RegionServer
java.lang.UnsupportedOperationException: Constructor threw an exception for org.apache.hadoop.hbase.ipc.NettyRpcServer
    at org.apache.hadoop.hbase.util.ReflectionUtils.instantiate(ReflectionUtils.java:66)
    at org.apache.hadoop.hbase.util.ReflectionUtils.instantiateWithCustomCtor(ReflectionUtils.java:45)
    at org.apache.hadoop.hbase.ipc.RpcServerFactory.createRpcServer(RpcServerFactory.java:66)
    at org.apache.hadoop.hbase.regionserver.RSRpcServices.createRpcServer(RSRpcServices.java:1271)
    at org.apache.hadoop.hbase.regionserver.RSRpcServices.<init>(RSRpcServices.java:1238)
    at org.apache.hadoop.hbase.regionserver.RSRpcServices.<init>(RSRpcServices.java:1191)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.createRpcServices(HRegionServer.java:733)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:571)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.constructRegionServer(HRegionServer.java:2991)
    at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:63)
    at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:87)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:149)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:3009)
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at org.apache.hadoop.hbase.util.ReflectionUtils.instantiate(ReflectionUtils.java:58)
    ... 17 more
Caused by: org.apache.hbase.thirdparty.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use
    at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newIOException(Errors.java:117)
    at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.bind(Socket.java:285)
    at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel.doBind(AbstractEpollChannel.java:714)
    at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollServerSocketChannel.doBind(EpollServerSocketChannel.java:70)
    at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:558)
    at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1283)
    at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:501)
    at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:486)
    at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:989)
    at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel.bind(AbstractChannel.java:254)
    at org.apache.hbase.thirdparty.io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:364)
    at org.apache.hbase.thirdparty.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)
    at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:403)
    at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:309)
    at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
    at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)
    at java.lang.Thread.run(Thread.java:748)
2018-08-17 12:32:21,940 ERROR [main] regionserver.HRegionServerCommandLine: Region server exiting
java.lang.RuntimeException: Failed construction of Regionserver: class org.apache.hadoop.hbase.regionserver.HRegionServer
    at org.apache.hadoop.hbase.regionserver.HRegionServer.constructRegionServer(HRegionServer.java:2994)
    at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:63)
    at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:87)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:149)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:3009)
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.constructRegionServer(HRegionServer.java:2991)
    ... 5 more
Caused by: java.lang.UnsupportedOperationException: Constructor threw an exception for org.apache.hadoop.hbase.ipc.NettyRpcServer
    at org.apache.hadoop.hbase.util.ReflectionUtils.instantiate(ReflectionUtils.java:66)
    at org.apache.hadoop.hbase.util.ReflectionUtils.instantiateWithCustomCtor(ReflectionUtils.java:45)
    at org.apache.hadoop.hbase.ipc.RpcServerFactory.createRpcServer(RpcServerFactory.java:66)
    at org.apache.hadoop.hbase.regionserver.RSRpcServices.createRpcServer(RSRpcServices.java:1271)
    at org.apache.hadoop.hbase.regionserver.RSRpcServices.<init>(RSRpcServices.java:1238)
    at org.apache.hadoop.hbase.regionserver.RSRpcServices.<init>(RSRpcServices.java:1191)

I at org.apache.hadoop.hbase.regionserver.HRegionServer.createRpcServices(HRegionServer.java:733) at org.apache.hadoop.hbase.regionserver.HRegionServer.(HRegionServer.java:571) ... 10 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.util.ReflectionUtils.instantiate(ReflectionUtils.java:58) ... 17 more Caused by: org.apache.hbase.thirdparty.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newIOException(Errors.java:117) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.bind(Socket.java:285) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel.doBind(AbstractEpollChannel.java:714) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollServerSocketChannel.doBind(EpollServerSocketChannel.java:70) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:558) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1283) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:501) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:486) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:989) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel.bind(AbstractChannel.java:254) at org.apache.hbase.thirdparty.io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:364) at org.apache.hbase.thirdparty.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:403) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:309) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138) at java.lang.Thread.run(Thread.java:748)

regionserver hbase-site.xml

<configuration>
        <property>
            <name>hbase.master</name>
            <value>nodemaster.hbasecluster.com:60000</value>
            <description>The host and port that the HBase master runs at.A value of ‘local’ runs the master and a regionserver in a single </description>
        </property>
        <property>
             <name>hbase.rootdir</name>
             <value>hdfs://nodemaster.hbasecluster.com:9000/hbase</value>
             <description>The directory shared by region servers.</description>
        </property>
        <property>
             <name>hbase.cluster.distributed</name>
             <value>true</value>
             <description>The mode the cluster will be in. Possible values are false: standalone and pseudo-distributed setups with managed Zookeeper true: fully-distributed with unmanaged Zookeeper Quorum (see hbase-env.sh) </description>
        </property>
        <property>
             <name>hbase.zookeeper.property.clientPort</name>
             <value>2181</value>
             <description>Property from ZooKeeper’s config zoo.cfg. The port at which the clients will connect. </description>
        </property>
        <property>
             <name>hbase.zookeeper.quorum</name>
             <value>nodemaster.hbasecluster.com</value>
             <description>Property from ZooKeeper’s config zoo.cfg. The port at which the clients will connect. </description>
        </property>
        <property>
             <name>hbase.zookeeper.distributed</name>
             <value>true</value>
        </property>
</configuration>

/etc/hosts file in regionserver1

127.0.0.1 localhost
192.168.2.154 nodemaster.hbasecluster.com node-master
192.168.2.186 node1.hbasecluster.com node1
192.168.2.187 node2.hbasecluster.com node2

Master node jps output:

19717 SecondaryNameNode
20441 HQuorumPeer
20781 Jps
19470 NameNode
19887 ResourceManager

regionserver jps output:

28404 NodeManager
28185 DataNode
28844 Jps
28687 HRegionServer

EDIT: I was trying to run ./bin/start-hbase.sh. When I used the commands ./bin/hbase-daemon.sh start master I get the following error in my master logs. 

2018-08-20 11:50:42,742 ERROR [main] regionserver.HRegionServer: Failed construction RegionServer
java.lang.NoClassDefFoundError: org/apache/htrace/SamplerBuilder
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:635)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
        at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2669)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:94)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2703)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2685)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:373)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295)
        at org.apache.hadoop.hbase.util.CommonFSUtils.getRootDir(CommonFSUtils.java:358)
        at org.apache.hadoop.hbase.util.CommonFSUtils.isValidWALRootDir(CommonFSUtils.java:407)
        at org.apache.hadoop.hbase.util.CommonFSUtils.getWALRootDir(CommonFSUtils.java:383)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.initializeFileSystem(HRegionServer.java:691)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:600)
        at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:484)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2965)
        at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:236)
        at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:140)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:149)
        at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2983)
Caused by: java.lang.ClassNotFoundException: org.apache.htrace.SamplerBuilder
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        ... 25 more
2018-08-20 11:50:42,744 ERROR [main] master.HMasterCommandLine: Master exiting

The zookeeper was able to create connections to the slaves and the Region servers are running on each slave.

解决方案

I hope you are using bin/hbase-daemon.sh start master to start the master, if yes, there should be more logs telling you about the actual problem with ERROR/FATAL just before the master is shutting down, and also you should see a similar line "master.HMaster: STARTING service HMaster" line in the logs when master starting up.

Below log line in regionserver says that either the regionserver port(16020) is utilized by another regionserver or application. Probably you have seen this while starting the regionserver again.

Caused by: org.apache.hbase.thirdparty.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use
    at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newIOException(Errors.java:117)
    at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.bind(Socket.java:285)
    at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel.doBind(AbstractEpollChannel.java:714)

这篇关于Hbase 设置配置:HMaster 未运行的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！

查看全文
相关文章
其他开发最新文章
热门教程
热门工具
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆