[hbase]Master rejected startup because clock is out of sync
来源:互联网 发布:破解版软件下载 编辑:程序博客网 时间:2024/05/21 17:52
2015-08-22 18:47:16,718 FATAL [regionserver60020] regionserver.HRegionServer: Master rejected startup because clock is out of syncorg.apache.hadoop.hbase.ClockOutOfSyncException: org.apache.hadoop.hbase.ClockOutOfSyncException: Server node1,60020,1440240424304 has been rejected; Reported time is too far out of sync with master. Time difference of 37352ms > max allowed of 30000msat org.apache.hadoop.hbase.master.ServerManager.checkClockSkew(ServerManager.java:360)at org.apache.hadoop.hbase.master.ServerManager.regionServerStartup(ServerManager.java:253)at org.apache.hadoop.hbase.master.HMaster.regionServerStartup(HMaster.java:1397)at org.apache.hadoop.hbase.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:7910)at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2093)at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)at org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)at java.util.concurrent.FutureTask.run(FutureTask.java:266)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)at java.lang.reflect.Constructor.newInstance(Constructor.java:422)at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:287)at org.apache.hadoop.hbase.regionserver.HRegionServer.reportForDuty(HRegionServer.java:2157)at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:894)at java.lang.Thread.run(Thread.java:745)Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.ClockOutOfSyncException): org.apache.hadoop.hbase.ClockOutOfSyncException: Server node1,60020,1440240424304 has been rejected; Reported time is too far out of sync with master. Time difference of 37352ms > max allowed of 30000msat org.apache.hadoop.hbase.master.ServerManager.checkClockSkew(ServerManager.java:360)at org.apache.hadoop.hbase.master.ServerManager.regionServerStartup(ServerManager.java:253)at org.apache.hadoop.hbase.master.HMaster.regionServerStartup(HMaster.java:1397)at org.apache.hadoop.hbase.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:7910)at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2093)at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)at org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)at java.util.concurrent.FutureTask.run(FutureTask.java:266)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1457)at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1661)at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1719)at org.apache.hadoop.hbase.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$BlockingStub.regionServerStartup(RegionServerStatusProtos.java:8277)at org.apache.hadoop.hbase.regionserver.HRegionServer.reportForDuty(HRegionServer.java:2155)... 2 more2015-08-22 18:47:16,730 FATAL [regionserver60020] regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: []2015-08-22 18:47:16,731 INFO [regionserver60020] regionserver.HRegionServer: STOPPED: Unhandled: org.apache.hadoop.hbase.ClockOutOfSyncException: Server node1,60020,1440240424304 has been rejected; Reported time is too far out of sync with master. Time difference of 37352ms > max allowed of 30000msat org.apache.hadoop.hbase.master.ServerManager.checkClockSkew(ServerManager.java:360)at org.apache.hadoop.hbase.master.ServerManager.regionServerStartup(ServerManager.java:253)at org.apache.hadoop.hbase.master.HMaster.regionServerStartup(HMaster.java:1397)at org.apache.hadoop.hbase.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:7910)at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2093)at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)at org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)at java.util.concurrent.FutureTask.run(FutureTask.java:266)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)2015-08-22 18:47:16,731 INFO [regionserver60020] ipc.RpcServer: Stopping server on 600202015-08-22 18:47:16,734 INFO [regionserver60020] regionserver.HRegionServer: Stopping infoServer2015-08-22 18:47:16,748 INFO [regionserver60020] mortbay.log: Stopped SelectChannelConnector@0.0.0.0:600302015-08-22 18:47:16,853 INFO [regionserver60020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager abruptly.2015-08-22 18:47:16,855 INFO [regionserver60020] regionserver.HRegionServer: aborting server null2015-08-22 18:47:16,855 DEBUG [regionserver60020] catalog.CatalogTracker: Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@7e50fc222015-08-22 18:47:16,855 INFO [regionserver60020] client.HConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x14f54de7ead00042015-08-22 18:47:16,866 INFO [regionserver60020-EventThread] zookeeper.ClientCnxn: EventThread shut down2015-08-22 18:47:16,867 INFO [regionserver60020] zookeeper.ZooKeeper: Session: 0x14f54de7ead0004 closed2015-08-22 18:47:16,868 INFO [regionserver60020] regionserver.HRegionServer: stopping server null; all regions closed.2015-08-22 18:47:16,871 INFO [regionserver60020] regionserver.Leases: regionserver60020 closing leases2015-08-22 18:47:16,871 INFO [regionserver60020] regionserver.Leases: regionserver60020 closed leases2015-08-22 18:47:16,873 INFO [regionserver60020] regionserver.CompactSplitThread: Waiting for Split Thread to finish...2015-08-22 18:47:16,873 INFO [regionserver60020] regionserver.CompactSplitThread: Waiting for Merge Thread to finish...2015-08-22 18:47:16,873 INFO [regionserver60020] regionserver.CompactSplitThread: Waiting for Large Compaction Thread to finish...2015-08-22 18:47:16,873 INFO [regionserver60020] regionserver.CompactSplitThread: Waiting for Small Compaction Thread to finish...2015-08-22 18:47:16,885 WARN [regionserver60020] zookeeper.RecoverableZooKeeper: Node /hbase/rs/node1,60020,1440240424304 already deleted, retry=false2015-08-22 18:47:16,885 WARN [regionserver60020] regionserver.HRegionServer: Failed deleting my ephemeral nodeorg.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /hbase/rs/node1,60020,1440240424304at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.delete(RecoverableZooKeeper.java:179)at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1290)at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1279)at org.apache.hadoop.hbase.regionserver.HRegionServer.deleteMyEphemeralNode(HRegionServer.java:1377)at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:1065)at java.lang.Thread.run(Thread.java:745)2015-08-22 18:47:16,894 INFO [regionserver60020-EventThread] zookeeper.ClientCnxn: EventThread shut down2015-08-22 18:47:16,895 INFO [regionserver60020] zookeeper.ZooKeeper: Session: 0x34f54ddf4610003 closed2015-08-22 18:47:16,895 INFO [regionserver60020] regionserver.HRegionServer: stopping server null; zookeeper connection closed.2015-08-22 18:47:16,895 INFO [regionserver60020] regionserver.HRegionServer: regionserver60020 exiting2015-08-22 18:47:16,895 ERROR [main] regionserver.HRegionServerCommandLine: Region server exitingjava.lang.RuntimeException: HRegionServer Abortedat org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:66)at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:85)at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)at org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2543)2015-08-22 18:47:16,899 INFO [Thread-9] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@61eaec382015-08-22 18:47:16,900 INFO [Thread-9] regionserver.ShutdownHook: Starting fs shutdown hook thread.2015-08-22 18:47:16,904 INFO [Thread-9] regionserver.ShutdownHook: Shutdown hook finished
解决办法:
同步服务器时钟<p class="p1"><span class="s1">ntpdate -u ntp.sjtu.edu.cn</span></p>
0 0
- [hbase]Master rejected startup because clock is out of sync
- Hbase 启动报 clock is out of sync 错
- Reported time is too far out of sync with master. Time difference of ...HBase时钟不同步问题
- FragmentTabHost] File is Out of sync
- HRegionServer: Master rejected startup异常解决
- Hudson/Jenkins -- 消除svn警告: "clock of the subversion server appears to be out of sync"
- Hudson/Jenkins -- 消除svn警告: "clock of the subversion server appears to be out of sync"
- resource is out of sync with the file system
- resource is out of sync with the file system
- Resource is out of sync with the file system: 解决办法。
- Resource is out of sync with the file system
- Resource is out of sync with the file system
- Resource is out of sync with the file 解决办法
- Publish failed using Ant publisher Resource is out of sync
- Resource is out of sync with the file system
- resource is out of sync with the file system 解决方法
- resource is out of sync with the file system 解决方法
- resource is out of sync with the file system 解决方法
- caffe hinge _loss layer
- 通过Linux终端查看公司IP
- 查找多个文件的关键字
- OnGlobalLayoutListener获得一个视图的高度
- Hadoop学习笔记:MapReduce框架详解
- [hbase]Master rejected startup because clock is out of sync
- 3.5发布Web地图服务(WMS)
- 21 个最棒最有用的 JavaScript 图表库
- 设置代理VPN等FQ的一些方式
- linux 每个程序员都应该知道的8个Linux命令
- 【linux】ubuntu 14.04下安装mysql 5.5
- 用Mathematica拯救一只数字化猫(2)
- SQLite和MySQL数据库的区别与应用
- 分布式MySQL数据库TDSQL架构分析