storm UI界面各参数全解

来源:互联网 发布:php替换字符串中一部分 编辑:程序博客网 时间:2024/06/05 19:57

Storm UI(Storm UI首页)

Cluster Summary(集群概况)

Version(版本)Nimbus uptime(nimbus运行时长)Supervisors(supervisor节点数)Used slots集群上已被使用的slots数目) Free slots集群上空闲的slots数目Total slots集群上的slots数目Executors(集群上各个top的workers总数)Tasks(集群上各个top的tasks总数)0.9.2-incubating44m 48s28088484

Topology summary(Topology概况)

Name(top名)Id(top id)Status(top状态:ACTIVE激活状态、Kill死亡状态、
Deactivate失效状态、Rebalance调整状态
)
Uptime(top运行时长)Num workersNum tasksNum executors(每个Topology运行时的worker的数目,默认值是1,若在代码中设置,则此选项值被覆盖Num tasks(top的并发度,是由TopologyBuilder.setSpout()和TopologyBuilder.setBolt()第三个参数parallelism_hint之和加workers组成log2masterlog2master-1-1411120914ACTIVE2d 17h 8m 18s28328havedatahavedata-4-1411029946ACTIVE3d 18h 24m 28s28328nodatanodata-3-1411029925ACTIVE3d 18h 24m 49s28228havedatahavelog2masterhavedatahavelog2master-1-1411116976ACTIVE2d 18h 13m 57s000

Supervisor summary(Supervisor概况)

Id(supervisor id)Host(supervisor所在主机名称)Uptime(supervisor节点运行时长)Slots(supervisor上的slots数目,默认是4个,其端口分别是6700-6703Used slots(supervisor上已被使用的slots数目5e959828-9098-4a23-bccc-ed5e5860b891slave142m 59s44ced12451-73fd-4dd9-95ea-4e646848e9c7slave241m 27s44

Nimbus Configuration(Nimbus配置信息)

KeyValuedev.zookeeper.path/tmp/dev-storm-zookeepertopology.tick.tuple.freq.secs topology.builtin.metrics.bucket.size.secs60topology.fall.back.on.java.serializationtruetopology.max.error.report.per.interval5zmq.linger.millis5000topology.skip.missing.kryo.registrationsfalsestorm.messaging.netty.client_worker_threads1ui.childopts-Xmx768mstorm.zookeeper.session.timeout20000nimbus.reassigntruetopology.trident.batch.emit.interval.millis500storm.messaging.netty.flush.check.interval.ms10nimbus.monitor.freq.secs10logviewer.childopts-Xmx128mjava.library.path/usr/local/lib:/opt/local/lib:/usr/libtopology.executor.send.buffer.size1024storm.local.dir(storm的工作目录)/home/hadoop/storm/workstorm.messaging.netty.buffer_size5242880supervisor.worker.start.timeout.secs120topology.enable.message.timeoutstruenimbus.cleanup.inbox.freq.secs600nimbus.inbox.jar.expiration.secs3600drpc.worker.threads64topology.worker.shared.thread.pool.size4nimbus.host(nimbus地址)192.168.195.199storm.messaging.netty.min_wait_ms100storm.zookeeper.port2181transactional.zookeeper.port topology.executor.receive.buffer.size1024transactional.zookeeper.servers storm.zookeeper.root(Storm在zookeeper集群中的根目录,默认是“/”,可以使用zkCli.sh查看)/stormstorm.zookeeper.retry.intervalceiling.millis30000supervisor.enabletruestorm.messaging.netty.server_worker_threads1storm.zookeeper.servers(zk集群中各服务器地址)192.168.195.199,192.168.195.201,192.168.195.202transactional.zookeeper.root/transactionaltopology.acker.executors topology.transfer.buffer.size1024topology.worker.childopts drpc.queue.size128worker.childopts-Xmx768msupervisor.heartbeat.frequency.secs(supervisor心跳频率,单位以秒计算)5topology.error.throttle.interval.secs10zmq.hwm0drpc.port(在使用drpc服务时,drpc server的服务端口)3772supervisor.monitor.frequency.secs3drpc.childopts-Xmx768mtopology.receiver.buffer.size8task.heartbeat.frequency.secs3topology.tasks storm.messaging.netty.max_retries100topology.spout.wait.strategybacktype.storm.spout.SleepSpoutWaitStrategynimbus.thrift.max_buffer_size1048576topology.max.spout.pending storm.zookeeper.retry.interval1000topology.sleep.spout.wait.strategy.time.ms1nimbus.topology.validatorbacktype.storm.nimbus.DefaultTopologyValidatorsupervisor.slots.ports(supervisor节点上slots端口号,一个supervisor节点默认有四个slots,其端口号默认分别是6700,6701,6702,67036700,6701,6702,6703topology.debugfalsenimbus.task.launch.secs120nimbus.supervisor.timeout.secs60topology.message.timeout.secs30task.refresh.poll.secs10topology.workers(每个Topology运行时的worker的默认数目,默认值是1,若在代码中设置,则此选项值被覆盖)1supervisor.childopts-Xmx256mnimbus.thrift.port6627topology.stats.sample.rate0.05worker.heartbeat.frequency.secs1topology.tuple.serializerbacktype.storm.serialization.types.ListDelegateSerializertopology.disruptor.wait.strategycom.lmax.disruptor.BlockingWaitStrategytopology.multilang.serializerbacktype.storm.multilang.JsonSerializernimbus.task.timeout.secs30storm.zookeeper.connection.timeout15000topology.kryo.factorybacktype.storm.serialization.DefaultKryoFactorydrpc.invocations.port3773logviewer.port8000zmq.threads1storm.zookeeper.retry.times5topology.worker.receiver.thread.count1storm.thrift.transportbacktype.storm.security.auth.SimpleTransportPlugintopology.state.synchronization.timeout.secs60supervisor.worker.timeout.secs30nimbus.file.copy.expiration.secs600storm.messaging.transportbacktype.storm.messaging.netty.Contextlogviewer.appender.nameA1storm.messaging.netty.max_wait_ms1000drpc.request.timeout.secs600storm.local.mode.zmqfalseui.port(nimbus节点上ui页面端口号,默认是8080)8080nimbus.childopts-Xmx1024mstorm.cluster.modedistributedtopology.max.task.parallelism(每个top运行时最大的executor数 storm.messaging.netty.transfer.batch.size262144


Storm UI

Topology summary

NameIdStatusUptimeNum workersNum executorsNum tasksFirstStorm201409230942FirstStorm201409230942-3-1411436633ACTIVE7h 35m 36s28328

Topology stats

WindowEmittedTransferredComplete latency (ms)AckedFailed10m 0s40400.000003h 0m 0s40400.000001d 0h 0m 0s40400.00000All time40400.00000


0 0