tune performance

来源:互联网 发布:建筑外观效果图软件 编辑:程序博客网 时间:2024/06/08 19:58

The following ending with ‘~’ should override the default value.
Inter-worker:
Netty.server.thread(Netty-server-localhost-670X-worker-N)[storm.messaging.netty.server_worker_threads] [NioServerSocketChannelFactory] 1 ~
Netty.client.thread(client-worker-N) [storm.messaging.netty.client_worker_threads] 1 ~
Netty.tcp.buffer [storm.messaging.netty.buffer_size] [child.receiveBufferSize|sendBufferSize] 5MB(storm-yarn default 1MB) ~
Netty.send.buffer [storm.messaging.netty.transfer.batch.size] 256KB

Intra-worker:
Worker.receive.thread(Thread-n-worker-receiver-thread-N) [topology.worker.receiver.thread.count] 1 ~
Worker.send.thread(Thread-n-disruptor-worker-transfer-queue) 1
Worker.receive.buffer [topology.receiver.buffer.size] 8
Worker.send.buffer [topology.transfer.buffer.size] 1024

Executor.task.thread(Thread-n-{task}) [spout/bolt parallelism_hint|topology.acker.executors] ~
Executor.send.thread(Thread-n-disruptor-executor[m m]-send-queue) 1/executor
Executor.receive.buffer [disruptor] [topology.executor.receive.buffer.size] 1024 ~
Executor.send.buffer [disruptor] [topology.executor.send.buffer.size] 1024 ~

  1. Executor.task.thread不仅包括用户写的spout、bolt task,还包括系统的acker task,它们都有对应的Executor.send.thread;
  2. Worker进程内除了上面所列举的线程外,还有metrics-meter-tick-thread和timer tasks,timer tasks如下:user-timer
    executor-heartbeat-timer
    refresh-active-timer
    refresh-connections-timer
    heartbeat-timer
0 0
原创粉丝点击