The parallelism of Storm

来源:互联网 发布:java get和post请求 编辑:程序博客网 时间:2024/05/17 02:02

物理架构:一个nimbus, 数个supervisor

每个supervisor默认拥有4个slots,一个worker进程将占用一个slot,拥有独立的jvm

一个topology的config可以配置the number of workers

worker process executes a subset of a topology, and runs in its own JVM.

An executor is a thread that is spawned by a worker process and runs within the worker’s JVM

task performs the actual data processing and is run within its parent executor’s thread of execution.

executor数<=task数,topology一旦运行task数不变,executor数可以rebalance


ref:Understanding the Parallelism of a Storm Topology

0 0
原创粉丝点击