Flume 学习笔记 一 ： Flume User Guide

1.  Architecture 总体概述

Flume’s architecture is simple, robust, and flexible. Themain abstraction in Flume is a stream-oriented data flow. A data flow describes the way a singlestream of data is transferred and processed from its point of generation to itseventual destination. Data flows are composed of logical nodes that can transform oraggregate the events they receive. Logical nodes are wired together in chainsto form a data flow. The way in which they are wired is called the logicalnode’s configuration.

Controlling all this is the Flume Master, which is a separateservice with knowledge of all the physical and logical nodes in a Flumeinstallation. The Master assigns configurations to logical nodes, and isresponsible for communicating configuration updates by the user to all logicalnodes. In turn, the logical nodes periodically contact the master so they canshare monitoring information and check for updates to their configuration.

 

三层结构：