kafka
来源:互联网 发布:淘宝数码商城 编辑:程序博客网 时间:2024/06/05 06:14
kafka —a distributed streaming platfform
PUBLISH & SUBSCRIBE
Read and write streams of data like a messaging system.
Learn more »
PROCESS
Write scalable stream processing applications that react to events in real-time.
Learn more »
STORE
Store streams of data safely in a distributed, replicated, fault-tolerant cluster.
Learn more »
It gets used for two broad classes of application:
- Building real-time streaming data pipelines that reliably get data between systems or applications
- Building real-time streaming applications that transform or react to the streams of data
First a few concepts:
- Kafka is run as a cluster on one or more servers.
- The Kafka cluster stores streams of records in categories called topics.
- Each record consists of a key, a value, and a timestamp.
Kafka has four core APIs:
- The Producer API allows an application to publish a stream of records to one or more Kafka topics.
- The Consumer API allows an application to subscribe to one or more topics and process the stream of records produced to them.
- The Streams API allows an application to act as a stream processor, consuming an input stream from one or more topics and producing an output stream to one or more output topics, effectively transforming the input streams to output streams.
- The Connector API allows building and running reusable producers or consumers that connect Kafka topics to existing applications or data systems. For example, a connector to a relational database might capture every change to a table.
In Kafka the communication between the clients and the servers is done with a simple, high-performance, language agnosticTCP protocol. This protocol is versioned and maintains backwards compatibility with older version. We provide a Java client for Kafka, but clients are available inmany languages.
Topics —partitions
Producer
Consumer
Stream
connector
- Kafka
- kafka
- kafka
- KAFKA
- Kafka
- kafka
- kafka
- kafka
- kafka
- Kafka
- kafka
- Kafka
- Kafka
- Kafka
- kafka
- kafka
- Kafka
- kafka
- 开发小结之layoutSubviews调用
- 欢迎使用CSDN-markdown编辑器
- ajax同步提交数据,并把请求返回值赋值给全局变量
- 二叉树的镜像 (剑指Offer 第 17 题)
- CG 标准函数库
- kafka
- react-router 4.0 格式化文档
- 路由
- Override和Overload
- 看到科技亮相高交会:你不能错过的五大看点预告!
- PullToRefresh添加HeaderView(Banner轮播)
- ES6-对象的扩展-属性名表达式
- Tensorflow Lite 0.1 for Android
- PHP curl请求错误汇总和解决方案