kafka to hdfs
来源:互联网 发布:韩国东大门淘宝店推荐 编辑:程序博客网 时间:2024/05/21 00:19
KaBoom - A High Performance Consumer Client for Kafka
https://github.com/blackberry/KaBoom
Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data.
http://flume.apache.org/
Gobblin is a universal data ingestion framework for extracting, transforming, and loading large volume of data from a variety of data sources, e.g., databases, rest APIs, FTP/SFTP servers, filers, etc., onto Hadoop.
http://gobblin.readthedocs.io/en/latest/case-studies/Kafka-HDFS-Ingestion/
The HDFS connector allows you to export data from Kafka topics to HDFS files in a variety of formats and integrates with Hive to make data immediately available for querying with HiveQL.
https://docs.confluent.io/current/connect/connect-hdfs/docs/hdfs_connector.html
This is a hadoop job for incremental loading of kafka topics into hdfs
https://github.com/amient/kafka-hadoop-loader
https://www.cnblogs.com/zdfjf/p/5646525.html
- kafka to hdfs
- Kafka+Gobblin+HDFS实践
- Kafka+Storm+HDFS
- Kafka+Storm+HDFS整合
- flume+kafka+hdfs详解
- Kafka+Storm+HDFS整合
- flume+kafka+storm+hdfs
- How-to: make spark streaming collect data from Kafka topics and store data into hdfs
- How-to: effective store kafka data into hdfs via spark streaming
- Kafka发送消息到HDFS
- Kafka+Storm+HDFS整合实践
- Kafka+Storm+HDFS整合实践
- Kafka+Storm+HDFS整合实践
- Kafka+Storm+HDFS整合实践
- Kafka+Storm+HDFS整合实践
- Kafka+Storm+HDFS整合实践
- Kafka+Storm+HDFS整合实践
- Kafka+Storm+HDFS整合实践
- VitualBox安装centos虚拟机
- 数据结构实验之图论三:判断可达性(BFS算法)
- Java中Synchronized的用法
- 有向无环图(DAG)的最小路径覆盖
- 使用递归制作树形结构
- kafka to hdfs
- ubuntu如何删除无效的应用图标
- 指向字符串的指针 ------ 字符串指针
- SQL语句参数化(用%s)
- Spring 使用注解方式进行事务管理
- Snapchat SDE 电面+onsite面经
- vb.net 教程 3-13 动态创建控件2
- java中的url 编码(Encoder)与解码(Decoder)
- TensorFlow初学(二)