kafka按照时间戳获取offset
来源:互联网 发布:qq炫舞合魔法软件 编辑:程序博客网 时间:2024/06/06 01:38
1.官网关于根据时间戳获取offset的介绍
Can I add new brokers dynamically to a cluster?
Yes, new brokers can be added online to a cluster. Those new brokers won't have any data initially until either some new topics are created or some replicas are moved to them using thepartition reassignment tool.
How do I accurately get offsets of messages for a certain timestamp using OffsetRequest?
Kafka allows querying offsets of messages by time and it does so at segment granularity. The timestamp parameter is the unix timestamp and querying the offset by timestamp returns the latest possible offset of the message that is appended no later than the given timestamp. There are 2 special values of the timestamp - latest and earliest. For any other value of the unix timestamp,Kafka will get the starting offset of the log segment that is created no later than the given timestamp. Due to this, and since the offset request is served only at segment granularity, the offset fetch request returns less accurate results for larger segment sizes.
For more accurate results, you may configure the log segment size based on time (log.roll.ms) instead of size (log.segment.bytes). However care should be taken since doing so might increase the number of file handlers due to frequent log segment rolling.
- kafka按照时间戳获取offset
- Kafka通过timestamp获取offset的机制详解
- Kafka offset存储方式与获取消费实现
- 关于怎么获取kafka指定位置offset消息
- Kafka offset存储方式与获取消费实现
- kafka监控Kafka Offset Monitor
- kafka offset判断
- Kafka-Offset-Monitor安装
- 重置kafka的offset
- kafka offset查询、提交
- Kafka Offset Storage
- Kafka Offset Storage
- kafka offset判断
- kafka-offset 存储方式
- kafka中的offset
- kafka auto.offset.reset介绍
- kafka 设置auto.offset.reset
- kafka 的offset的重置
- php解决session跨域,验证码无效问题。
- KALI LINUX SSH 相关配置
- Python开发学习笔记(7) - dict, set
- Android Volley完全解析(二),使用Volley加载网络图片
- scrapy + pandas 进行数据分析的一个例子
- kafka按照时间戳获取offset
- 小程序五:组件之视图容器
- C# 读写XML文件的方法详细总结
- 图解HTTP笔记之第三章:http的请求报文和响应报文
- 瀑布流详解
- Java 三种技术框架
- vi 整行 多行 复制与粘贴
- 我是这么聊 QQ 的!可以,这很Linux
- Android Volley完全解析(三),定制自己的Request