kafka-storm-stater研究
来源:互联网 发布:大学生程序员兼职群 编辑:程序博客网 时间:2024/04/28 17:44
kafka集群安装
中文介绍
项目地址
下载后解压到/usr/local/spark/sbtproject
进入解压目录执行测试
sbt test
sbt run
This command launches kafkastormdemo. This demo starts in-memory instances of ZooKeeper, Kafka, and Storm. It then runs a demo Storm topology that connects to and reads from the Kafka instance.
停止运行
To stop the demo application you must kill orCtrl-C
the process in the terminal.
- 编译代码
$ ./sbt clean compile
If you want to only (re)generate Java classes from Avro schemas:
$ ./sbt avro:generate
Generated Java sources are stored under target/scala-*/src_managed/main/compiled_avro/.
- 运行测试
$ ./sbt clean test
- Creating code coverage reports
$ ./sbt clean scoverage:test
- 打包代码
$ ./sbt clean package>>> Generates `target/scala-2.10/kafka-storm-starter_2.10-0.2.0-SNAPSHOT.jar`
To create a fat jar, which includes any dependencies of kafka-storm-starter:
$ ./sbt assembly>>> Generates `target/scala-2.10/kafka-storm-starter-assembly-0.2.0-SNAPSHOT.jar`
Note: By default, assembly by itself will NOT run any tests. If you want to run tests before assembly, chain sbt commands in sequence, e.g. ./sbt test assembly. See assembly.sbt` for details why we do this.
- 创建scaladoc/javadoc jar
$ ./sbt packageDoc>>> Generates `target/scala-2.10/kafka-storm-starter_2.10-0.2.0-SNAPSHOT-javadoc.jar`
- 创建源代码jar
$ ./sbt packageSrc>>> Generates `target/scala-2.10/kafka-storm-starter_2.10-0.2.0-SNAPSHOT-sources.jar`
- 创建APIdocs
$ ./sbt packageSrc>>> Generates `target/scala-2.10/kafka-storm-starter_2.10-0.2.0-SNAPSHOT-sources.jar`
IDE支持
- 建立IDEA项目文件
$ ./sbt gen-idea
You can then open kafka-storm-starter as a project in IDEA via File > Open… and selecting the top-level directory of kafka-storm-starter.
有一个bug需要注意
Until this bug is fixed upstream you can use the following workaround, which you must perform everytime you run ./sbt gen-idea:
1。 In IntelliJ IDEA open the project structure for kafka-storm-starter via File > Project Structure….
2 。Under Project settings on the left-hand side select Modules.
3。 Select the Sources tab on the right-hand side.
4 。Remove the problematic target/scala-2.10/src_managed/main/compiled_avro/com entry from the Source Folders listing (the source folders are colored in light-blue). Note the trailing …/com, which comes from com.miguno.avro.Tweet in the twitter.avsc Avro schema.
5 。Click Ok.
参考
- kafka-storm-stater研究
- 【storm kafka】storm kafka集成
- Storm Kafka + Storm + HBase实例
- kafka以及storm-kafka整合
- Kafka研究
- flume+kafka+storm
- flume+kafka+storm调研
- Storm 与Kafka 整合
- Flume+kafka+storm整合
- storm-kafka 学习
- storm kafka集成
- flume+kafka+storm+mysql
- Flume+storm+kafka
- storm-kafka示例详解
- kafka+storm初探
- flume+kafka+storm
- flume、kafka、storm常用命令
- storm-kafka编程指南
- Hello World
- exchange2013 outlook连接服务器的方法
- Oracle数据类型与.NET中的对应关系
- TIOBE(2015.8):Java、C和C++持稳前三,OC依然在Top 5之外
- IOS设备上修改原deb解包 打包-教程
- kafka-storm-stater研究
- git 撤销分支删除 操作 (git delete branch undo)
- 在Mac os x 安装 Redis
- 小谈并查集及其算法实现
- word2vec纯程序+注释
- 2014 找工作总结
- [Android随笔]内存泄漏以及内存溢出
- 网页宽度自动适应手机屏幕宽度的方法
- 欢迎使用CSDN-markdown编辑器