如何本地调试Storm topology

来源:互联网 发布:医保报销软件 编辑:程序博客网 时间:2024/05/21 17:35

1. 在Main程序中,要使用 LocalCluster提交topology

LocalCluster cluster = new LocalCluster();cluster.submitTopology("word-count", conf,        builder.createTopology());Thread.sleep(10000);cluster.shutdown();

2. 如果是Maven工程,则最好单独制作Storm工程,使pom.xml中只有storm程序需要的依赖和repository,

否则可能会导致某些类或方法找不到,引起 Error on initialization of server mk-worker


pom.xml

<repositories>    <repository>        <id>github-releases</id>        <url>http://oss.sonatype.org/content/repositories/github-releases/</url>    </repository>    <repository>        <id>clojars.org</id>        <url>http://clojars.org/repo</url>    </repository>    <repository>        <id>twitter4j</id>        <url>http://twitter4j.org/maven2</url>    </repository></repositories><dependencies>    <dependency>        <groupId>org.apache.storm</groupId>        <artifactId>storm-core</artifactId>        <version>0.9.6</version>        <!--scope>provided</scope-->    </dependency>    <dependency>        <groupId>org.apache.storm</groupId>        <artifactId>storm-hdfs</artifactId>        <version>0.9.6</version>        <!--scope>provided</scope-->    </dependency>    <dependency>        <groupId>com.google.guava</groupId>        <artifactId>guava</artifactId>        <version>13.0.1</version>    </dependency>    <dependency>        <groupId>commons-collections</groupId>        <artifactId>commons-collections</artifactId>        <version>3.2.1</version>    </dependency></dependencies>

0 0
原创粉丝点击