dubbo + assembly 整理

本文结合网上资料整理。

Dubbo部分

Dubbo 是阿里巴巴开源一个RPC框架，核心思想是通过注册中心，实现provider和consumer之间的接口交互。可以通过多个provider实现分布式，consumer在使用时不必关心提供方。

这几天在调整dubbo provider的发布方式。之前项目使用了war的方式提供服务，这在provider过多时，需要引入许多container并带来维护成本，而且容器本身也占用系统内存。官方的demo是采用jar的方式调用，但要注意的是，如果直接在main线程注册provider而不block住，注册完马上就会注销。

网上有人采用System.in.read(); 方式来block，代码片段如下：

public class Main {public static void main(String[] args){// load spring、dubbo configurationtry {System.in.read();} catch (IOException e) {e.printStackTrace();}}

但是放到centos上执行不顺利，改用了线程sleep的方式。代码片段如下：

public static void main(String[] args) throws IOException {logger.info(" **** main start ****");MyThread myThread = new MyThread();Thread thread = new Thread(myThread, "xxx");thread.start();logger.info(" **** main end ****");}@Overridepublic void run() {//load spring、dubbo configurationscontext.start();do {try {Thread.sleep(3600000);} catch (InterruptedException e) {logger.error("",e);}} while (true);}

如果有业务需要，可以增加interrupt方式来终止线程。

Assembly部分

maven提供了maven-assembly-plugin，适用于打包。在assembly基础上配套了profie，更适用于企业多环境的部署问题。

比如一个qa profile，配置assembly文件位置

<profile><id>qa</id><properties><assembly.ddescriptor>build/assembly/qa/assembly.xml</assembly.ddescriptor></properties></profile>

插件使用时即可根据profile读取正确的配置文件

<plugin>    <groupId>org.apache.maven.plugins</groupId>    <artifactId>maven-assembly-plugin</artifactId>    <version>2.4</version>    <configuration>        <descriptors>            <descriptor>${assembly.ddescriptor}</descriptor>        </descriptors>    </configuration>    <executions>        <!-- 当执行mvn package时才会打包 -->        <execution>            <id>make-assembly</id>            <phase>package</phase>            <goals>                <goal>single</goal>            </goals>        </execution>    </executions></plugin>

assembly.xml 如下，指定一些配置文件的路径。

<assembly>    <id>bin</id>    <formats>        <!-- zip,tar,tar.gz,tar.bz2,jar,dir,war -->        <format>zip</format>    </formats>    <includeBaseDirectory>false</includeBaseDirectory>    <dependencySets>        <!-- 依赖包的输出路径 -->        <dependencySet>        <useProjectArtifact>true</useProjectArtifact>            <outputDirectory>lib</outputDirectory>        </dependencySet>    </dependencySets>    <!-- 需要打包的文件集 -->    <fileSets>    <fileSet>            <directory>env/qa/conf</directory>            <outputDirectory>/conf</outputDirectory>            <includes>        <include>**/*.xml</include>    </includes>        </fileSet>        <fileSet>            <directory>env/qa/conf</directory>            <outputDirectory>/conf</outputDirectory>            <includes>        <include>**/*.properties</include>    </includes>    <filtered>true</filtered>        </fileSet>        <fileSet>            <directory>build/scripts</directory>            <outputDirectory>/bin</outputDirectory>            <includes>        <include>**</include>    </includes>        </fileSet>    </fileSets></assembly>

提供start.sh、stop.sh脚本

#!/bin/bashexport JAVA_HOME=xxxexport PATH=$PATH:/xxx/bincd `dirname $0`BIN_DIR=`pwd`cd ..DEPLOY_DIR=`pwd`CONF_DIR=$DEPLOY_DIR/confJAVA_MAIN_CLASS="xxx"PIDS=`ps -f | grep java | grep "$CONF_DIR" |awk '{print $2}'`if [ -n "$PIDS" ]; then    echo "ERROR: The $DEPLOY_DIR already started!"    echo "PID: $PIDS"    exit 1fiLOGS_DIR=$DEPLOY_DIR/logsif [ ! -d $LOGS_DIR ]; then    mkdir $LOGS_DIRfiSTDOUT_FILE=$LOGS_DIR/stdout.logLIB_DIR=$DEPLOY_DIR/libLIB_JARS=`ls $LIB_DIR|grep .jar|awk '{print "'$LIB_DIR'/"$0}'|tr "\n" ":"`JAVA_OPTS=" -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true "JAVA_DEBUG_OPTS=""if [ "$1" = "debug" ]; then    JAVA_DEBUG_OPTS=" -Xdebug -Xnoagent -Djava.compiler=NONE -Xrunjdwp:transport=dt_socket,address=8000,server=y,suspend=n "fiJAVA_JMX_OPTS=""if [ "$1" = "jmx" ]; then    JAVA_JMX_OPTS=" -Dcom.sun.management.jmxremote.port=1099 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false "fiJAVA_MEM_OPTS=""BITS=`java -version 2>&1 | grep -i 64-bit`if [ -n "$BITS" ]; then    JAVA_MEM_OPTS=" -server -Xmx2g -Xms2g -Xmn256m -XX:PermSize=128m -Xss256k -XX:+DisableExplicitGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:+UseCMSCompactAtFullCollection -XX:LargePageSizeInBytes=128m -XX:+UseFastAccessorMethods -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=70 "else    JAVA_MEM_OPTS=" -server -Xms1g -Xmx1g -XX:PermSize=128m -XX:SurvivorRatio=2 -XX:+UseParallelGC "fiecho -e "Starting the $DEPLOY_DIR ...\c"nohup java $JAVA_OPTS $JAVA_MEM_OPTS $JAVA_DEBUG_OPTS $JAVA_JMX_OPTS -Djava.ext.dirs=$LIB_DIR:$CONF_DIR $JAVA_MAIN_CLASS > $STDOUT_FILE 2>&1 &COUNT=0while [ $COUNT -lt 1 ]; do        echo -e ".\c"    sleep 1    COUNT=`ps -f | grep java | grep "$DEPLOY_DIR" | awk '{print $2}' | wc -l`    if [ $COUNT -gt 0 ]; then        break    fidoneecho "OK!"PIDS=`ps -f | grep java | grep "$DEPLOY_DIR" | awk '{print $2}'`echo "PID: $PIDS"echo "STDOUT: $STDOUT_FILE"

#!/bin/bashcd `dirname $0`BIN_DIR=`pwd`cd ..DEPLOY_DIR=`pwd`CONF_DIR=$DEPLOY_DIR/confPIDS=`ps -ef | grep java | grep "$DEPLOY_DIR" |awk '{print $2}'`if [ -z "$PIDS" ]; then    echo "ERROR: The $DEPLOY_DIR does not started!"    exit 1fiif [ "$1" != "skip" ]; then    $BIN_DIR/dump.shfiecho -e "Stopping the $DEPLOY_DIR ...\c"for PID in $PIDS ; do    kill $PID > /dev/null 2>&1doneCOUNT=0while [ $COUNT -lt 1 ]; do        echo -e ".\c"    sleep 1    COUNT=1    for PID in $PIDS ; do        PID_EXIST=`ps -f -p $PID | grep java`        if [ -n "$PID_EXIST" ]; then            COUNT=0            break        fi    donedoneecho "OK!"echo "PID: $PIDS"

dubbo服务管理部分

以上部分从使用上已经可以正常提供dubbo服务，但是为了方便管理，可以增加后台控制。这里采用java的process来操作shell脚本。

String sudo = "chmod 777 " + script;String cmd = "/bin/sh " + script;Process process = null;try {logger.info("execute command:{}",sudo);process = Runtime.getRuntime().exec(sudo);process.waitFor();logger.info("execute command:{}",cmd);Runtime.getRuntime().exec(cmd);} catch (Exception e) {logger.error("{}",e);}finally {process.destroy();}

chmod是考虑到权限问题。在使用java progress操作时，需要注意提供环境变量支持，如上面脚本的JAVA_HOME。

管理系统代码可以参考：Dubbo-center

********** 2015-12-23 

增加windows下bat脚本

@echo off & setlocal enabledelayedexpansionecho beginf:set DEPLOY_DIR=f:\rootset LIB_JARS=""set MAIN_CLASS=com.cherong.service.pay.init.Initcd %DEPLOY_DIR%\libfor %%i in (*) do set LIB_JARS=!LIB_JARS!;..\lib\%%icd ..\binif ""%1"" == ""debug"" goto debugif ""%1"" == ""jmx"" goto jmxecho begin java java -Xms64m -Xmx1024m -XX:MaxPermSize=64M -classpath ..\conf;%LIB_JARS% %MAIN_CLASS%java -Xms64m -Xmx1024m -XX:MaxPermSize=64M -classpath ..\conf;%LIB_JARS% %MAIN_CLASS%goto end:debugjava -Xms64m -Xmx1024m -XX:MaxPermSize=64M -Xdebug -Xnoagent -Djava.compiler=NONE -Xrunjdwp:transport=dt_socket,address=8000,server=y,suspend=n -classpath ..\conf;%LIB_JARS% %MAIN_CLASS%goto end:jmxjava -Xms64m -Xmx1024m -XX:MaxPermSize=64M -Dcom.sun.management.jmxremote.port=1099 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -classpath ..\conf;%LIB_JARS% %MAIN_CLASS%:endpause

请注意windows下cmd的路径切换，比如脚本中的f: ，否则无法正常执行。

windows下停止暂时采用JAVA实现，暂未解决脚本占用问题

package com.chinesedreamer.dubbocenter.executor.service;import java.io.IOException;import java.util.ArrayList;import java.util.List;import java.util.Scanner;import org.apache.commons.lang.StringUtils;import org.slf4j.Logger;import org.slf4j.LoggerFactory;import com.chinesedreamer.dubbocenter.pid.Pid;public class WindowsStopProcess {private static Logger logger = LoggerFactory.getLogger(WindowsStopProcess.class);private static String TASK_LIST = "taskList";private static String TASK_KILL = "TSKILL ";private static String PID_PATH = "wmic process where processid=<pid> get commandline"; //获取pid路径public static void stopProcess(String path) {Process process = null;List<String> pids = new ArrayList<String>();try {process = Runtime.getRuntime().exec(TASK_LIST);Scanner in = new Scanner(process.getInputStream(),"GBK");while (in.hasNextLine()) {String line = in.nextLine();if (line.startsWith("java")) {pids.add(line);}}in.close();List<Pid> getPidObjs = getPidObjs(pids);for (Pid pid : getPidObjs) {process = Runtime.getRuntime().exec(PID_PATH.replace("<pid>", pid.getPid()));in = new Scanner(process.getInputStream(),"GBK");while (in.hasNextLine()) {String commandPath = in.nextLine();logger.info("process path: {}" , commandPath);if (commandPath.trim().endsWith(path)) {logger.info("kill pid#{}",pid.getPid());Runtime.getRuntime().exec(TASK_KILL + pid.getPid());break;}}}} catch (IOException e) {logger.error("{}",e);}}private static List<Pid> getPidObjs(List<String> pids) {List<Pid> pidOjbs = new ArrayList<Pid>();List<String> pidObj = new ArrayList<String>();for (String pid : pids) {String[] pidProperties = pid.split(" ");pidObj.clear();for (String pidProperty : pidProperties) {if (StringUtils.isNotEmpty(pidProperty)) {pidObj.add(pidProperty);}}pidOjbs.add(generatePid(pidObj));}return pidOjbs;}private static Pid generatePid(List<String> pidObj) {Pid pid = new Pid();pid.setServiceName(pidObj.get(0));pid.setPid(pidObj.get(1));pid.setSessionName(pidObj.get(2));pid.setSessionNumber(pidObj.get(3));pid.setMemory(pidObj.get(4));return pid;}}