RPC学习----Thrift快速入门和Java简单示例

一.什么是RPC?

RPC（Remote Procedure Call Protocol）——远程过程调用协议，它是一种通过网络从远程计算机程序上请求服务，而不需要了解底层网络技术的协议。

RPC协议假定某些传输协议的存在，如TCP或UDP，为通信程序之间携带信息数据。在OSI网络通信模型中，RPC跨越了传输层和应用层。RPC使得开发包括网络分布式多程序在内的应用程序更加容易。

二.什么是Thrift?

thrift是一个软件框架，用来进行可扩展且跨语言的服务的开发。它结合了功能强大的软件堆栈和代码生成引擎，以构建在 C++, Java, Python, PHP, Ruby, Erlang, Perl, Haskell, C#, Cocoa, JavaScript, Node.js, Smalltalk, and OCaml 这些编程语言间无缝结合的、高效的服务。

thrift最初由facebook开发，07年四月开放源码，08年5月进入apache孵化器。

三.下载,安装,配置Thrift

本机环境:ubuntu 12.04 (64bit)

1.下载:

下载地址:http://www.apache.org/dyn/closer.cgi?path=/thrift/0.9.1/thrift-0.9.1.tar.gz　(目前最新0.9.1,2014/08/11)

2.安装,配置Thrift

官网教程:http://thrift.apache.org/docs/BuildingFromSource

Building from source

First make sure your system meets all necessary Apache Thrift Requirements

If you are building from the first time out of the source repository, you will need to generate the configure scripts. (This is not necessary if you downloaded areleased tarball.) From the top directory, do:

./bootstrap.sh

Once the configure scripts are generated, thrift can be configured. From the top directory, do:

./configure

Disable a language:

./configure --without-java

You may need to specify the location of the boost files explicitly. If you installed boost in /usr/local, you would run configure as follows:

./configure --with-boost=/usr/local

If you want to override the logic of the detection of the Java SDK, use the JAVAC environment variable:

./configure JAVAC=/usb/bin/javac

Note that by default the thrift C++ library is typically built with debugging symbols included. If you want to customize these options you should use the CXXFLAGS option in configure, as such:

./configure CXXFLAGS='-g -O2' ./configure CFLAGS='-g -O2' ./configure CPPFLAGS='-DDEBUG_MY_FEATURE'

To see other configuration options run

./configure --help

Once you have run configure you can build Thrift via make:

make

and run the test suite:

make check

and the cross language test suite:

sh test/test.sh

Issues while compiling

• "compiler/cpp/thriftl.cc:2190: undefined reference to `yywrap'"

  you need to install the Flex library (See also Apache Thrift Requirements ) and re-run the configuration script.

• mv: cannot stat "'.deps/TBinaryProtocol.Tpo': No such file or directory" while building the Thrift Runtime Library

  Re-reun configure with

  --enable-libtool-lock

  or by turning off parallel make by placing .NOTPARALLEL: in lib/cpp/Makefile or

  make -j 1

  Although the thrift compiler build appears to be compatible with parallel make without libtool lock, the thrift runtime build is not.

Installing

From the top directory, become superuser and do:

make install

Note that some language packages must be installed manually using build tools better suited to those languages (this applies to Java, Ruby, PHP).

Look for the README file in the lib/<language>/ folder for more details on the installation of each language library package.

 

总结下来,第1步,先解压thrift-0.9.1.tar.gz,解压命令:

tar -xvf thrift-0.9.1.tar.gz

第2步,输入以下命令:

$cd thrift-0.9.1 $./configure  $make #sudo make install 

关于配置的问题可以查看命令:

./configure --help

可以关闭你不熟悉的语言,因为thrift支持的语言非常多,可以关闭一些用不到的,如python,gt4等;

关闭命令为:

./configure --without-qt4

在install的过程中如果报一些test方面的error可以忽略.

上面的步骤走完以后,可以在任意一个目录下输入如下命令进行测试:

amosli@amosli-pc:~/workspace$ thrift -versionThrift version 0.9.1

 

四.Thrift基本概念

1.数据类型

• 基本类型：
  • bool：布尔值，true 或 false，对应 Java 的 boolean
  • byte：8 位有符号整数，对应 Java 的 byte
  • i16：16 位有符号整数，对应 Java 的 short
  • i32：32 位有符号整数，对应 Java 的 int
  • i64：64 位有符号整数，对应 Java 的 long
  • double：64 位浮点数，对应 Java 的 double
  • string：utf-8编码的字符串，对应 Java 的 String
• 结构体类型：
  • struct：定义公共的对象，类似于 C 语言中的结构体定义，在 Java 中是一个 JavaBean
• 容器类型：
  • list：对应 Java 的 ArrayList
  • set：对应 Java 的 HashSet
  • map：对应 Java 的 HashMap
• 异常类型：
  • exception：对应 Java 的 Exception
• 服务类型：
  • service：对应服务的类

2.服务端编码基本步骤：

• 实现服务处理接口impl
• 创建TProcessor
• 创建TServerTransport
• 创建TProtocol
• 创建TServer
• 启动Server

3.客户端编码基本步骤：

• 创建Transport
• 创建TProtocol
• 基于TTransport和TProtocol创建 Client
• 调用Client的相应方法

4.数据传输协议

• TBinaryProtocol : 二进制格式.
• TCompactProtocol : 压缩格式
• TJSONProtocol : JSON格式
• TSimpleJSONProtocol : 提供JSON只写协议, 生成的文件很容易通过脚本语言解析

tips:客户端和服务端的协议要一致

 

 

五.Java实例

1.引入jar包

我这里用到的是maven进行管理jar包的,所以首先新建一个maven项目,然后在 pom.xml中添加如下内容:

 

1

2

3

4

5

6

7

8

9

10

<dependency>

            <groupId>org.apache.thrift</groupId>

            <artifactId>libthrift</artifactId>

            <version>0.9.1</version>

  </dependency>

  <dependency>

            <groupId>org.slf4j</groupId>

            <artifactId>slf4j-log4j12</artifactId>

            <version>1.5.8</version>

 </dependency>

2.创建Thrift文件

创建Thrift文件：amosli@amosli-pc:/media/f91a4cca-0b96-4c30-b140-7918a196de3e/amosli/java/rpc/DemoTest/demoHello.thrift ,内容如下：

namespace java com.amos.thrift.demoservice  HelloWorldService {  string sayHello(1:string username)}

3.生成java文件:

thrift -r -gen java demoHello.thrift

文件目录如下:

1

2

3

4

5

6

7

8

9

$ tree

.

├── demoHello.thrift

└── gen-java

    └── com

        └── amos

            └── thrift

                └── demo

                    └── HelloWorldService.java

把生成的HelloWorldService.java文件拷贝到项目中去.

4.实现接口Iface

 

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

packagecom.amos;

 

/**

 * Created by amosli on 14-8-12.

 */

publicclass HelloWorldImpl implementsHelloWorldService.Iface {

 

    publicHelloWorldImpl() {

    }

 

    @Override

    publicString sayHello(String username) {

        return"Hi," + username + " ,Welcome to the thrift's world !";

    }

 

}

5.TSimpleServer服务端

简单的单线程服务模型，一般用于测试。

编写服务端server代码：HelloServerDemo.java

 

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

packagecom.amos;

 

importorg.apache.thrift.protocol.TBinaryProtocol;

importorg.apache.thrift.protocol.TCompactProtocol;

importorg.apache.thrift.server.TServer;

importorg.apache.thrift.server.TSimpleServer;

importorg.apache.thrift.transport.TServerSocket;

 

 

/**

 * Created by amosli on 14-8-12.

 */

publicclass HelloServerDemo {

    publicstatic final int SERVER_PORT = 8090;

 

    /**

     * @param args

     */

    publicstatic void main(String[] args) {

        HelloServerDemo server = newHelloServerDemo();

        server.startServer();

    }

 

    publicvoid startServer() {

        try{

            System.out.println("HelloWorld TSimpleServer start ....");

 

//          TProcessor tprocessor = new HelloWorldService.Processor<HelloWorldService.Iface>(new  HelloWorldImpl());

            HelloWorldService.Processor<HelloWorldService.Iface> tprocessor = newHelloWorldService.Processor<HelloWorldService.Iface>(newHelloWorldImpl());

 

            // 简单的单线程服务模型，一般用于测试

            TServerSocket serverTransport = newTServerSocket(SERVER_PORT);

            TServer.Args tArgs = newTServer.Args(serverTransport);

            tArgs.processor(tprocessor);

//            tArgs.protocolFactory(new TBinaryProtocol.Factory());

            tArgs.protocolFactory(newTCompactProtocol.Factory());

            // tArgs.protocolFactory(new TJSONProtocol.Factory());

            TServer server = newTSimpleServer(tArgs);

            server.serve();

 

        }catch(Exception e) {

            System.out.println("Server start error!!!");

            e.printStackTrace();

        }

    }

 

}

6.编写客户端代码

 

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

49

50

51

52

53

54

55

56

57

packagecom.amos;

 

 

importorg.apache.thrift.TException;

importorg.apache.thrift.protocol.TBinaryProtocol;

importorg.apache.thrift.protocol.TCompactProtocol;

importorg.apache.thrift.protocol.TProtocol;

importorg.apache.thrift.transport.TSocket;

importorg.apache.thrift.transport.TTransport;

importorg.apache.thrift.transport.TTransportException;

 

/**

 * Created by amosli on 14-8-12.

 */

publicclass HelloClientDemo {

 

    publicstatic final String SERVER_IP = "localhost";

    publicstatic final int SERVER_PORT = 8090;

    publicstatic final int TIMEOUT = 30000;

 

    /**

     * @param args

     */

    publicstatic void main(String[] args) {

        HelloClientDemo client = newHelloClientDemo();

        client.startClient("amosli");

 

    }

 

    /**

     * @param userName

     */

    publicvoid startClient(String userName) {

        TTransport transport = null;

        try{

            transport = newTSocket(SERVER_IP, SERVER_PORT, TIMEOUT);

            // 协议要和服务端一致

//            TProtocol protocol = new TBinaryProtocol(transport);

            TProtocol protocol = newTCompactProtocol(transport);

            // TProtocol protocol = new TJSONProtocol(transport);

            HelloWorldService.Client client = newHelloWorldService.Client(

                    protocol);

            transport.open();

            String result = client.sayHello(userName);

            System.out.println("Thrift client result =: " + result);

        }catch(TTransportException e) {

            e.printStackTrace();

        }catch(TException e) {

            e.printStackTrace();

        }finally{

            if(null!= transport) {

                transport.close();

            }

        }

    }

 

}

项目最终结构图:

7.最终运行效果

服务端:

客户端:

本文源码:https://github.com/amosli/rpc

参考:

1.http://baike.baidu.com/view/1698865.htm?fr=aladdin

2.http://thrift.apache.org/docs/BuildingFromSource

3.http://www.micmiu.com/soa/rpc/thrift-sample/

4.http://blog.chinaunix.net/uid-20357359-id-2876170.html

5.http://baike.baidu.com/view/7287257.htm?fromtitle=RPC&fr=aladdin