Laravel中用GuzzleHttp

来源:互联网 发布:python爬虫克隆网页 编辑:程序博客网 时间:2024/06/05 22:52

今天项目中用到GuzzleHttp,开始不知道怎么用,其实还是很简单的。
直接在项目根目录,输入以下命令

composer require guzzlehttp/guzzle

等下载安装好,在vendor文件夹下,有一个guzzle目录,此文件夹就是guzzlehttp的package了。
如何使用,可以参考官方文档http://docs.guzzlephp.org/en/latest/
下面这段代码就是官网文档中的一段

$client = new GuzzleHttp\Client();$res = $client->request('GET', 'https://api.github.com/user', [    'auth' => ['user', 'pass']]);echo $res->getStatusCode();// "200"echo $res->getHeader('content-type');// 'application/json; charset=utf8'echo $res->getBody();// {"type":"User"...'// Send an asynchronous request.$request = new \GuzzleHttp\Psr7\Request('GET', 'http://httpbin.org');$promise = $client->sendAsync($request)->then(function ($response) {    echo 'I completed! ' . $response->getBody();});$promise->wait();

我在项目中,已经使用了form表单post,异步请求等等。
这篇文章还是挺有意思的《Laravel 下使用 Guzzle 编写多线程爬虫实战》,代码啥都有,虽然是个小玩意,但能学到很多东西。
比如:

  1. 在Laravel中如何创建命令
  2. 怎么用多线程

贴一下代码

<?php namespace App\Console\Commands;use GuzzleHttp\Client;use GuzzleHttp\Pool;use GuzzleHttp\Psr7\Request;use GuzzleHttp\Exception\ClientException;use Illuminate\Console\Command;class MultithreadingRequest extends Command{    private $totalPageCount;    private $counter        = 1;    private $concurrency    = 7;  // 同时并发抓取    private $users = ['CycloneAxe', 'appleboy', 'Aufree', 'lifesign',                        'overtrue', 'zhengjinghua', 'NauxLiu'];    protected $signature = 'test:multithreading-request';    protected $description = 'Command description';    public function __construct()    {        parent::__construct();    }    public function handle()    {        $this->totalPageCount = count($this->users);        $client = new Client();        $requests = function ($total) use ($client) {            foreach ($this->users as $key => $user) {                $uri = 'https://api.github.com/users/' . $user;                yield function() use ($client, $uri) {                    return $client->getAsync($uri);                };            }        };        $pool = new Pool($client, $requests($this->totalPageCount), [            'concurrency' => $this->concurrency,            'fulfilled'   => function ($response, $index){                $res = json_decode($response->getBody()->getContents());                $this->info("请求第 $index 个请求,用户 " . $this->users[$index] . " 的 Github ID 为:" .$res->id);                $this->countedAndCheckEnded();            },            'rejected' => function ($reason, $index){                $this->error("rejected" );                $this->error("rejected reason: " . $reason );                $this->countedAndCheckEnded();            },        ]);        // 开始发送请求        $promise = $pool->promise();        $promise->wait();    }    public function countedAndCheckEnded()    {        if ($this->counter < $this->totalPageCount){            $this->counter++;            return;        }        $this->info("请求结束!");    }}

运行结果如下:

$ php artisan test:multithreading-request请求第 5 个请求,用户 zhengjinghua 的 Github ID 为:3413430请求第 6 个请求,用户 NauxLiuGithub ID 为:9570112请求第 0 个请求,用户 CycloneAxeGithub ID 为:6268176请求第 1 个请求,用户 appleboy 的 Github ID 为:21979请求第 2 个请求,用户 AufreeGithub ID 为:5310542请求第 3 个请求,用户 lifesign 的 Github ID 为:2189610请求第 4 个请求,用户 overtrue 的 Github ID 为:1472352请求结束!
0 0