parrallel python study notes
来源:互联网 发布:linux子目录权限 编辑:程序博客网 时间:2024/05/17 01:09
工作中需要用到python 数据预处理,然后 跑spark hadoop 太过繁琐,为提高计算速度,再加所用服务器核比较多,然后考虑用parrelell python.
1、pp用的包 :包名叫pp, pip install pp
import math,sys,timeimport pp
2、主要函数
job_server = pp.Server(cpu_number,ppservers = ppserver)job1 = job_server.submit(***)job2 = job_server.submit(***)jobn = job_server.submit(***)
0 0
- parrallel python study notes
- python study notes
- study notes
- MySql study notes [1]
- Portlet Study Notes (1)
- IBM Director study notes
- lucene study notes
- lucene study notes (2)
- Legacy Study notes(Servlet)
- C++ Study Notes
- System Architect Study notes
- flex study notes (2)
- scm515 study notes
- Java API Study Notes
- Webkit Timer study notes
- Webkit JNI study notes
- Hash study notes
- Web Service Study notes
- MongoDB学习心得
- 算法提高 周期字串
- Swt Jface TreeViewer Selection
- 主题建模入门指南(python)
- 60. Permutation Sequence -Medium
- parrallel python study notes
- Angular.js之指令学习笔记
- 【Kinect】5th-Kinect深度图像采集和Opencv差帧法运动目标检测
- ubuntu环境下访问windows共享目录
- 实现App跳转到应用商店
- 一款高质的棋牌游戏具有哪些特点
- ubuntu下mysql的常用命令
- 《懒人Shell脚本》之七——格式化处理数据存入数据库实现
- 抽奖demo