Flink安装

来源：互联网发布：js 点击链接编辑：程序博客网时间：2024/05/17 04:33

前提：安装：已安好hadoop，环境已经配好 java 7.X 及其以上 scala有对应版本
单机：下载、解压、需要注意：flink与hadoop版本要对应
解压即安装
Check the JobManager’s web frontend at http://localhost:8081 and make sure everything is up and running.
Instead of starting Flink with bin/start-local.sh you can also start Flink in an streaming optimized mode, using bin/start-local-streaming.sh.

ConsumerManager、JobManager

集群：passwordless SSH免登陆
1. Copy the unpacked flink directory from the downloaded archive to the same file system path on each node of your setup.
2. Choose a master node (JobManager) and set the jobmanager.rpc.address key in conf/flink-conf.yaml to its IP or hostname. Make sure that all nodes in your cluster have the same jobmanager.rpc.address configured.
3. Add the IPs or hostnames (one per line) of all worker nodes (TaskManager) to the slaves files in conf/slaves.
4. You can now start the cluster at your master node with bin/start-cluster.sh. If you are planning to run only streaming jobs with Flink, you can also an optimized streaming mode: start-cluster-streaming.sh.

the amount of available memory per TaskManager (taskmanager.heap.mb),
the number of available CPUs per machine (taskmanager.numberOfTaskSlots),
the total number of CPUs in the cluster (parallelism.default) and
the temporary directories (taskmanager.tmp.dirs)

ConsumerManager、TaskManager（slaves）

on yarn

总体来说flink的安装相对于其他的hadoop组件简单很多，这也是软件的一个趋势：傻瓜式。
详情请参照官方文档https://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html

0 0