ubuntu16.04 编译安装kubernetes1.6.1

本文是基于 http://www.cnblogs.com/LinuxGo/p/5729788.html,blog.csdn.net/flymu0808/article/details/55505216工作的基础上，针对新的版本存在的一些问题做了修改

环境信息

版本信息

组件版本etcd3.1.0Flannel0.6.1Kubernetes1.6.1

 

 

 

 

主机信息

主机IPOSk8s-master10.235.118.215
Ubuntu 16.04k8s-node0110.235.118.215Ubuntu 16.04

安装Docker

每台主机上安装最新版Docker Engine - https://docs.docker.com/engine/installation/Linux/ubuntu/

部署etcd集群

我们将在1台主机上安装部署etcd集群

下载etcd

在部署机上下载etcd

ETCD_VERSION=${ETCD_VERSION:-"3.1.0"}  ETCD="etcd-v${ETCD_VERSION}-linux-amd64"  curl -L https://github.com/coreos/etcd/releases/download/v${ETCD_VERSION}/${ETCD}.tar.gz -o etcd.tar.gz    tar xzf etcd.tar.gz -C /tmp  cd /tmp/etcd-v${ETCD_VERSION}-linux-amd64  sudo mkdir -p /opt/bin && sudo mv * /opt/bin 

配置项说明

--name

etcd集群中的节点名，这里可以随意，可区分且不重复就行 

--listen-peer-urls

监听的用于节点之间通信的url，可监听多个，集群内部将通过这些url进行数据交互(如选举，数据同步等)

--initial-advertise-peer-urls

建议用于节点之间通信的url，节点间将以该值进行通信。

--listen-client-urls

监听的用于客户端通信的url,同样可以监听多个。
--advertise-client-urls

建议使用的客户端通信url,该值用于etcd代理或etcd成员与etcd节点通信。
--initial-cluster-token etcd-cluster-1

节点的token值，设置该值后集群将生成唯一id,并为每个节点也生成唯一id,当使用相同配置文件再启动一个集群时，只要该token值不一样，etcd集群就不会相互影响。
--initial-cluster

也就是集群中所有的initial-advertise-peer-urls 的合集
--initial-cluster-state new

新建集群的标志

配置etcd服务

在每台主机上，分别创建/opt/config/etcd.conf和/lib/systemd/sy，（注意修改红色粗体处的IP地址）

/opt/config/etcd.conf 

sudo mkdir -p /var/lib/etcd/sudo mkdir -p /opt/config/sudo  cat <

/lib/systemd/system/etcd.service

[Unit]Description=Etcd ServerDocumentation=https://github.com/coreos/etcdAfter=network.target[Service]User=rootType=simpleEnvironmentFile=-/opt/config/etcd.confExecStart=/opt/bin/etcdRestart=on-failureRestartSec=10sLimitNOFILE=40000[Install]WantedBy=multi-user.target

然后在每台主机上运行

sudo systemctl daemon-reload sudo systemctl enable etcdsudo systemctl start etcd

下载Flannel

FLANNEL_VERSION=${FLANNEL_VERSION:-"0.6.1"}curl -L  https://github.com/coreos/flannel/releases/download/v${FLANNEL_VERSION}/flannel-${FLANNEL_VERSION}-linux-amd64.tar.gz flannel.tar.gztar xzf  flannel.tar.gz -C /tmp下载不了压缩文件就到 https://github.com/coreos/flannel/releases 找一个版本然后下载下来，记住下载的版本号，然后一样解压，在解压前执行FLANNEL_VERSION=${FLANNEL_VERSION:-"你的版本"}

编译K8s

到 https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG.md#downloads-for-v161 下载1.6.1版本的二进制解压包

tar xzf kubernetes-server-linux-amd64.tar.gz -C /tmp

部署K8s Master

cd /tmpcp kubernetes/server/bin/kube-apiserver \     kubernetes/server/bin/kube-controller-manager \     kubernetes/server/bin/kube-scheduler kubernetes/server/bin/kubelet kubernetes/server/bin/kube-proxy ~/kubecp flanneld ~/kubesudo mv ~/kube/* /opt/bin/

创建证书

在master主机上 ，运行如下命令创建证书

mkdir -p /srv/kubernetes/cd /srv/kubernetesexport MASTER_IP=10.235.118.200echo subjectAltName = IP:${MASTER_IP} > extfile.cnfopenssl genrsa -out ca.key 2048openssl req -x509 -new -nodes -key ca.key -subj "/CN=${MASTER_IP}" -days 10000 -out ca.crtopenssl genrsa -out server.key 2048openssl req -new -key server.key -subj "/CN=${MASTER_IP}" -out server.csropenssl x509 -req -in server.csr -CA ca.crt -CAkey ca.key -CAcreateserial -out server.crt -days 10000 -extfile extfile.cnf

配置kube-apiserver服务

我们使用如下的Service以及Flannel的网段：

SERVICE_CLUSTER_IP_RANGE=172.18.0.0/16

FLANNEL_NET=192.168.0.0/16

在master主机上，创建/lib/systemd/system/kube-apiserver.service文件，内容如下

[Unit]Description=Kubernetes API ServerDocumentation=https://github.com/kubernetes/kubernetesAfter=network.target[Service]User=rootExecStart=/opt/bin/kube-apiserver \ --insecure-bind-address=0.0.0.0 \ --insecure-port=8080 \ --etcd-servers=http://10.235.118.200:2379\ --logtostderr=true \ --allow-privileged=false \ --service-cluster-ip-range=172.18.0.0/16 \ --admission-control=NamespaceLifecycle,LimitRanger,ServiceAccount,SecurityContextDeny,ResourceQuota \ --service-node-port-range=30000-32767 \ --advertise-address=10.235.118.200 \ --client-ca-file=/srv/kubernetes/ca.crt \ --tls-cert-file=/srv/kubernetes/server.crt \ --tls-private-key-file=/srv/kubernetes/server.keyRestart=on-failureType=notifyLimitNOFILE=65536[Install]WantedBy=multi-user.target

配置kube-controller-manager服务

在master主机上，创建/lib/systemd/system/kube-controller-manager.service文件，内容如下

[Unit]Description=Kubernetes Controller ManagerDocumentation=https://github.com/kubernetes/kubernetes[Service]User=rootExecStart=/opt/bin/kube-controller-manager \  --master=127.0.0.1:8080 \  --root-ca-file=/srv/kubernetes/ca.crt \  --service-account-private-key-file=/srv/kubernetes/server.key \  --logtostderr=trueRestart=on-failureLimitNOFILE=65536[Install]WantedBy=multi-user.target

配置kuber-scheduler服务

在master主机上，创建/lib/systemd/system/kube-scheduler.service文件，内容如下

[Unit]Description=Kubernetes SchedulerDocumentation=https://github.com/kubernetes/kubernetes[Service]User=rootExecStart=/opt/bin/kube-scheduler \  --logtostderr=true \  --master=127.0.0.1:8080Restart=on-failureLimitNOFILE=65536[Install]WantedBy=multi-user.target

配置flanneld服务

在master主机上，创建/lib/systemd/system/flanneld.service文件，内容如下

[Unit]Description=FlanneldDocumentation=https://github.com/coreos/flannelAfter=network.targetBefore=docker.service[Service]User=rootExecStart=/opt/bin/flanneld \  --etcd-endpoints="http://10.235.118.200:2379" \  --iface=10.235.118.200 \  --ip-masqRestart=on-failureType=notifyLimitNOFILE=65536

启动服务

/opt/bin/etcdctl --endpoints="http://10.235.118.200:2379" mk /coreos.com/network/config \   '{"Network":"192.168.0.0/16", "Backend": {"Type": "vxlan"}}'sudo systemctl daemon-reloadsudo systemctl enable kube-apiserversudo systemctl enable kube-controller-managersudo systemctl enable kube-schedulersudo systemctl enable flanneldsudo systemctl start kube-apiserversudo systemctl start kube-controller-managersudo systemctl start kube-schedulersudo systemctl start flanneld

修改Docker服务

source /run/flannel/subnet.envsudo sed -i "s|^ExecStart=/usr/bin/dockerd -H fd://$|ExecStart=/usr/bin/dockerd -H tcp://127.0.0.1:4243 -H unix:///var/run/docker.sock --bip=${FLANNEL_SUBNET} --mtu=${FLANNEL_MTU}|g" /lib/systemd/system/docker.servicerc=0ip link show docker0 >/dev/null 2>&1 || rc="$?"if [[ "$rc" -eq "0" ]]; thenip link set dev docker0 downip link delete docker0fisudo systemctl daemon-reloadsudo systemctl enable dockersudo systemctl restart docker

部署K8s Node

复制程序文件

cd /tmpcp kubernetes/server/bin/kubelet kubernetes/server/bin/kube-proxy ~/kubecp flannel-${FLANNEL_VERSION}/flanneld ~/kubesudo mkdir -p /opt/bin && sudo mv ~/kube/* /opt/bin/

配置Flanned以及修改Docker服务

参见Master部分相关步骤： 配置Flanneld服务，启动Flanneld服务，修改Docker服务。注意修改iface的地址

配置kubelet服务

/lib/systemd/system/kubelet.service，注意修改IP地址

[Unit]Description=Kubernetes KubeletAfter=docker.serviceRequires=docker.service[Service]ExecStart=/opt/bin/kubelet \  --hostname-override=10.235.118.200 \  --api-servers=http://10.235.118.200:8080 \  --logtostderr=trueRestart=on-failureKillMode=process[Install]WantedBy=multi-user.target

启动服务

sudo systemctl daemon-reloadsudo systemctl enable kubeletsudo systemctl start kubelet

配置kube-proxy服务

/lib/systemd/system/kube-proxy.service，注意修改IP地址

sudo systemctl daemon-reloadsudo systemctl enable kube-proxysudo systemctl start kube-proxy

配置kubectl

cd /tmp

mv kubernetes/server/bin/kubectl /usr/bin/kubectl

mkdir -p ~/.kube

vi ~/.kube/config

apiVersion: v1  clusters:  - cluster:      certificate-authority: crts/ca.crt      server: https://10.235.118.200:6443  name: minikube  - cluster:      insecure-skip-tls-verify: true      server: http://10.235.118.200:6443  name: ubuntu  contexts:  - context:      cluster: minikube      user: minikube    name: minikube  current-context: minikube  kind: Config  preferences: {}  users:  - name: minikube    user:      client-certificate: crts/server.crt      client-key: crts/server.key

done