Kubernetes使用cephfs作为后端存储

这里使用了k8s自身的持久化卷存储机制：PV和PVC。各组件之间的关系参考下图：

PV的Access Mode（访问模式）

The access modes are:

ReadWriteOnce – the volume can be mounted as read-write by a single node

ReadOnlyMany – the volume can be mounted read-only by many nodes

ReadWriteMany – the volume can be mounted as read-write by many nodes

In the CLI, the access modes are abbreviated to:

RWO - ReadWriteOnce

ROX - ReadOnlyMany

RWX - ReadWriteMany

Reclaim Policy（回收策略）

Current reclaim policies are:

Retain – manual reclamation

Recycle – basic scrub (“rm -rf /thevolume/*”)

Delete – associated storage asset such as AWS EBS, GCE PD, Azure Disk, or OpenStack Cinder volume is deleted

Currently, only NFS and HostPath support recycling. AWS EBS, GCE PD, Azure Disk, and Cinder volumes support deletion.

PV是有状态的资源对象，有以下几种状态：

1、Available：空闲状态

2、Bound：已经绑定到某个pvc上

3、Released：对应的pvc已经删除，但资源还没有被回收

4、Failed：pv自动回收失败

1、创建secret。在secret中，data域的各子域的值必须为base64编码值。

#echo "AQDchXhYTtjwHBAAk2/H1Ypa23WxKv4jA1NFWw==" | base64

QVFEY2hYaFlUdGp3SEJBQWsyL0gxWXBhMjNXeEt2NGpBMU5GV3c9PQo=

#vim ceph-secret.yaml

apiVersion: v1

kind: Secret

metadata:

  name: ceph-secret

data:

  key: QVFEY2hYaFlUdGp3SEJBQWsyL0gxWXBhMjNXeEt2NGpBMU5GV3c9PQo=

2、创建pv。pv只能是网络存储，不属于任何node，但可以在每个node*问。pv并不是定义在pod上的，而是独立定义于pod之外。目前pv仅支持定义存储容量。

#vim ceph-pv.yml

apiVersion: v1

kind: PersistentVolume

metadata:

  name: cephfs

spec:

  capacity:

    storage: 10Gi

  accessModes:

    - ReadWriteMany

  fsType: xfs

  cephfs:

    monitors:

    - 172.16.100.5 :6789

    - 172.16.100.6 :6789

    - 172.16.100.7 :6789

    path: /opt/eshop_dir/eshop

    user: admin

    secretRef:

      name: ceph-secret

3、创建pvc

#vim ceph-pvc.yml

kind: PersistentVolumeClaim

apiVersion: v1

metadata:

  name: cephfs

spec:

  accessModes:

      - ReadWriteMany

  resources:

      requests:

        storage: 8Gi

4、查看pv和pvc

#kubectl get pv

cephfs      10Gi       RWX           Retain          Bound     default/cephfs           2d

#kubectl get pvc

cephfs      Bound     cephfs         10Gi       RWX           2d

5、创建rc，这个只是测试样例

#vim ceph-rc.yml

kind: ReplicationController

metadata:

  name: cephfstest

  labels:

    name: cephfstest

spec:

  replicas: 4

  selector:

    name: cephfstest

  template:

    metadata:

      labels:

        name: cephfstest

    spec:

      containers:

      - name: cephfstest

        image: 172.60.0.107/pingpw/nginx-php:v4

        env:

        - name: GET_HOSTS_FROM

          value: env

        ports:

        - containerPort: 81

        volumeMounts:

        - name: cephfs

          mountPath: "/opt/cephfstest"

      volumes:

      - name: cephfs

        persistentVolumeClaim:

           claimName: cephfs

5、查看pod

#kubectl get pod -o wide

cephfstest-09j37                            1/1       Running   0          2d        10.244.5.16   kuber-node03

cephfstest-216r6                            1/1       Running   0          2d        10.244.3.25   kuber-node01

cephfstest-4sjgr                            1/1       Running   0          2d        10.244.4.26   kuber-node02

cephfstest-p2x7c                            1/1       Running   0          2d        10.244.6.22   kuber-node04

秒客网

Kubernetes使用cephfs作为后端存储

相关文章