作者：李毓

redis是属于数据库，在ceph为后端存储的情况下，适合rbd模式。所以我们先搭建RBD模式的存储。

紧接上一节CEPH所讲，创建自动供给PV.

[root@adm-master src]# cd external-storage-master/ceph/rbd/deploy/
[root@adm-master deploy]# ls
non-rbac  rbac  README.md
[root@adm-master deploy]# pwd
/usr/local/src/external-storage-master/ceph/rbd/deploy
kubectl apply -f ./rbac

[root@adm-master rbac]# kubectl get pods
NAME                                     READY   STATUS    RESTARTS   AGE
rbd-provisioner-c968dcb4b-fws8q          1/1     Running   0          42m

创建secret

[root@adm-master test-rbd]# cat ceph-secret-rbd.yaml 
apiVersion: v1
kind: Secret
metadata:
  name: ceph-secret-rbd
  namespace: test-redis
type: "ceph.com/rbd"
data:
  key: QVFCem9UOWdiQWNwRXhBQXFET0VKTnFMWGJRZm1TTmhObkRRdUE9PQo=

在ceph节点创建pool池

ceph osd pool create k8stest 256

rbd create rbda -s 1024 -p k8stest

rbd feature disable  k8stest/rbda object-map fast-diff deep-flatten

创建storageclass

[root@adm-master test-rbd]# cat rbd-sc.yaml 
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  name: k8s-rbd
provisioner: ceph.com/rbd
parameters:
  monitors: 192.168.0.131:6789,192.168.0.132:6789,192.168.0.133:6789
  adminId: admin
  adminSecretName: ceph-secret-rbd
  pool: k8stest
  userId: admin
  userSecretName: ceph-secret-rbd
  fsType: xfs
  imageFormat: "2"
  imageFeatures: "layering"

接着安装redis集群

第一步，按套路来先添加库。
helm repo add stable http://mirror.azure.cn/kubernetes/charts/

添加成功

[root@adm-master jenkins]# helm repo list
NAME    URL                                      
apphub  https://apphub.aliyuncs.com              
stable  http://mirror.azure.cn/kubernetes/charts/

查询一下我们需要的redis

[root@adm-master jenkins]# helm search repo redis
NAME                                CHART VERSION   APP VERSION     DESCRIPTION                                       
apphub/prometheus-redis-exporter    3.2.2           1.3.4           Prometheus exporter for Redis metrics             
apphub/redis                        10.5.3          5.0.7           Open source, advanced key-value store. It is of...
apphub/redis-cache                  0.5.0           4.0.12-alpine   A pure in-memory redis cache, using statefulset...
apphub/redis-ha                     4.3.3           5.0.6           Highly available Kubernetes implementation of R...
apphub/redis-operator               1.0.0                           Redis Operator provides high availability redis...
apphub/redispapa                    0.0.1           0.0.1           利用redis的info信息对redis的使用情况进行监控的一...
stable/prometheus-redis-exporter    3.5.1           1.3.4           DEPRECATED Prometheus exporter for Redis metrics  
stable/redis                        10.5.7          5.0.7           DEPRECATED Open source, advanced key-value stor...
stable/redis-ha                     4.4.6           5.0.6           DEPRECATED - Highly available Kubernetes implem...
stable/sensu                        0.2.5           0.28            DEPRECATED Sensu monitoring framework backed by...
apphub/codis                        3.2             3.2             A Helm chart for Codis    

查看历史版本命令

helm search repo redis -

拉取最新的redis部署文件

helm pull stable/redis-ha

[root@adm-master src]# cd redis-ha/
[root@adm-master redis-ha]# ls
Chart.yaml  ci  README.md  templates  values.yaml

部署文件的变量值一般保存在values.yaml里面

修改一下子values.yaml里面的副本数

改为一主一从即可

存储方式改为rbd，具体搭建cephfs的方式参考我之前的文档。

部署redis集群

[root@adm-master redis-ha]# kubectl create ns test-redis
namespace/test-redis created
[root@adm-master redis-ha]# helm install redis . -f ./values.yaml -n test-redis
WARNING: This chart is deprecated
NAME: redis
LAST DEPLOYED: Sun Mar 14 22:55:28 2021
NAMESPACE: test-redis
STATUS: deployed
REVISION: 1
NOTES:
Redis can be accessed via port 6379 and Sentinel can be accessed via port 26379 on the following DNS name from within your cluster:
redis-redis-ha.test-redis.svc.cluster.local

To connect to your Redis server:
1. Run a Redis pod that you can use as a client:

   kubectl exec -it redis-redis-ha-server-0 sh -n test-redis

2. Connect using the Redis CLI:

  redis-cli -h redis-redis-ha.test-redis.svc.cluster.local

暴露出外网

[root@adm-master redis-ha]# cat redis-services.yaml 
apiVersion: v1
kind: Service
metadata:
  name: redis-ha-service
  namespace: test-redis        #名称：随意
  labels:
    app: redis                  #部署的 redis-ha 名称
spec:
  ports:
  - name: redis                 #部署的 redis-ha 名称
    protocol: "TCP"                     #TCP 协议
    port: 26379                         
    targetPort: 6379            
    nodePort: 30379                     #此为外部连接k8s redis-ha 服务的端口
  selector:
    statefulset.kubernetes.io/pod-name: redis-redis-ha-server-0
  type: NodePort

其他可用的命令有

redis 的 upgrade

修改了 values.yaml中的 replicas 数量之后需要更新一下

helm upgrade redis .

查看历史记录回滚

helm -n redis history

删除项目

helm uninstall redis

标签：adm,rbd,redis,REDIS,CEPH,集群,master,ha,root
来源： https://blog.51cto.com/14783669/2662535