0
点赞
收藏
分享

微信扫一扫

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务

新鲜小饼干 2022-08-16 阅读 49
springmysqldockerkubernetes云计算


文章目录

  • ​​zk环境拆分为test和prod环境​​
  • ​​namespace 分环境，创建test 和prod​​
  • ​​数据库进行拆分，因实验资源有限，故使用分库的形式模拟分环境​​
  • ​​分别创建修改两个环境的资源配置文件：​​
  • ​​cm.yaml 修改ns，数据库库名，eureka地址​​
  • ​​dp.yaml​​
  • ​​svc.yaml​​
  • ​​ingress.yaml​​
  • ​​接下来部署apollo-adminservice​​
  • ​​cm.yaml​​
  • ​​dp.yaml​​
  • ​​接下来部署prod环境的apollo-configservice，还是一样的套路​​
  • ​​cm.yaml​​
  • ​​dp.yaml​​
  • ​​svc.yaml​​
  • ​​ingress.yaml​​
  • ​​修改apollo-adminservice的资源配置清单​​
  • ​​cm.yaml​​
  • ​​dp.yaml​​
  • ​​打开portal.od.com验证，并且创建两个项目​​
  • ​​接下来交付dubbo服务分环境交付​​
  • ​​dp.yaml​​
  • ​​接下来交付dubbo-demo-consumer​​
  • ​​dp.yaml​​
  • ​​svc.yaml​​
  • ​​ingress.yaml​​
  • ​​接下来交付prod环境的dubbo-demo-server和dubbo-demo-consumer服务​​
  • ​​dp.yaml​​
  • ​​接下来做dubbo-demo-consumer的资源配置清单​​
  • ​​dp.yaml​​
  • ​​svc.yaml​​
  • ​​ingress.yaml​​
  • ​​模拟发版​​

要进行分环境，需要将现有实验环境进行拆分 其中portal服务（门户）可在各个环境共用，但apollo-adminservice和apollo-configservice必须要分开。

zk环境拆分为test和prod环境

添加dns解析：

# vi /var/named/od.com.zone

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_docker

namespace 分环境，创建test 和prod

# kubectl create ns test
# kubectl create ns prod

创建secret：

# kubectl create secret docker-registry harbor --docker-server=harbor.od.com --docker-username=harbor --docker-password=Harbor12345 -n test
 
# kubectl create secret docker-registry harbor --docker-server=harbor.od.com --docker-username=harbor --docker-password=Harbor12345 -n prod

数据库进行拆分，因实验资源有限，故使用分库的形式模拟分环境

修改数据库初始化脚本，分别创建ApolloConfigTestDB和ApolloConfigProdDB

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_docker_02


【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_mysql_03


修改数据库中eureka的地址，这里用到了两个新的域名，自行在bind9中添加解析

> update ApolloConfigProdDB.ServerConfig set ServerConfig.Value="http://config-prod.od.com/eureka" where ServerConfig.Key="eureka.service.url";
 
 
> grant INSERT,DELETE,UPDATE,SELECT on ApolloConfigProdDB.* to "apolloconfig"@"10.4.7.%" identified by "123456";
 
> update ApolloConfigTestDB.ServerConfig set ServerConfig.Value="http://config-test.od.com/eureka" where ServerConfig.Key="eureka.service.url";
 
 
> grant INSERT,DELETE,UPDATE,SELECT on ApolloConfigTestDB.* to "apolloconfig"@"10.4.7.%" identified by "123456";

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_docker_04


修改portal数据，支持fat和pro环境：

set Value='fat,pro' where Id=1;

修改portal的cm资源配置清单：

# vi /data/k8s-yaml/apollo-portal/cm.yaml

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_mysql_05

# kubectl apply -f http://k8s-yaml.od.com/apollo-portal/cm.yaml

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_spring_06

分别创建修改两个环境的资源配置文件：

test：

# cd /data/k8s-yaml

# mkdir -p test/{apollo-adminservice,apollo-configservice,dubbo-demo-server,dubbo-demo-consumer}
  
# mkdir -p prod/{apollo-adminservice,apollo-configservice,dubbo-demo-server,dubbo-demo-consumer}

将之前的资源配置清单cp到对应环境的目录中，进行修改：

# cd  test/apollo-configservice/
# cp ../../apollo-configservice/* ./

cm.yaml 修改ns，数据库库名，eureka地址

apiVersion: v1
kind: ConfigMap
metadata:
  name: apollo-configservice-cm
  namespace: test
data:
  application-github.properties: |
    # DataSource
    spring.datasource.url = jdbc:mysql://mysql.od.com:3306/ApolloConfigTestDB?characterEncoding=utf8
    spring.datasource.username = apolloconfig
    spring.datasource.password = 123456
    eureka.service.url = http://config-test.od.com/eureka
  app.properties: |
    appId=100003171

dp.yaml

kind: Deployment
apiVersion: extensions/v1beta1
metadata:
  name: apollo-configservice
  namespace: test

svc.yaml

kind: Service
apiVersion: v1
metadata: 
  name: apollo-configservice
  namespace: test

ingress.yaml

kind: Ingress
apiVersion: extensions/v1beta1
metadata: 
  name: apollo-configservice
  namespace: test

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_spring_07


服务已经注册进来了

接下来部署apollo-adminservice

修改apollo-adminservice的资源配置清单：

# cd /data/k8s-yaml/test/apollo-adminservice
# cp ../../apollo-adminservice/* ./

cm.yaml

apiVersion: v1
kind: ConfigMap
metadata:
  name: apollo-adminservice-cm
  namespace: test
data:
  application-github.properties: |
    # DataSource
    spring.datasource.url = jdbc:mysql://mysql.od.com:3306/ApolloConfigTestDB?characterEncoding=utf8
    spring.datasource.username = apolloconfig
    spring.datasource.password = 123456
    eureka.service.url = http://config-test.od.com/eureka
  app.properties: |
    appId=100003172

dp.yaml

kind: Deployment
apiVersion: extensions/v1beta1
metadata:
  name: apollo-adminservice
  namespace: test

应用资源配置清单：

# kubectl apply -f http://k8s-yaml.od.com/test/apollo-adminservice/cm.yaml
# kubectl apply -f http://k8s-yaml.od.com/test/apollo-adminservice/dp.yaml

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_spring_08

接下来部署prod环境的apollo-configservice，还是一样的套路

# cd ../../prod/apollo-configservice/
# cp ../../apollo-configservice/* ./

修改资源配置清单：

cm.yaml

apiVersion: v1
kind: ConfigMap
metadata:
  name: apollo-configservice-cm
  namespace: prod
data:
  application-github.properties: |
    # DataSource
    spring.datasource.url = jdbc:mysql://mysql.od.com:3306/ApolloConfigProdDB?characterEncoding=utf8
    spring.datasource.username = apolloconfig
    spring.datasource.password = 123456
    eureka.service.url = http://config-prod.od.com/eureka
  app.properties: |
    appId=100003171

dp.yaml

kind: Deployment
apiVersion: extensions/v1beta1
metadata:
  name: apollo-configservice
  namespace: prod 
  labels: 
    name: apollo-configservice
spec:
  replicas: 1
  selector:
    matchLabels: 
      name: apollo-configservice
  template:
    metadata:
      labels: 
        app: apollo-configservice 
        name: apollo-configservice
    spec:
      volumes:
      - name: configmap-volume
        configMap:
          name: apollo-configservice-cm
      containers:
      - name: apollo-configservice
        image: harbor.od.com/infra/apollo-configservice:v1.5.1
        ports:
        - containerPort: 8080
          protocol: TCP
        volumeMounts:
        - name: configmap-volume
          mountPath: /apollo-configservice/config
        terminationMessagePath: /dev/termination-log
        terminationMessagePolicy: File
        imagePullPolicy: IfNotPresent
      imagePullSecrets:
      - name: harbor
      restartPolicy: Always
      terminationGracePeriodSeconds: 30
      securityContext: 
        runAsUser: 0
      schedulerName: default-scheduler
  strategy:
    type: RollingUpdate
    rollingUpdate: 
      maxUnavailable: 1
      maxSurge: 1
  revisionHistoryLimit: 7
  progressDeadlineSeconds: 600

svc.yaml

kind: Service
apiVersion: v1
metadata:
  name: apollo-configservice
  namespace: prod
spec:
  ports:
  - protocol: TCP
    port: 8080
    targetPort: 8080
  selector:
    app: apollo-configservice

ingress.yaml

kind: Ingress
apiVersion: extensions/v1beta1
metadata:
  name: apollo-configservice
  namespace: prod
spec:
  rules:
  - host: config-prod.od.com
    http:
      paths:
      - path: /
        backend:
          serviceName: apollo-configservice
          servicePort: 8080

应用资源配置清单：

# kubectl apply -f http://k8s-yaml.od.com/prod/apollo-configservice/cm.yaml
# kubectl apply -f http://k8s-yaml.od.com/prod/apollo-configservice/dp.yaml
# kubectl apply -f http://k8s-yaml.od.com/prod/apollo-configservice/svc.yaml
# kubectl apply -f http://k8s-yaml.od.com/prod/apollo-configservice/ingress.yaml

修改apollo-adminservice的资源配置清单

# cd ../apollo-adminservice/
# cp ../../apollo-adminservice/* ./

cm.yaml

apiVersion: v1
kind: ConfigMap
metadata:
  name: apollo-adminservice-cm
  namespace: prod
data:
  application-github.properties: |
    # DataSource
    spring.datasource.url = jdbc:mysql://mysql.od.com:3306/ApolloConfigProdDB?characterEncoding=utf8
    spring.datasource.username = apolloconfig
    spring.datasource.password = 123456
    eureka.service.url = http://config-prod.od.com/eureka
  app.properties: |
    appId=100003172

dp.yaml

kind: Deployment
apiVersion: extensions/v1beta1
metadata:
  name: apollo-adminservice
  namespace: prod 
  labels: 
    name: apollo-adminservice
spec:
  replicas: 1
  selector:
    matchLabels: 
      name: apollo-adminservice
  template:
    metadata:
      labels: 
        name: apollo-adminservice
    spec:
      volumes:
      - name: configmap-volume
        configMap:
          name: apollo-adminservice-cm
      containers:
      - name: apollo-adminservice
        image: harbor.od.com/infra/apollo-adminservice:v1.5.1
        ports:
        - containerPort: 8080
          protocol: TCP
        volumeMounts:
        - name: configmap-volume
          mountPath: /apollo-adminservice/config
        terminationMessagePath: /dev/termination-log
        terminationMessagePolicy: File
        imagePullPolicy: IfNotPresent
      imagePullSecrets:
      - name: harbor
      restartPolicy: Always
      terminationGracePeriodSeconds: 30
      securityContext: 
        runAsUser: 0
      schedulerName: default-scheduler
  strategy:
    type: RollingUpdate
    rollingUpdate: 
      maxUnavailable: 1
      maxSurge: 1
  revisionHistoryLimit: 7
  progressDeadlineSeconds: 600

应用资源配置清单：

# kubectl apply -f http://k8s-yaml.od.com/prod/apollo-adminservice/cm.yaml
# kubectl apply -f http://k8s-yaml.od.com/prod/apollo-adminservice/dp.yaml

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_spring_09


两个服务都已经注册进来了，删除portal数据库中存储的关于之前项目的配置，接下来启动portal项目：

# mysql -uroot -p
> use ApolloPortalDB ;
> truncate table App;
> truncate table AppNamespace;

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_spring_10


【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_docker_11

打开portal.od.com验证，并且创建两个项目

首先创建dubbo-demo-service

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_mysql_12


添加配置：两个环境都添加上：注意连接地址一个是test.od.com,一个是prod.od.com

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_docker_13


接下来创建dubbo-demo-web项目：同样是两个环境都发布，注意一个是test.od.com,一个是prod.od.com

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_mysql_14

接下来交付dubbo服务分环境交付

同样操作，修改之前项目的资源配置清单：

# cd /data/k8s-yaml/test/dubbo-demo-server
# cp ../../dubbo-server/* ./

dp.yaml

kind: Deployment
apiVersion: extensions/v1beta1
metadata:
  name: dubbo-demo-service
  namespace: test 
  labels: 
    name: dubbo-demo-service
spec:
  replicas: 1
  selector:
    matchLabels: 
      name: dubbo-demo-service
  template:
    metadata:
      labels: 
        app: dubbo-demo-service
        name: dubbo-demo-service
    spec:
      containers:
      - name: dubbo-demo-service
        image: harbor.od.com/app/dubbo-demo-service:apollo_191211_1916
        ports:
        - containerPort: 20880
          protocol: TCP
        env:
        - name: C_OPTS
          value: -Denv=fat -Dapollo.meta=http://config-test.od.com
        - name: JAR_BALL
          value: dubbo-server.jar
        imagePullPolicy: IfNotPresent
      imagePullSecrets:
      - name: harbor
      restartPolicy: Always
      terminationGracePeriodSeconds: 30
      securityContext: 
        runAsUser: 0
      schedulerName: default-scheduler
  strategy:
    type: RollingUpdate
    rollingUpdate: 
      maxUnavailable: 1
      maxSurge: 1
  revisionHistoryLimit: 7
  progressDeadlineSeconds: 600

应用资源配置清单：

# kubectl apply -f http://k8s-yaml.od.com/test/dubbo-demo-server/dp.yaml

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_spring_15

接下来交付dubbo-demo-consumer

# cd /data/k8s-yaml/test/dubbo-demo-consumer
# cp ../../dubbo-consumer/* ./

dp.yaml

kind: Deployment
apiVersion: extensions/v1beta1
metadata:
  name: dubbo-demo-consumer
  namespace: test 
  labels: 
    name: dubbo-demo-consumer
spec:
  replicas: 1
  selector:
    matchLabels: 
      name: dubbo-demo-consumer
  template:
    metadata:
      labels: 
        app: dubbo-demo-consumer
        name: dubbo-demo-consumer
    spec:
      containers:
      - name: dubbo-demo-consumer
        image: harbor.od.com/app/dubbo-demo-web:apollo_191212_1715
        ports:
        - containerPort: 8080
          protocol: TCP
        - containerPort: 20880
          protocol: TCP
        env:
        - name: C_OPTS
          value: -Denv=fat -Dapollo.meta=http://config-test.od.com
        - name: JAR_BALL
          value: dubbo-client.jar
        imagePullPolicy: IfNotPresent
      imagePullSecrets:
      - name: harbor
      restartPolicy: Always
      terminationGracePeriodSeconds: 30
      securityContext: 
        runAsUser: 0
      schedulerName: default-scheduler
  strategy:
    type: RollingUpdate
    rollingUpdate: 
      maxUnavailable: 1
      maxSurge: 1
  revisionHistoryLimit: 7
  progressDeadlineSeconds: 600

svc.yaml

kind: Service
apiVersion: v1
metadata:
  name: dubbo-demo-consumer
  namespace: test

ingress.yaml

kind: Ingress
apiVersion: extensions/v1beta1
metadata:
  name: dubbo-demo-consumer
  namespace: test

这里会用到两个新的域名，添加解析：

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_mysql_16


应用test环境的dubbo-consumer资源配置清单：

# kubectl apply -f http://k8s-yaml.od.com/test/dubbo-demo-consumer/dp.yaml
# kubectl apply -f http://k8s-yaml.od.com/test/dubbo-demo-consumer/svc.yaml
# kubectl apply -f http://k8s-yaml.od.com/test/dubbo-demo-consumer/ingress.yaml

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_docker_17

接下来交付prod环境的dubbo-demo-server和dubbo-demo-consumer服务

同样套路，复制资源配置清单，然后修改成prod环境：

cd /data/k8s-yaml/prod/dubbo-demo-server
cp ../../dubbo-server/* ./

dp.yaml

kind: Deployment
apiVersion: extensions/v1beta1
metadata:
  name: dubbo-demo-service
  namespace: prod 
  labels: 
    name: dubbo-demo-service
spec:
  replicas: 1
  selector:
    matchLabels: 
      name: dubbo-demo-service
  template:
    metadata:
      labels: 
        app: dubbo-demo-service
        name: dubbo-demo-service
    spec:
      containers:
      - name: dubbo-demo-service
        image: harbor.od.com/app/dubbo-demo-service:apollo_191211_1916
        ports:
        - containerPort: 20880
          protocol: TCP
        env:
        - name: C_OPTS
          value: -Denv=pro -Dapollo.meta=http://config-prod.od.com
        - name: JAR_BALL
          value: dubbo-server.jar
        imagePullPolicy: IfNotPresent
      imagePullSecrets:
      - name: harbor
      restartPolicy: Always
      terminationGracePeriodSeconds: 30
      securityContext: 
        runAsUser: 0
      schedulerName: default-scheduler
  strategy:
    type: RollingUpdate
    rollingUpdate: 
      maxUnavailable: 1
      maxSurge: 1
  revisionHistoryLimit: 7
  progressDeadlineSeconds: 600

应用资源配置清单：

# kubectl apply -f http://k8s-yaml.od.com/prod/dubbo-demo-server/dp.yaml

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_docker_18

接下来做dubbo-demo-consumer的资源配置清单

cd /data/k8s-yaml/prod/dubbo-demo-consumer
 cp ../../dubbo-consumer/* ./

dp.yaml

http://apollo-configservice:8080 这里可以直接使用svc资源名称调用，不用走ingress，因为svc资源只在当前namespace中生效。

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_mysql_19

kind: Deployment
apiVersion: extensions/v1beta1
metadata:
  name: dubbo-demo-consumer
  namespace: prod 
  labels: 
    name: dubbo-demo-consumer
spec:
  replicas: 1
  selector:
    matchLabels: 
      name: dubbo-demo-consumer
  template:
    metadata:
      labels: 
        app: dubbo-demo-consumer
        name: dubbo-demo-consumer
    spec:
      containers:
      - name: dubbo-demo-consumer
        image: harbor.od.com/app/dubbo-demo-web:apollo_191212_1715
        ports:
        - containerPort: 8080
          protocol: TCP
        - containerPort: 20880
          protocol: TCP
        env:
        - name: C_OPTS
          value: -Denv=pro -Dapollo.meta=http://apollo-configservice:8080
        - name: JAR_BALL
          value: dubbo-client.jar
        imagePullPolicy: IfNotPresent
      imagePullSecrets:
      - name: harbor
      restartPolicy: Always
      terminationGracePeriodSeconds: 30
      securityContext: 
        runAsUser: 0
      schedulerName: default-scheduler
  strategy:
    type: RollingUpdate
    rollingUpdate: 
      maxUnavailable: 1
      maxSurge: 1
  revisionHistoryLimit: 7
  progressDeadlineSeconds: 600

svc.yaml

kind: Service
apiVersion: v1
metadata: 
  name: dubbo-demo-consumer
  namespace: prod 
spec:
  ports:
  - protocol: TCP
    port: 8080
    targetPort: 8080
  selector: 
    app: dubbo-demo-consumer

ingress.yaml

kind: Service
apiVersion: v1
metadata: 
  name: dubbo-demo-consumer
  namespace: prod 
spec:
  ports:
  - protocol: TCP
    port: 8080
    targetPort: 8080
  selector: 
    app: dubbo-demo-consumer
[root@hdss7-200 dubbo-demo-consumer]# cat ingress.yaml

应用资源配置清单：

# kubectl apply -f http://k8s-yaml.od.com/prod/dubbo-demo-consumer/dp.yaml
# kubectl apply -f http://k8s-yaml.od.com/prod/dubbo-demo-consumer/svc.yaml
# kubectl apply -f http://k8s-yaml.od.com/prod/dubbo-demo-consumer/ingress.yaml

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_docker_20


访问两个环境的不同url：

​​ http://demo-test.od.com​​

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_docker_21

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_spring_22

模拟发版

使用jenkins构建新的镜像：

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_docker_23


构建成功，然后我们在测试环境发布此版本镜像：

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_spring_24


修改测试环境的dp.yaml

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_spring_25

应用修改后的资源配置清单：

kubectl apply -f http://k8s-yaml.od.com/test/dubbo-demo-consumer/dp.yaml

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_mysql_26


已经成功将新代码上线到test环境，接下来上线到prod环境，

同样修改prod环境的dp.yaml,并且应用该资源配置清单：

【K8S运维知识汇总】第6天8：实战使用apollo分环境管理dubbo服务_mysql_27


已经上线到生产环境，这样一套完整的分环境使用apollo配置中心发布流程已经可以使用了，并且真正做到了一次构建，多平台使用


举报

相关推荐

【K8S运维知识汇总】第6天6：dubbo服务提供者连接Apollo

重启jaridekubernetes云计算

【K8S运维知识汇总】第6天７：dubbo服务消费者连接Apollo

创建项目jarkubernetes云计算

【K8S运维知识汇总】第6天4：交付Apollo-adminservice至k8s集群

javadockerjarkubernetes云计算

【K8S运维知识汇总】第3天1：k8s回顾

百度kubernetes云计算

【K8S运维知识汇总】第2天12：验证k8s集群

nginxh5idekubernetes云计算

【K8S运维知识汇总】第7天2：交付Exporters至k8s集群

docker软连接ide虚拟化云计算

【K8S运维知识汇总】第6天1：微服务架构之配置中心选型

2dzookeeper3dDocker云计算

【K8S运维知识汇总】第4天10：部署zk集群

zookeeperjava环境变量云计算

K8S 运维管理

kubernetes容器

【K8S运维知识汇总】第3天3：flanneld安装部署详解

nginxlinuxhtmlkubernetes云计算
0 条评论