1. 项目背景与核心价值在容器化技术普及的今天Kubernetes简称K8s已成为云原生应用编排的事实标准。本次要分享的是在K8s 1.33.3集群上部署Nginx的全流程实践这个组合看似基础实则是理解K8s工作机理的最佳切入点。Nginx作为高性能Web服务器在K8s环境中的部署过程涉及Deployment、Service、Ingress等核心概念通过这个最小可行示例我们可以掌握K8s资源定义、服务暴露、滚动更新等关键技能。选择K8s 1.33.3版本是因为它属于长期支持LTS版本分支相比edge版本具有更好的稳定性。而Nginx的官方镜像经过特别优化与K8s的调度系统有深度适配。这个部署方案适合需要快速搭建Web服务的中小型项目也适合作为学习K8s的入门实验。2. 环境准备与前置检查2.1 集群环境确认在开始部署前需要确保K8s集群处于健康状态。通过以下命令检查节点和核心组件kubectl get nodes # 查看节点状态应为Ready kubectl get pods -n kube-system # 检查核心组件运行状态特别要注意kube-proxy和CoreDNS这两个与网络相关的组件必须正常运行。如果使用云服务商的托管K8s如EKS、AKS等还需要确认LoadBalancer控制器已正确安装。2.2 存储类配置虽然Nginx本身是无状态应用但考虑到后续可能需要的配置文件持久化建议提前配置StorageClass。对于测试环境可以使用hostPath生产环境则建议配置网络存储apiVersion: storage.k8s.io/v1 kind: StorageClass metadata: name: fast provisioner: kubernetes.io/aws-ebs # 根据实际云平台调整 parameters: type: gp33. Nginx部署方案设计3.1 Deployment配置详解创建nginx-deployment.yaml文件关键配置说明如下apiVersion: apps/v1 kind: Deployment metadata: name: nginx-deployment labels: app: nginx spec: replicas: 3 # 根据实际负载调整副本数 selector: matchLabels: app: nginx template: metadata: labels: app: nginx spec: containers: - name: nginx image: nginx:1.25.3-alpine # 推荐使用alpine精简版 ports: - containerPort: 80 resources: requests: cpu: 100m memory: 128Mi limits: cpu: 500m memory: 512Mi livenessProbe: httpGet: path: / port: 80 initialDelaySeconds: 5 periodSeconds: 10关键技巧使用alpine版本镜像可以显著减少资源占用适合生产环境。livenessProbe配置能确保异常容器自动重启。3.2 Service暴露策略创建nginx-service.yaml定义服务暴露方式apiVersion: v1 kind: Service metadata: name: nginx-service spec: selector: app: nginx ports: - protocol: TCP port: 80 targetPort: 80 type: LoadBalancer # 根据环境选择ClusterIP或NodePort对于生产环境更推荐使用Ingress实现高级路由apiVersion: networking.k8s.io/v1 kind: Ingress metadata: name: nginx-ingress annotations: nginx.ingress.kubernetes.io/rewrite-target: / spec: rules: - host: example.com http: paths: - path: / pathType: Prefix backend: service: name: nginx-service port: number: 804. 部署流程与验证4.1 应用部署命令执行以下命令完成部署kubectl apply -f nginx-deployment.yaml kubectl apply -f nginx-service.yaml # 如果配置了Ingress kubectl apply -f nginx-ingress.yaml4.2 状态验证方法检查部署状态kubectl get deployments kubectl get pods -o wide kubectl get services kubectl describe svc nginx-service验证服务可达性# 获取服务外部IP EXTERNAL_IP$(kubectl get svc nginx-service -o jsonpath{.status.loadBalancer.ingress[0].ip}) curl http://$EXTERNAL_IP5. 高级配置与优化5.1 配置热更新方案通过ConfigMap管理Nginx配置apiVersion: v1 kind: ConfigMap metadata: name: nginx-config data: nginx.conf: | user nginx; worker_processes auto; events { worker_connections 1024; } http { include /etc/nginx/mime.types; default_type application/octet-stream; sendfile on; keepalive_timeout 65; server { listen 80; server_name localhost; location / { root /usr/share/nginx/html; index index.html index.htm; } } }然后在Deployment中挂载spec: containers: - name: nginx volumeMounts: - name: config mountPath: /etc/nginx/nginx.conf subPath: nginx.conf volumes: - name: config configMap: name: nginx-config5.2 自动扩缩容配置配置HPA实现自动扩缩容kubectl autoscale deployment nginx-deployment --cpu-percent50 --min3 --max10或通过YAML定义apiVersion: autoscaling/v2 kind: HorizontalPodAutoscaler metadata: name: nginx-hpa spec: scaleTargetRef: apiVersion: apps/v1 kind: Deployment name: nginx-deployment minReplicas: 3 maxReplicas: 10 metrics: - type: Resource resource: name: cpu target: type: Utilization averageUtilization: 506. 问题排查与日常维护6.1 常见问题速查表问题现象可能原因解决方案Pod处于CrashLoopBackOff状态容器启动失败kubectl logs pod-name查看日志Service无法访问标签选择器不匹配检查Service的selector与Pod标签502 Bad Gateway后端Pod未就绪检查readinessProbe配置DNS解析失败CoreDNS异常检查kube-dns Pod状态6.2 日志收集方案建议配置集中式日志收集# 查看实时日志 kubectl logs -f deployment/nginx-deployment # 安装Fluentd日志收集器 helm repo add fluent https://fluent.github.io/helm-charts helm install fluentd fluent/fluentd -n logging7. 版本升级与回滚7.1 滚动更新策略修改Deployment中的镜像版本触发更新kubectl set image deployment/nginx-deployment nginxnginx:1.25.4-alpine观察更新过程kubectl rollout status deployment/nginx-deployment7.2 回滚操作查看历史版本kubectl rollout history deployment/nginx-deployment回滚到指定版本kubectl rollout undo deployment/nginx-deployment --to-revision28. 安全加固建议8.1 最小权限原则创建专用ServiceAccountapiVersion: v1 kind: ServiceAccount metadata: name: nginx-sa然后在Deployment中指定spec: serviceAccountName: nginx-sa8.2 网络策略限制配置NetworkPolicy限制入站流量apiVersion: networking.k8s.io/v1 kind: NetworkPolicy metadata: name: nginx-policy spec: podSelector: matchLabels: app: nginx policyTypes: - Ingress ingress: - from: - namespaceSelector: {} ports: - protocol: TCP port: 809. 性能监控方案9.1 指标暴露配置Nginx默认暴露stub_status指标可以通过以下方式启用kubectl exec -it nginx-pod -- bash echo server { listen 8080; location /stub_status { stub_status on; } } /etc/nginx/conf.d/stats.conf nginx -s reload9.2 Prometheus监控配置ServiceMonitor用于Prometheus采集apiVersion: monitoring.coreos.com/v1 kind: ServiceMonitor metadata: name: nginx-monitor spec: selector: matchLabels: app: nginx endpoints: - port: web interval: 15s path: /stub_status10. 生产环境建议在实际生产部署中我总结了几个关键经验镜像标签管理避免使用latest标签明确指定版本号便于追踪资源限制配置合理设置requests和limits防止资源争抢多可用区部署通过topologySpreadConstraints实现跨AZ部署备份策略定期备份ConfigMap和Deployment配置混沌工程定期进行Pod删除测试验证系统健壮性对于高流量场景可以考虑以下优化启用Nginx缓存配置WAF防护使用Service Mesh进行细粒度流量管理实现蓝绿部署降低发布风险
1. 项目背景与核心价值在容器化技术普及的今天Kubernetes简称K8s已成为云原生应用编排的事实标准。本次要分享的是在K8s 1.33.3集群上部署Nginx的全流程实践这个组合看似基础实则是理解K8s工作机理的最佳切入点。Nginx作为高性能Web服务器在K8s环境中的部署过程涉及Deployment、Service、Ingress等核心概念通过这个最小可行示例我们可以掌握K8s资源定义、服务暴露、滚动更新等关键技能。选择K8s 1.33.3版本是因为它属于长期支持LTS版本分支相比edge版本具有更好的稳定性。而Nginx的官方镜像经过特别优化与K8s的调度系统有深度适配。这个部署方案适合需要快速搭建Web服务的中小型项目也适合作为学习K8s的入门实验。2. 环境准备与前置检查2.1 集群环境确认在开始部署前需要确保K8s集群处于健康状态。通过以下命令检查节点和核心组件kubectl get nodes # 查看节点状态应为Ready kubectl get pods -n kube-system # 检查核心组件运行状态特别要注意kube-proxy和CoreDNS这两个与网络相关的组件必须正常运行。如果使用云服务商的托管K8s如EKS、AKS等还需要确认LoadBalancer控制器已正确安装。2.2 存储类配置虽然Nginx本身是无状态应用但考虑到后续可能需要的配置文件持久化建议提前配置StorageClass。对于测试环境可以使用hostPath生产环境则建议配置网络存储apiVersion: storage.k8s.io/v1 kind: StorageClass metadata: name: fast provisioner: kubernetes.io/aws-ebs # 根据实际云平台调整 parameters: type: gp33. Nginx部署方案设计3.1 Deployment配置详解创建nginx-deployment.yaml文件关键配置说明如下apiVersion: apps/v1 kind: Deployment metadata: name: nginx-deployment labels: app: nginx spec: replicas: 3 # 根据实际负载调整副本数 selector: matchLabels: app: nginx template: metadata: labels: app: nginx spec: containers: - name: nginx image: nginx:1.25.3-alpine # 推荐使用alpine精简版 ports: - containerPort: 80 resources: requests: cpu: 100m memory: 128Mi limits: cpu: 500m memory: 512Mi livenessProbe: httpGet: path: / port: 80 initialDelaySeconds: 5 periodSeconds: 10关键技巧使用alpine版本镜像可以显著减少资源占用适合生产环境。livenessProbe配置能确保异常容器自动重启。3.2 Service暴露策略创建nginx-service.yaml定义服务暴露方式apiVersion: v1 kind: Service metadata: name: nginx-service spec: selector: app: nginx ports: - protocol: TCP port: 80 targetPort: 80 type: LoadBalancer # 根据环境选择ClusterIP或NodePort对于生产环境更推荐使用Ingress实现高级路由apiVersion: networking.k8s.io/v1 kind: Ingress metadata: name: nginx-ingress annotations: nginx.ingress.kubernetes.io/rewrite-target: / spec: rules: - host: example.com http: paths: - path: / pathType: Prefix backend: service: name: nginx-service port: number: 804. 部署流程与验证4.1 应用部署命令执行以下命令完成部署kubectl apply -f nginx-deployment.yaml kubectl apply -f nginx-service.yaml # 如果配置了Ingress kubectl apply -f nginx-ingress.yaml4.2 状态验证方法检查部署状态kubectl get deployments kubectl get pods -o wide kubectl get services kubectl describe svc nginx-service验证服务可达性# 获取服务外部IP EXTERNAL_IP$(kubectl get svc nginx-service -o jsonpath{.status.loadBalancer.ingress[0].ip}) curl http://$EXTERNAL_IP5. 高级配置与优化5.1 配置热更新方案通过ConfigMap管理Nginx配置apiVersion: v1 kind: ConfigMap metadata: name: nginx-config data: nginx.conf: | user nginx; worker_processes auto; events { worker_connections 1024; } http { include /etc/nginx/mime.types; default_type application/octet-stream; sendfile on; keepalive_timeout 65; server { listen 80; server_name localhost; location / { root /usr/share/nginx/html; index index.html index.htm; } } }然后在Deployment中挂载spec: containers: - name: nginx volumeMounts: - name: config mountPath: /etc/nginx/nginx.conf subPath: nginx.conf volumes: - name: config configMap: name: nginx-config5.2 自动扩缩容配置配置HPA实现自动扩缩容kubectl autoscale deployment nginx-deployment --cpu-percent50 --min3 --max10或通过YAML定义apiVersion: autoscaling/v2 kind: HorizontalPodAutoscaler metadata: name: nginx-hpa spec: scaleTargetRef: apiVersion: apps/v1 kind: Deployment name: nginx-deployment minReplicas: 3 maxReplicas: 10 metrics: - type: Resource resource: name: cpu target: type: Utilization averageUtilization: 506. 问题排查与日常维护6.1 常见问题速查表问题现象可能原因解决方案Pod处于CrashLoopBackOff状态容器启动失败kubectl logs pod-name查看日志Service无法访问标签选择器不匹配检查Service的selector与Pod标签502 Bad Gateway后端Pod未就绪检查readinessProbe配置DNS解析失败CoreDNS异常检查kube-dns Pod状态6.2 日志收集方案建议配置集中式日志收集# 查看实时日志 kubectl logs -f deployment/nginx-deployment # 安装Fluentd日志收集器 helm repo add fluent https://fluent.github.io/helm-charts helm install fluentd fluent/fluentd -n logging7. 版本升级与回滚7.1 滚动更新策略修改Deployment中的镜像版本触发更新kubectl set image deployment/nginx-deployment nginxnginx:1.25.4-alpine观察更新过程kubectl rollout status deployment/nginx-deployment7.2 回滚操作查看历史版本kubectl rollout history deployment/nginx-deployment回滚到指定版本kubectl rollout undo deployment/nginx-deployment --to-revision28. 安全加固建议8.1 最小权限原则创建专用ServiceAccountapiVersion: v1 kind: ServiceAccount metadata: name: nginx-sa然后在Deployment中指定spec: serviceAccountName: nginx-sa8.2 网络策略限制配置NetworkPolicy限制入站流量apiVersion: networking.k8s.io/v1 kind: NetworkPolicy metadata: name: nginx-policy spec: podSelector: matchLabels: app: nginx policyTypes: - Ingress ingress: - from: - namespaceSelector: {} ports: - protocol: TCP port: 809. 性能监控方案9.1 指标暴露配置Nginx默认暴露stub_status指标可以通过以下方式启用kubectl exec -it nginx-pod -- bash echo server { listen 8080; location /stub_status { stub_status on; } } /etc/nginx/conf.d/stats.conf nginx -s reload9.2 Prometheus监控配置ServiceMonitor用于Prometheus采集apiVersion: monitoring.coreos.com/v1 kind: ServiceMonitor metadata: name: nginx-monitor spec: selector: matchLabels: app: nginx endpoints: - port: web interval: 15s path: /stub_status10. 生产环境建议在实际生产部署中我总结了几个关键经验镜像标签管理避免使用latest标签明确指定版本号便于追踪资源限制配置合理设置requests和limits防止资源争抢多可用区部署通过topologySpreadConstraints实现跨AZ部署备份策略定期备份ConfigMap和Deployment配置混沌工程定期进行Pod删除测试验证系统健壮性对于高流量场景可以考虑以下优化启用Nginx缓存配置WAF防护使用Service Mesh进行细粒度流量管理实现蓝绿部署降低发布风险
