~/ nmadiraju.com Amazon EKS · DaemonSets
arrow_back Back to nmadiraju
Visual Walkthrough · Kubernetes workloads

How DaemonSets Work on Amazon EKS

Follow the fluent-bit log agent onto every node as nodes join, leave and get tainted, then check yourself with 8 questions.

1Visual Walkthrough

A DaemonSet running one fluent-bit Pod per EKS node, with the kube-system DaemonSets The Kubernetes API holds a Deployment log-agent, DaemonSet fluent-bit, the kube-system DaemonSets aws-node and kube-proxy, and an NVIDIA device plugin DaemonSet. Below, your VPC holds node-1 to node-4 from node group ng-general and gpu-1 from ng-gpu, each with its DaemonSet Pods, and fluent-bit ships logs to CloudWatch Logs. The walkthrough shows a Deployment missing a node, a DaemonSet covering every node, nodes joining and leaving, a tainted GPU node and its toleration, a nodeSelector, a rolling update and a Pending Pod fixed with priority. You kubectl · laptop CloudWatch Logs log group …/prod/application OBJECTS IN THE KUBERNETES API · CLUSTER prod Deployment log-agent replicas: 3 placed wherever the scheduler finds room DaemonSet fluent-bit ns amazon-cloudwatch kube-system DaemonSet aws-node DaemonSet kube-proxy on every managed or self-managed EC2 node nvidia-device-plugin DaemonSet · ns nvidia your nodeSelector: eks.amazonaws.com/nodegroup: ng-gpu tolerates nvidia.com/gpu YOUR VPC · NODE GROUPS ng-general (node-1 TO node-4) AND ng-gpu (gpu-1) node-1 m6i.large REMOVED node-2 m6i.large REMOVED node-3 m6i.large REMOVED node-4 m6i.large REMOVED gpu-1 g5.xlarge REMOVED log-agent Pod 1 Running log-agent Pod 2 Running log-agent Pod 3 Running no log agent no log agent fluent-bit-x7k2p fluent-bit-m4q9z fluent-bit-c8w3d fluent-bit-r2j6n fluent-bit-h5t1v aws-node VPC CNI · Running aws-node VPC CNI · Running aws-node VPC CNI · Running aws-node VPC CNI · Running aws-node VPC CNI · Running kube-proxy Running kube-proxy Running kube-proxy Running kube-proxy Running kube-proxy Running nvidia-device-plugin Running

    2Quiz to check understanding

    Check yourself