If you would like to implement autoscaling in your Kubernetes cluster then you are at the right place to get started, so read on.<\/p>\n\n\n\n
I’ve explored the implementation of the Kubernetes object called HorizontalPodAutoscaler (HPA for short) in order to autoscale (up or down) a deployment according to the memory usage of its pods. The idea is to have a deployment with 10 replicas, but only deploy the number of pods required according to their memory usage. So, at some point during the day, we could deploy up to 10 pods when there is a lot of traffic to process but during the night, go down to 4 for example when it is quieter. I’ll only have to set a few parameters and HPA will take care of the rest based on the metrics it collects. The algorithm used for this autoscaling is described in the Kubernetes documentation here<\/a>.<\/p>\n\n\n\n Before diving into HPA, you must ensure metrics are installed in your cluster as the HPA algorithm is using them for autoscaling. A quick check is to use the kubectl top<\/strong> command and observe the results:<\/p>\n\n\n If the output displays the CPU and MEMORY for each of your pod then metrics are installed and you can move forward. If like me you are using Minikube first for testing this, installing metrics is as easy as the command below:<\/p>\n\n\n Let’s move on to HPA. I’ve configured HorizontalPodAutoscaler through a yaml file to experiment with it. Below I’ll describe what you need to know to make it work. The first step is to check what is your API version for this hpa object:<\/p>\n\n\n On this old cluster I’ve got, the API version of hpa is autoscaling\/v1<\/em><\/strong>. Here is the bad news: in this version it is not possible to use pod memory metrics to do autoscaling. There is just one parameter available and it can only use the CPU metrics of the pods:<\/p>\n\n\n In this API version, the possibilities are then limited to this parameter targetCPUUtilizationPercentage<\/em><\/strong> that evaluates the average CPU utilization of the pods.<\/p>\n\n\n\n To have more options, your cluster needs to use autoscaling\/v2<\/strong> for HPA (this is what a recent version of Minikube is automatically using). An hpa yaml file could then be for example:<\/p>\n\n\n In this version 2 the syntax has changed from version 1 and targetCPUUtilizationPercentage<\/em><\/strong> has been replaced by metrics<\/strong><\/em> which allows a more flexible way to configure metrics.<\/p>\n\n\n\n To leverage HPA, the resources<\/strong> parameter has to be configured for the pod’s containers of the deployment as for example:<\/p>\n\n\n When the deployment is set and your hpa configuration is running, you’ll then be able to check its status:<\/p>\n\n\n The TARGETS column shows the percentage of memory used by all the pods (not relevant here as my pods are not running anything and are in a sleep state) \/ the average utilization we’ve configured for our hpa metrics. That works and I now have a solution to adapt and deploy in the wild. If the memory metrics were not collected properly I would have seen instead <unknown>\/60%.<\/p>\n\n\n\n If you also want to use HPA with the CPU metrics of your pods, here is how to proceed. Update the hpa yaml file as follows:<\/p>\n\n\n Just add a block resources<\/strong> for cpu and its metric and value. You see how flexible that new api version 2 is in comparison with the unique cpu parameter in version 1.<\/p>\n\n\n\n Add in the deployment pod’s containers a cpu resource for your pods:<\/p>\n\n\n When all is set, you’ll now have the following output:<\/p>\n\n\n In addition to the memory, hpa is now also monitoring the CPU (0%\/60%) and use both metrics to autoscale the pods of our deployment.<\/p>\n\n\n\n I hope this post will help you quickly configure HPA in your Kubernetes cluster. If you want to learn more about Kubernetes, check out our Training course<\/a> given by our Kubernetes wizard!<\/p>\n\n\n\nMetrics prerequisite<\/h2>\n\n\n\n
\n$ kubectl top pod\nNAME CPU(cores) MEMORY(bytes)\nbusybox-5cfd866f57-4l95f 0m 0Mi\nbusybox-5cfd866f57-b9h45 0m 0Mi\n<\/pre><\/div>\n\n\n
\n$ minikube addons enable metrics-server\n<\/pre><\/div>\n\n\n
API autoscaling v1<\/h2>\n\n\n\n
\n$ kubectl api-resources|grep hpa\nhorizontalpodautoscalers hpa autoscaling\/v1 true HorizontalPodAutoscaler\n<\/pre><\/div>\n\n\n
\n$ kubectl explain hpa.spec\nKIND: HorizontalPodAutoscaler\nVERSION: autoscaling\/v1\n\nRESOURCE: spec <Object>\n\nDESCRIPTION:\n behaviour of autoscaler. More info:\n https:\/\/git.k8s.io\/community\/contributors\/devel\/api-conventions.md#spec-and-status.\n\n specification of a horizontal pod autoscaler.\n\nFIELDS:\n maxReplicas <integer> -required-\n upper limit for the number of pods that can be set by the autoscaler;\n cannot be smaller than MinReplicas.\n\n minReplicas <integer>\n lower limit for the number of pods that can be set by the autoscaler,\n default 1.\n\n scaleTargetRef <Object> -required-\n reference to scaled resource; horizontal pod autoscaler will learn the\n current resource consumption and will set the desired number of pods by\n using its Scale subresource.\n\n targetCPUUtilizationPercentage <integer>\n target average CPU utilization (represented as a percentage of requested\n CPU) over all the pods; if not specified the default autoscaling policy\n will be used.\n\n<\/pre><\/div>\n\n\n
Api autoscaling v2<\/h2>\n\n\n\n
\napiVersion: autoscaling\/v2\nkind: HorizontalPodAutoscaler\nmetadata:\n name: hpa-busybox\nspec:\n maxReplicas: 2\n minReplicas: 1\n scaleTargetRef:\n apiVersion: apps\/v1\n kind: Deployment\n name: busybox\n metrics:\n - type: Resource\n resource:\n name: memory\n target:\n type: Utilization\n averageUtilization: 60\n<\/pre><\/div>\n\n\n
\nresources:\n limits:\n memory: "1Gi"\n requests:\n memory: "1Ki"\n<\/pre><\/div>\n\n\n
\n$ kubectl get hpa\nNAME REFERENCE TARGETS MINPODS MAXPODS REPLICAS AGE\nhpa-busybox Deployment\/busybox 16200%\/60% 1 2 2 121m\n<\/pre><\/div>\n\n\n
Add CPU Autoscaling<\/h2>\n\n\n\n
\napiVersion: autoscaling\/v2\nkind: HorizontalPodAutoscaler\nmetadata:\n name: hpa-busybox\nspec:\n maxReplicas: 2\n minReplicas: 1\n scaleTargetRef:\n apiVersion: apps\/v1\n kind: Deployment\n name: busybox\n metrics:\n - type: Resource\n resource:\n name: cpu\n target:\n type: Utilization\n averageUtilization: 60\n - type: Resource\n resource:\n name: memory\n target:\n type: Utilization\n averageUtilization: 60\n<\/pre><\/div>\n\n\n
\nresources:\n limits:\n cpu: "1"\n memory: "1Gi"\n requests:\n cpu: "0.5"\n memory: "1Ki"\n<\/pre><\/div>\n\n\n
\n$ kubectl get hpa\nNAME REFERENCE TARGETS MINPODS MAXPODS REPLICAS AGE\nhpa-busybox Deployment\/busybox 16000%\/60%, 0%\/60% 1 2 2 6m49s\n<\/pre><\/div>\n\n\n