Skip to content

AWS

Amazon Web Services from a database perspective: RDS and Aurora, databases on EC2, storage, networking, IAM, migration and keeping the bill under control.

Building a PostgreSQL EC2 AMI for testing the latest commits

Testing the latest features or bug fixes in PostgreSQL can easily be done by pulling the latest commits from the git repository and compile PostgreSQL from source code. I am doing that frequently on my local sandbox VM but this becomes limited when I need more CPUs or more memory. This is where the public cloud really shines, as you… 

DynamoDB / Aurora: sparse and partial indexes

By Franck Pachot . In a previous post I tried to build a glossary about Amazon DynamoDB terms that look like relational database terms, but with a different technical meaning. Here is more about it. If you work with AWS Databases and frequently switch between DynamoDB and Aurora, or other RDS databases, you may be confused by the same terms… 

A VPC is a private cloud in a public cloud

By Franck Pachot . If you are surprised that the first thing you do in a Public Cloud is creating a Virtual Private Cloud, this post is for you. This is a beginner level post. And if you are at that level, interested by what is the Cloud and what is AWS, I recommend our free AWS Discovery Days –… 

Deploying a Kubernetes cluster on EC2 with Rancher

Once Rancher is up and running, it makes the deployment and management of Kubernetes clusters quite easy. In this post we’ll deploy a brand new cluster on top of EC2. If you want to have a simple and quick Rancher playground you can follow this post, which will give you a Rancher setup on SLES 15. If you want to… 

AWS: PostgreSQL on Graviton2 with newer GCC

By Franck Pachot . In the previous post I have run PostgreSQL on AWS m6gd.2xlarge (ARM Graviton2 processor). I didn’t precise the compilation option and this post will give more details following this feedback: @FranckPachot thanks for sharing the results. Our own testing showed similar perf when using the default gcc7. However, with newer compiler and use of LSE, the… 

Rancher, up and running, on EC2 – 3 – Rancher setup

The is the next post in this little Rancher series. After we installed a single node RKE cluster and extended this configurtation to three nodes we will finally install Rancher in this post. As Rancher is installed with Helm we need to install that first: rancher@rancher1:~$ wget https://get.helm.sh/helm-v3.5.2-linux-amd64.tar.gz rancher@rancher1:~$ tar axf helm-v3.5.2-linux-amd64.tar.gz rancher@rancher1:~$ sudo mv linux-amd64/helm /usr/local/bin/ rancher@rancher1:~$ sudo chown… 

Rancher, up and running, on EC2 – 2 – Three nodes

In the last post we’ve brought up a RKE Kubernetes cluster on a single node. While that is cool for demonstration purposes or testing, this is nothing for a real life setup. Running the control pane, the etcd nodes and the worker nodes all on one node, is nothing you want to do usually, as you can not guarantee fault… 

AWS: PostgreSQL on Graviton2

By Franck Pachot . On the AWS free tier, you can run a t2.micro instance for 750 hours per month during the first 12 month after sign-up date. And currently, until June 2021, you can also run a T4g.micro. But be careful, when the free trial ends, or if your usage exceeds the free trial restrictions, you’ll pay the standard… 

Rancher, up and running, on EC2 – 1 – One node

If you want to play with Rancher you have several options, as outlined in the documentation. There are quick starts for the major public cloud providers (using Terraform), you can install it on a Linux host by using the Rancher container or you can do it on your own. We’ll be doing it step by step, as I believe that… 

8000 PostgreSQL clusters on one host?

Coming back to the last post: 8000 databases in one PostgreSQL cluster?. As we’ve seen this is doable but comes with a lot of pain points. Another solution for this kind of requirement would be to host 8000 PostgreSQL clusters on one host. Again, I am not saying this is something you should do, and again, this is not how… 

AWS EC2 instance deployment with Terraform

When it comes to quickly provision a server in the Cloud, using an Infrastructure as Code (IaC) tool is a solution to consider. There are many IaC products available and among them, Terraform seems to be the most popular. The following is a non-exhaustive list of Terraform advantages : – Terraform can deploy infrastructure to multiple cloud service providers simultaneously… 

DynamoDB Scan: the most efficient operation 😉

By Franck Pachot . The title is provocative on purpose because you can read in many places that you should avoid scans, and that Scan operations are less efficient than other operations in DynamoDB. I think that there is a risk, reading those message without understanding what is behind, that people will actually avoid Scans and replace them by something…