Blog

Data Engineering is more SRE than SQL

|

Following my post about the Chariot Data Engineering interview, I received some comments along the lines of “wait, you don’t test their SQL skills?!?” Actually, we do: after loading up the test data into Redshift, the candidate creates three progressively difficult queries. But by then, I’m pretty sure they’ve got the skills we need, because in my experience, SQL is only a small part of a Data Engineer’s job. Site Reliability Engineering (SRE) originated at Google, and focuses on “improv[ing]…

Read More

Leveraging EKS Pod Identity to Inject ASM Secrets: A Step-by-Step Guide

|

EKS Pod Identity is a feature that enables applications running on EKS to securely access AWS services, such as AWS Secrets Manager, without the need for hardcoding or managing access credentials. Instead, EKS Pod Identity uses IAM roles to grant permissions to pods, allowing them to interact with AWS services seamlessly. In my last post, I showed an example of a pod fetching objects from S3 using pod identity. But let’s create a more real world example: using pod identity…

Read More

Hands on with EKS Pod Identity

|

Recently AWS released EKS Pod Identity which simplifies how cluster administrators can configure Kubernetes applications to obtain AWS IAM permissions. With Pod Identity you can assign an IAM role to a K8s service account using the new AWS API create-pod-identity-association and the EKS pod identity agent. When a pod starts with the associated service account, the identity agent will inject credentials so the pod can call AWS services. Here we will create a simple demo allowing a pod to access…

Read More
1 … 3 4 5 … 52

How can we help your company with your development needs?

Contact Us