Infraspec Blog

Sharing our learnings from our work

Efficient Data Migration: From Hive Metastore to Unity Catalog in Databricks

TL;DR We had to migrate extensive data from Hive Metastore to Unity Catalog in a regulated large-scale enterprise…
by Arihant Hirawat, on Nov 9, 2024 | 6 min read

ClickHouse Performance Benchmarking on ECS for Log Storage and Querying

Imagine being a Formula One driver, racing at breakneck speeds, but without any telemetry data to guide you. It’s a…
by Rohit Nagmoti, on Oct 21, 2024 | 8 min read

Cache Strategies

What is Caching? Caching is a technique that enhances application performance by temporarily storing frequently accessed…
by Sanjay Singh, on Sep 25, 2024 | 8 min read

From Chaos to Clarity: Managing Environments with Terragrunt

Managing multiple environments was a never-ending headache for me. Like many others in the DevOps world, I was…
by Nimisha G J, on Sep 10, 2024 | 6 min read

Leveraging NFS Filesystem as Volumes in Docker: A Comprehensive Guide

As an Infrastructure engineer, I’ve had my fair share of experiences with containerized environments and the challenges…
by Nimisha G J, on Aug 19, 2024 | 6 min read

AWS ECS: FARGATE vs self-managed EC2

Cooking Up Cloud: Fargate or EC2—Which Kitchen Suits You? The Amazon Elastic Container Service (ECS) from Amazon deploys…
by Saumitra Topinkatti, on Aug 13, 2024 | 7 min read

Managing Credentials and Secrets in Terraform

Imagine you’re working on a project where you need to deploy resources to aws using terraform. In a rush to get things…
by Rahul Patil, on Aug 6, 2024 | 8 min read

Essential AWS Tagging Strategies for Better Cloud Control

Introduction Managing cloud resources efficiently in AWS requires a robust tagging strategy. Tags are key-value pairs…
by Rohit Nagmoti, on Jul 29, 2024 | 7 min read

GenAI Dictionary: Part 1 - LLM

We bring to you this weekly series of articles, to help understand and demystify the lexicon in the GenAI space. Here is…
by Nandhitha Kamal, on Jun 21, 2024 | 5 min read

Building a Discord GPT Bot

Amidst the excitement surrounding AI, we were eager to delve into this field ourselves. As engineers, we wanted more…
by Nandhitha Kamal, on May 31, 2024 | 7 min read

Bridging the gap between Argo Rollout & AWS ALB by eliminating 502s

The blog discusses resolving a deployment issue with 502 errors on AWS EKS using AWS ALB and Argo Rollouts. It details…
by Mufaddal Shakir, on May 27, 2024 | 6 min read

Header-Based traffic routing using Argo Rollouts

This blog explores how to use Argo Rollouts for deploying software updates smoothly. It covers the challenges faced when…
by Mufaddal Shakir, on May 27, 2024 | 10 min read

Role-Based Access Control in Kubernetes

Role-Based Access Control (RBAC) is a crucial feature in Kubernetes that allows administrators to define and manage…
by Sudeep Kulkarni, on Apr 29, 2024 | 4 min read

Step-by-Step Guide to Implement Winston Logger in your Node.js Projects

“The only thing more satisfying than fixing a bug is reading the frustrated log messages that led you there.” This…
by Shivani Banke, on Apr 29, 2024 | 7 min read

Getting Started with GitHub Runners

Introduction In today’s fast-paced world of software development, automation is key to staying competitive. GitHub, a…
by Rahul Patil, on Apr 25, 2024 | 5 min read

Docker: Simplify , Scale & Secure

This blog will cover the foundational concepts of Docker layers, caching mechanisms, and Dockerfile optimization.…
by Sudeep Kulkarni, on Apr 24, 2024 | 6 min read

Securing and Rotating Secrets Easily with AWS Secrets Manager - Part 2

In Part 1, we discussed upon configuring AWS Secrets Manager, AWS Lambda, and Automatic Rotation for our Secret. We also…
by Saumitra Topinkatti, on Apr 22, 2024 | 10 min read

Securing and Rotating Secrets Easily with AWS Secrets Manager - Part 1

Automating Secret Rotation with AWS Secrets Manager Managing secrets has always been a significant aspect when deploying…
by Saumitra Topinkatti, on Apr 21, 2024 | 7 min read

TFTP: A Lightweight Protocol for File Transfer

TFTP protocol overview TFTP known as Trivial File transfer protocol is a simple file transfer protocol with features…
by Nimisha G J, on Apr 19, 2024 | 5 min read

Streamlining Raspberry Pi Deployment: A Guide to Automated Netbooting

In this blog, we’ll delve into automating the netbooting process using a bash script (pxeService.sh) and an address list…
by Rohit Nagmoti, on Apr 17, 2024 | 6 min read

Streamlining Raspberry Pi Deployment: A Deep Dive into PXE Boot Sequence

Understanding PXE Boot What is PXE Boot? The Preboot Execution Environment (PXE) specification describes a standardized…
by Rohit Nagmoti, on Apr 16, 2024 | 5 min read

Boost Your Productivity with Cron Jobs: What You Need to Know

In this article, tailored specifically for users of Unix-like systems such as Linux, we’ll explore everything you need…
by Shivani Banke, on Apr 15, 2024 | 9 min read

Understanding memory and swap usage in Linux

Introduction This blog will help you figure out how to check how much memory is left on your Linux machine. Knowing this…
by Nimisha G J, on Apr 15, 2024 | 4 min read

Building internal tooling in legacy systems

This article takes you through what it is like to build an internal tool while dealing with a lot of legacy systems…
by Abhishek Sangwan, on Apr 11, 2024 | 8 min read

Unleashing the Power of Streams in Java

Java Streams: A Paradigm Shift in Data Processing What are Streams? Imagine a lazy river carrying data elements one by…
by Rahul Patil, on Mar 5, 2024 | 7 min read

How TDD helps design and build better software?

Most of us think of TDD as a tool for software testing and verification. But if used effectively it is more than that.…
by Chetan Kothari, on Jan 18, 2023 | 4 min read

k3s cluster on Raspberry Pi’s

As a developer at Infraspec, I am responsible for managing internal tooling and ensuring the smooth operation of local…
by Rajat Tomar, on Jan 2, 2023 | 8 min read

Is DNS migration a tricky affair?

Never trust a friend who says DNS migration is easy. Your instinct says it’s easy, well don’t trust your instinct. In…
by , on Dec 15, 2022 | 7 min read

Office/Home Lab Internet Failover Setup

An overview of how to set up internet failover for an office or home lab. We started working out of our Infraspec office…
by Arihant Hirawat, on Dec 15, 2022 | 7 min read

Setting up Ingress on EKS

Note: Everything here applies to Amazon Elastic Kubernetes Service (EKS). If you are running on another cloud, on-prem,…
by Rajat Tomar, on Nov 30, 2022 | 7 min read

Container Networking Deep Dive - Part 3

In part 3 of this series, we will see how containers running on the host communicates with the outside world i.e., the…
by Arihant Hirawat, on Nov 21, 2022 | 3 min read

Container Networking Deep Dive - Part 2

In part 2 of this series, we will demystify how multiple containers running on the same host communicates with the host…
by Arihant Hirawat, on Nov 20, 2022 | 6 min read

Container Networking Deep Dive - Part 1

In part 1 of this series, we will demystify how a container communicates with the host and vice versa. Topics to be…
by Arihant Hirawat, on Nov 19, 2022 | 5 min read