cal machine so you can work with a new repository? Is Docker hogging CPU and memory, killing the promise of all-day battery life? Sick of gigabyte image downloads consuming your mobile data plan? Are you having issues running Docker or Terraform on Apple silicon? Over dealing with machine-specific problems that
In the post, we will explore how we can use partitions to reduce job execution time by increasing parallelism. Specifically, we will focus on building Spark partitions from tables in a Postgres database. Spark is an analytics engine for processing large datasets. Spark allows you to process enormous datasets across
Aws-azure-login is a command-line utility for organisations using Azure Active Directory to authenticate users to the AWS console. It lets you use an Azure AD login (including MFA) from a command line to create a federated AWS session and places the temporary credentials in the proper place for the AWS
Overview My goal is to build a decent approximation of a production Apache Spark EMR environment for development and testing. For development, I need: * A Postgres database to persist datasets. * A Spark cluster with two worker nodes. * A Jupiter notebook server for prototyping. * To submit a PySpark job to the
Introduction Over the last couple of years, I've seen an upward trend in the number of internal git repositories organisations are managing. In the past organisations might create a handful of repositories aligned with each architectural layer, i.e. front end, backend, analytics and infrastructure. Today it'
Today I created a command-line tool for sending bulk SMS using Twilio. The utility lets you define a mustache template and provide a CSV file with matching columns for bulk SMS sends. Installation The utility requires python3.7 python -m pip install twilio_sendsms Setup The first time you run,
My raspberry PI project is a back to base add-on to a very old home alarm system. My goal is keep the existing panel functioning as is, extending its usefulness with the raspberry PI. My aim is to get PI to do the following for me: 1. Monitor each of
The following is my detailed guide to programming a spare key for an 07-08 CBR600RR. Please note this guide is only going to help if you have one working key. To add additional keys to your bike, you have two basic options: 1. Go to a locksmith purchase a replacement