#346 — March 19, 2021

Read on the Web

Database Weekly

What Does a Database Administrator Actually Do? — Brent is a big name in the SQL Server world in particular so it’s neat to get some insights from him on the 20th anniversary of his popular site.

Brent Ozar

What’s New in SQLite 3.35 — Quite a lot, it turns out. I’m always inspired by not just how useful SQLite is but how actively developed it is too. 3.35 introduces a plethora of mathematical functions, the ability to drop columns on tables, materialized CTEs, and a RETURNING clause for returning useful values from DELETE, INSERT, and UPDATE queries. The official release notes are also available.

Anton Zhiyanov

An Operations-Free, Scalable & Flexible Postgres Alternative — Fauna combines the operational integrity and relational modeling of Postgres with an interface and architecture that fits better with modern app development in the cloud. The goodness of Postgres without its operational bottlenecks - Learn more about Fauna.

Fauna sponsor

Introducing Amazon S3 Object Lambda: Process Data During Retrieval — For S3’s 15th birthday it’s got a new feature! S3 Object Lambda seamlessly places Lambda functions in between S3 objects and whatever is requesting those objects so you can do processing and transformations on the fly. (This is basically an alternative approach to just using Lambda and working with S3 that way round.)

Danilo Poccia (AWS)

Amazon Makes ARM-Based Instances Generally Available for Aurora — AWS Graviton2 processors are ARM-based CPUs that are custom built by AWS themselves and seem to offer much improved performance at a lower cost (a la Apple and their new M1 chips). This announcement brings the perf and cost improvements to Amazon Aurora PostgreSQL (and MySQL) users.

Amazon Web Services

Quick Bits

  • Google Cloud Spanner has launched point-in-time recovery.
  • TerminusDB has closed a €3.6m seed round. TerminusDB is an upstart provider of an open source knowledge graph style database system.
  • AWS has a new EC2 X2gd instance type which gives you ARM-based Graviton2 power with up to 1TB of memory and 3.8TB of local NVMe storage. Good potential for data workloads here.

Tackling the Travelling Salesperson Problem with PostGIS and pgRouting — The Travelling Salesperson Problem is the problem of routing between a variety of points visiting each only once and in as short a distance as possible. This post tackles the problem in a PostGIS powered Postgres database using pgRouting’s extensions.

Florian Nadler

Building a Postgres-Backed “Data Lake” for Reporting Purposes — Most companies make data driven decisions and querying data warehouses (or ‘lakes’, when the data is less formally structured) is a common activity. This extensive tale covers how one company approached it using Postgres and FDWs in an intriguing manner.

Paul Bonaud

Guide for Windows Users: Tune PostgreSQL & EDB Postgres Advanced Server — Download this guide to get a set of recommendations to configure and tune PostgreSQL and EDB Postgres Advanced Server.

EDB sponsor

Export and Analyze Amazon DynamoDB Data in an Amazon S3 Data Lake in Parquet Format — The benefit of having data exported to S3 in Parquet format is it opens up a lot of extra analytical possibilities such as with Athena, Redshift, SageMaker or local big data tools of your choosing.

Ali and Mandal (AWS)

How to Inspect Redis Commands with MONITOR — Take a look at a live log of all commands run on your Redis server.

thoughtbot

Analyzing Python Package Downloads in BigQuery — Dig into trends in Python package downloads with BigQuery’s new public dataset.

Leigha Jarett (Google)

Uber's Journey Toward Better Data Culture From First Principles
Krishna Puttaswamy (Uber)

Performance Differences Between Postgres and MySQL
Blessing Krofegha

💻 Jobs

Splitgraph is Hiring Postgres Experts to Help Build a Data Mesh — Join our all-remote team. We're building a unified data platform on Postgres — a single interface to query and discover data.

Splitgraph

Senior Software Engineer — Remote Senior Software Engineer for a software consultancy company based in NYC.

Def Method

🛠 Projects and Tools

sql.js 1.5: A Library to Run SQLite on the Web — This brings things up to SQLite 3.35.0 standards (a pretty big release).

SQL.JS

SQLAlchemy 1.4.0: The Python SQL toolkit and Object Relational Mapper

Mike B

SQL Forever: A Prepopulated Playground for SQL Experimentation — This site lets you run queries against several preloaded relational datasets. All the data sets are open source. Designed for educational purposes.

Shahbaz

Creating an Excel Add-in in D
Jonathan Harring