--- title: "Assessing your options for real-time message buses" publication: "DB Weekly" issue: 256 published_at: "2019-05-31" canonical_url: "https://dbweekly.com/issues/256" --- Wahoo, we're 2 to the power of 8 issues old. #256 — May 31, 2019 [Read on the Web](https://dbweekly.com/issues/256) Database Weekly [![\](https://res.cloudinary.com/cpress/image/upload/w_1280,e_sharpen:60/v1559243458/h9ezqffxvml6khgza6gw.jpg)](https://blog.twitter.com/engineering/en_us/topics/infrastructure/2019/metricsdb.html) [A Look at MetricsDB: A Time Series Database for Storing Metrics at Twitter](https://blog.twitter.com/engineering/en_us/topics/infrastructure/2019/metricsdb.html) — Twitter’s time series ingestion service is handling _83 million metrics a second_ and to scale into the future, they had to seek a new approach. MetricsDB, which went live in 2017, gives an overall cost reduction of 10x and latency by 5x compared to traditional key value stores. Satish Kotha and Ilho Ye (Twitter) ▶[An Introduction to GridDB: A Scalable In-Memory, NoSQL Time Series Database](https://www.youtube.com/watch?v=boAZXOSMY58) — GridDB ([homepage](https://griddb.net/en/), in case you find videos annoying) hit our radar [briefly in 2016](https://dbweekly.com/issues/94) but appears to have grown up somewhat into an interesting IoT-optimized time series database. It’s open source (AGPL licensed) with the [GitHub repo here](https://github.com/griddb/griddb_nosql). Fixstars Corporation [![\](https://copm.s3.amazonaws.com/f5f5f722.png)](https://studio3t.com/knowledge-base/articles/import-sql-database-to-mongodb/?utm_source=cooper&utm_medium=newsletter&utm_campaign=may31) [Studio 3T Makes SQL Migration to MongoDB, Powerfully Simple](https://studio3t.com/knowledge-base/articles/import-sql-database-to-mongodb/?utm_source=cooper&utm_medium=newsletter&utm_campaign=may31) — Now you can import an entire SQL database to MongoDB using Studio 3T and its new SQL Migration feature. Studio 3T sponsor [Links to 756 (and Counting) Interesting Datasets](https://docs.google.com/spreadsheets/d/1wZhPLMCHKJvwOkP4juclhjFgqIY8fQFMemwKL2c64vk/edit#gid=0) — This is a rather varied grab bag of delights from datasets of [every death in Tarantino movies](https://github.com/fivethirtyeight/data/tree/master/tarantino) and [cruise ship inspections](https://github.com/marks/cdc-cruise-ship-inspections) to [cricket scores](https://github.com/dwillis/toss-up) and [visitors to National Parks](https://irma.nps.gov/Stats/Reports/National). Data Is Plural [Assessing Your Options for Real-Time Message Buses](https://www.datanami.com/2019/05/28/assessing-your-options-for-real-time-message-buses/) — Modern real time data processing systems often rely on message buses with stream processing systems sat on top. This post rounds up some of the former, including Apache Kafka, RabbitMQ, and ActiveMQ. Datanami **IN BRIEF:** - 🌎 PostgreSQL 12 and PostGIS 3 have, apparently, finally [cracked the parallel spatial query execution problem.](https://postgresweekly.com/link/64403/web) - 😞 MapR, once a significant player in the Hadoop space, is reportedly [seeking a buyer to stay in business](https://www.datanami.com/2019/05/30/after-funding-falls-through-mapr-seeks-a-buyer-to-avoid-shut-down/) after a funding deal fell through. - Hacker News users came together to [discuss ways to represent a hierarchy](https://news.ycombinator.com/item?id=20027586) in an RDBMS. - Amazon RDS for SQL Server now [supports up to 100 databases per instance](https://aws.amazon.com/about-aws/whats-new/2019/05/amazon_rds_for_sql_server_increases/), up from 30 before. 💻 Jobs [Senior Site Reliability Engineer - Invoca (Santa Barbara, CA or Remote)](https://grnh.se/a93ae5e82) — Join our team of Operations Engineers deploying code to our production SaaS platform & public cloud infrastructure multiple times per day. Invoca [Find a DB Job on Vettery](https://www.vettery.com/tech?utm_source=newsletter&utm_medium=cooper-dbweekly&utm_term=tech&utm_content=grouped&utm_campaign=ad-88878) — Vettery specializes in tech roles and is completely free for job seekers. Vettery 📒 Tutorials and Stories [Using Docker Hub's PostgreSQL Images](https://www.2ndquadrant.com/en/blog/using-docker-hub-postgresql-images/) — Very helpful advice if you want to use the Docker-hosted images to run up Postgres for things like CI jobs or development. Craig Ringer [Migrating Data from SQL to Dgraph, a Graph Database](https://blog.dgraph.io/post/migrating-from-sql-to-dgraph/) — [Dgraph](https://dgraph.io/) is an advanced graph database so the task of turning an SQL-oriented relational schema into something suitable is quite interesting. Lucas Wang [What Are All These Specialized Databases All About?](https://hubs.ly/H0h-XkJ0) — This article explores the tools developers and DBAs can use to deliver the insights their business stakeholders demand. Turbonomic sponsor [How to Automate Daily DevOps Database Tasks with Chef](https://severalnines.com/blog/how-automate-daily-devops-database-tasks-chef) — Translate your manual DBA tasks into an automated set of rules with Chef. Paul Namuag [How I Decimated the PostgreSQL Response Times for My SaaS](https://blog.checklyhq.com/how-i-decimated-postgres-response-times-for-my-saas/) — A tale of taking Postgres query response times from an average of ~100ms with peaks to 1 second to a steady 1-10ms. Tim Nolet [A Tale of SQL Query Optimization](https://parallelthoughts.xyz/2019/05/a-tale-of-query-optimization/) — _“We went from a query time of ~24 mins to 2 seconds, an extremely dramatic performance improvement”_ Manish Gill [The Polyglot Problem: Solving the Paradox of the 'Right' Database](https://www.datanami.com/2019/05/29/the-polyglot-problem-solving-the-paradox-of-the-right-database/) — One monolithic database can rarely address _all_ of an organization’s data requirements, so the idea of ‘polyglot persistence’ caught on.. but running multiple databases has a cost and downsides too. Max Neunhoeffer (ArangoDB) 🛠 Code and Tools [PugSQL: A Python Interface for Using Parameterized SQL from Files](https://pugsql.org/) — Define SQL queries in separate files and then use them on the fly from normal Python code. An interesting idea inspired by Clojure’s [HugSQL](https://www.hugsql.org/). PugSQL [test_db: A Sample MySQL Database with An Integrated Test Suite](https://github.com/datacharmer/test_db) — A sample database containing about 300,000 ‘employee’ records with 2.8 million salary entries. At 167MB it’s complex enough to be used for fair tests (or practicing your SQL!) without being overwhelming. Giuseppe Maxia [modssl: An SSL Module for Redis and KeyDB](https://github.com/JohnSully/modssl) — Any old-school Apache httpd users might bristle at the name, but this is an interesting attempt to promote the idea of bringing SSL to Redis and to expand the capabilities of Redis’s module API. John Sully MongoDB user? Check out [our MongoDB newsletter.](https://mongodb.email/) A **[Cooperpress](https://cooperpress.com/)** publication. [Change your email address](https://dbweekly.com/edit_subscription/*|UID|*) or[Stop getting this newsletter](https://dbweekly.com/leave/*|UID|*) © Cooper Press Ltd · Fairfield Enterprise Centre, Louth, LN11 0LS, United Kingdom