---
title: "New databases and the biggest releases of 2017"
publication: "DB Weekly"
issue: 185
published_at: "2017-12-22"
canonical_url: "https://dbweekly.com/issues/185"
---

Database Weekly 185   

This week's database news -[Read this on the Web](http://dbweekly.com/issues/185) 

[Database Weekly](http://dbweekly.com) Issue 185 — December 22, 2017         

**In this final issue of 2017, we're looking back at what new database systems were released, the best case studies/stories, and the biggest releases of 2017.** We'll be back on January 12, 2018 - thanks for your support and we hope you have a happy holiday season! :-) Roundups 

[DB-Engines Popularity Ranking of Database Systems](https://db-engines.com/en/ranking) — Since December 2016, PostgreSQL, Elasticsearch, MariaDB, and Azure Cosmos DB have shown the biggest gains. Oracle, MySQL, SQL Server have had the biggest falls relatively, but still top the chart. DB-Enginesnews 

[Developers' Most Loved, Dreaded, Wanted and Used Databases](https://stackoverflow.com/insights/survey/2017/#technology-most-loved-dreaded-and-wanted-databases) — Insights from 64,000 developers who took Stack Overflow’s latest survey show Redis, Postgres, and Mongo as the ‘most loved’ databases, Oracle the most dreaded, but MySQL and SQL Server the most used overall. Stack Overflownews 

[MySQL Replication Tutorial For Disaster Recovery](https://www.engineyard.com/blog/mysql-replication-tutorial-for-disaster-recovery) — This blog post is a step by step tutorial on how to set up MySQL Replication between AWS regions. This is an essential part of our disaster recovery plan at Engine Yard. A previous [blog post](https://www.engineyard.com/blog/disaster-recovery) gives a higher level overview on disaster recovery. Engine Yardsponsored — [![\](https://copm.s3.amazonaws.com/f9889163.jpg)](https://www.engineyard.com/blog/mysql-replication-tutorial-for-disaster-recovery) 

[A Comparison of Advanced, Modern Cloud Databases](https://brandur.org/cloud-databases) — A non-exhaustive primer of modern cloud database solutions like Aurora, Cosmos, and Spanner. Brandur Leachopinion 

[A Look at the Graph Database Landscape](https://www.datanami.com/2017/11/30/look-graph-database-landscape/) — Graph databases are the fastest growing category in all of data management, according to DB-Engines.com. Datanaminews Big Releases 

[PostgreSQL 10 Released](https://www.postgresql.org/about/news/1786/) — The popular open source database includes native logical replication, declarative table partitioning, and improved query parallelism. [More on what’s new here](https://wiki.postgresql.org/wiki/New_in_postgres_10). Postgres.​orgnews 

[MongoDB 3.6 Released: Security, Robustness and JSON Schema](https://www.mongodb.com/blog/post/announcing-mongodb-36) — A new version of the popular NoSQL database: better hardened against network outages with ‘Retryable Writes’, as well as against ransomware by only binding to localhost by default. It now also supports JSON Schema for data validation. MongoDBnews 

[See What's New in MongoDB 3.6](https://www.mongodb.com/mongodb-3.6?jmp=cpress&utm_campaign=WW_CP_newsletter_sponsorship_FY17Q4&utm_content=sponsored&utm_medium=display&utm_source=dbweekly1222) — Read the guide or try 3.6 right away. mongodbnews sponsored — [![\](https://copm.s3.amazonaws.com/5b9edece.png)](https://www.mongodb.com/mongodb-3.6?jmp=cpress&utm_campaign=WW_CP_newsletter_sponsorship_FY17Q4&utm_content=sponsored&utm_medium=display&utm_source=dbweekly1222) 

[Redis 4.0 Released](https://groups.google.com/d/msg/redis-db/5Kh3viziYGQ/58TKLwX0AAAJ) — The popular data structure server took a step forward with several key improvements including a new replication engine and official support for modules. Salvatore Sanfilippotools 

[SQL Server 2017 Released: What's New?](https://docs.microsoft.com/en-us/sql/sql-server/what-s-new-in-sql-server-2017) — A look at the year’s big SQL Server release with new features from Python support to adaptive query optimization and a built-in graph database. Microsoft 

[Elasticsearch 6.0.0 Released](https://www.elastic.co/blog/elasticsearch-6-0-0-released) — The popular full-text search-oriented database gains zero downtime upgrades, faster restarts, faster query times, and more. The new version is based on Lucene 7. Clinton Gormleynews 

[Apache Kafka Goes 1.0](https://www.confluent.io/blog/apache-kafka-goes-1-0/) — Billing the popular event streaming platform ‘enterprise capable’, its creators reflect on its history and feature set. Confluentnews 

[BigchainDB 1.0: A Scalable Blockchain Database](https://blog.bigchaindb.com/bigchaindb-version-1-0-released-932bee682266) — [BigchainDB](https://www.bigchaindb.com/) is a decentralized database with blockchain characteristics, at scale. [GitHub repo.](https://github.com/bigchaindb/bigchaindb) Tim Daubenschütznews 

[CockroachDB 1.0: A Production-Ready Go-Based SQL Database](https://www.cockroachlabs.com/blog/cockroachdb-1-0-release/) — One of the “NewSQL” generation of databases, CockroachDB is an open source, distributed SQL database designed for high availability. Spencer Kimballtools 

[MapD Open Sources Its GPU-Powered Database](https://www.mapd.com/blog/2017/05/08/mapd-open-sources-gpu-powered-database/) — Mark Litwintschik has also written a handy guide to [compiling MapD from source.](http://tech.marksblogg.com/compiling-mapd-ubuntu-16.html) MapD Blogstory Case Studies and Stories 

[Moving Yelp's Core Search to Elasticsearch](https://engineeringblog.yelp.com/2017/06/moving-yelps-core-business-search-to-elasticsearch.html) — A post mortem of Yelp’s successful migration to Elasticsearch from a custom system built on top of Lucene. Yelp Engineeringstory 

[$20 Free On A New Linode Account](https://welcome.linode.com/db-weekly/?utm_source=cooperpress&utm_medium=email&utm_term=db&utm_campaign=db-weekly-sponsored) — Linux cloud hosting starting at 1GB of RAM for $5/mo. Get $20 credit on a new account. Linode Cloud Hostingsponsored 

[Architecture of Giants: Data Stacks at Facebook, Netflix, Airbnb, and Pinterest](https://blog.keen.io/architecture-of-giants-data-stacks-at-facebook-netflix-airbnb-and-pinterest-9b7cd881af54?s=m3) — Simple event data infrastructure diagrams from several fast-scaling companies. Michelle Wetzlerstory 

[How Discord Stores Billions of Messages with Cassandra](https://blog.discordapp.com/how-discord-stores-billions-of-messages-7fa6ec7ee4c7#.j169uuvl7) — Discord is a popular chat system for gamers. They started out with MongoDB but here they explain why and how they moved to Cassandra, and how they dealt with garbage collection issues. Stanislav Vishnevskiystory 

[A Look at Instapaper's Outage Cause and Recovery Process](https://medium.com/making-instapaper/instapaper-outage-cause-recovery-3c32a7e9cc5f) — Bookmarking service Instapaper experienced a 30 hour outage. Here’s the story of how their MySQL database failed, why, and how it was resolved. Brian Donohuestory 

[PostgreSQL At 10TB and Beyond](https://www.youtube.com/watch?v=8mKpfutwD0U) — Chris Travers discusses what happens when managing over 10 terabytes of data in PostgreSQL. Does it scale and what kinds of problems need to be resolved? Chris Traversvideo 

[Building a New Database Management System in Academia](http://www.cs.cmu.edu/~pavlo/blog/2017/03/building-a-new-database-management-system-in-academia.html) — Andy Pavlo of Carnegie Mellon University explains why his group had to build a new database system ([Peloton](http://pelotondb.io/)) rather than use an existing one. Andy Pavlostory 

[Writing a Time Series Database from Scratch](https://fabxc.org/blog/2017-04-10-writing-a-tsdb/) — [Prometheus](https://prometheus.io/) is an open source monitoring tool that includes a custom time series database. This is a deep dive into fleshing out a new architecture to address the existing database engine’s shortcomings. Fabian Reinartztutorial 

[Elasticsearch Cluster Lifecycle at eBay](http://www.ebaytechblog.com/2017/04/12/elasticsearch-cluster-lifecycle-at-ebay/) — A look at some of what’s involved with streamlining the rollout and management of Elasticsearch clusters. Sudeep Kumarstory 

[Publishing with Apache Kafka at The New York Times](https://www.confluent.io/blog/publishing-apache-kafka-new-york-times/) — How Apache Kafka and its Streams API are used for storing and processing all the articles published by the NYT. Boerge Svingenstory New Database Systems 

[Timescale: An Open Source Time-Series Database](http://www.timescaledb.com/) — SQL made scalable for time-series data. It’s Postgres compatible and optimized for fast ingest & complex queries. Timescale 

[Microsoft Unveiled Azure Cosmos DB, A New Multi-Model DB](https://docs.microsoft.com/en-us/azure/cosmos-db/introduction) — An Azure-based globally-distributed multi-model database built for low latency, elastic scalability, and high availability. Microsofttools 

[Cloud Spanner: A Global Database Service from Google](https://cloudplatform.googleblog.com/2017/02/introducing-Cloud-Spanner-a-global-database-service-for-mission-critical-applications.html) — A globally-distributed relational database service with ACID transactions and SQL semantics. [WIRED’s writeup](https://www.wired.com/2017/02/spanner-google-database-harnessed-time-now-open-everyone/) gives the bigger picture of why this was a big deal. Googlenews 

[YugaByte: A New Open Source, Cloud-Native Database](https://blog.yugabyte.com/yugabyte-has-arrived-fa1be31aa57b) — From the team that built Facebook’s internal NoSQL platform comes a new database for mission-critical applications which supports both the Cassandra and Redis APIs. [GitHub repo.](https://github.com/yugabyte/yugabyte-db) YugaByte Blognews 

[RocksDB: A Persistent Key-Value Store for Flash and RAM Storage](https://github.com/facebook/rocksdb) — From Facebook came a library forming the core of a fast memory-based key-value store. Facebooktools 

[Peloton: The Self-Driving Database Management System](http://pelotondb.io/) — An in-memory, DRAM/NVM optimized, relational database management system designed with autonomous operation and optimization in mind. Carnegie Mellon University Database Grouptools 

[JanusGraph: An Open-Source, Distributed Graph Database](https://github.com/JanusGraph/janusgraph) — A highly scalable transactional graph database optimized for storing and querying large graphs with billions of vertices and edges distributed across a multi-machine cluster. JanusGraphtools 

[AgensGraph: A Transactional Graph Database based on Postgres](https://github.com/bitnine-oss/agensgraph) — An open source, multi-model database which supports both relational and graph-based data models, even supporting both SQL and openCypher within the same query. bitnine 

[GryadkaJS: A Paxos-Based Replicated Key/Value Layer On Top of Redis](https://github.com/gryadka/GryadkaJS) — Gryadka is a minimalistic Paxos-based master-master replicated consistent key/value layer on top of multiple instances of Redis. Denis Rystsovtools 

[Tarantool: The Good, The Bad and The Ugly](https://medium.com/@Vadim.Popov/tarantool-the-good-the-bad-and-the-ugly-1be5c5e04dd3) — A practical demonstration of [Tarantool](https://tarantool.org/), an open source in-memory NoSQL database and Lua app server. Vadim Popovstory 

[PumpkinDB: An Event Sourcing DB Engine That Doesn't Overwrite Data](http://pumpkindb.org/) — A compact event sourcing database, featuring on-disk storage, flexible approach to event structure & encoding, sophisticated event indexing and querying. Open source, written in Rust. pumpkindb.​orgtools 

[GeoMesa: An Open-Source Spatio-Temporal Database Layer](http://www.geomesa.org/) — GeoMesa provides spatio-temporal indexing on top of Accumulo, Bigtable, and Cassandra, as well as near real-time stream processing and spatial semantics on top of Kafka. The GeoMesa Projecttools 

[Badger: A High-Perf Key/Value Storage Engine](https://open.dgraph.io/post/badger/) — An embeddable, persistent, simple and fast key-value store, written natively in Go. [GitHub repo.](https://github.com/dgraph-io/badger) Dgraphcode 

[TigerGraph Emerges with Native Parallel Graph Database](https://www.datanami.com/2017/09/19/tigergraph-emerges-native-parallel-graph-database/) — A startup named TigerGraph has emerged from stealth with a new native parallel graph database its founder thinks can shake up the analytics market. Alex Woodiestory 

[ProfaneDB: A Protocol Buffers Database](http://profanedb.gitlab.io/) — Based on RocksDB and can be used with any language that supports gRPC. Giorgio Azzinnarocode 

[TiDB 1.0: A Distributed NewSQL Database for Analytics](https://pingcap.github.io/blog/2017/10/17/announcement/) — An open source distributed Hybrid Transactional/Analytical Processing (HTAP) database written in the Go language. PingCAPnews 

[TileDB: A Multi-Dimensional Array Data Management System](http://www.tiledb.io/) — A database that started life at MIT and Intel that’s designed for storing massive dense and sparse multi-dimensional array data. TileDB, Inc.​ tools 

[Amazon Aurora Serverless: Databases on Demand](https://aws.amazon.com/blogs/aws/in-the-works-amazon-aurora-serverless/) — Aurora is AWS’s MySQL- and Postgres-compatible scalable database service and they’re now working on a pay-as-you-go variant for highly variable workloads. Amazon Web Servicesnews 

[Hello Memgraph: A Real-Time Transactional Graph Database](https://blog.memgraph.com/hello-memgraph-44f51032434a) — Designed for the ‘artificial and machine intelligence’ era, Memgraph is focused on speed and scale and is available in an early access ‘Community Edition’. Dominik Tomicevictools 

[Amazon Neptune: A Fully Managed Graph Database Service](https://aws.amazon.com/blogs/aws/amazon-neptune-a-fully-managed-graph-database-service/) — A big week for graph databases, it seems, as Amazon announces a new graph database service for AWS users. Amazon Web Servicesnews        

Database Weekly is curated by Peter Cooper [Read this issue on the Web](http://dbweekly.com/issues/185) [See our archives](http://dbweekly.com/issues) [Change your email address](*|UPDATE_PROFILE|*)  [Stop getting this newsletter](*|UNSUB|*)  

Published by [Cooperpress](https://cooperpress.com/)
Fairfield Enterprise Centre, Lincoln Way, Louth, LN11 0LS, UK