PgDog Tackles Postgres Scaling Issues with Open-Source Solution
Startup PgDog has developed an open-source solution designed to address scaling limitations in Postgres databases. By adding a proxy, PgDog aims to enable horizontal scalability for massive datasets and high query loads, making Postgres a competitive alternative to NoSQL options for large-scale applications. The project reports significant adoption and query volumes.
Key points
- PgDog is an open-source project by a three-person startup aiming to make Postgres horizontally scalable.
- The solution uses a proxy to enable Postgres to handle 100 TB+ tables and over 1 million queries per second.
- PgDog claims to currently serve over 2 million queries per second across dozens of production deployments, sharding over 20 TB.
- The project has garnered over 1.4 million Docker pulls on GitHub and releases new versions weekly.
- Founder Lev Kokotov previously worked on scaling Postgres at Instacart to handle high-volume grocery order processing.
A new open-source project called PgDog is aiming to resolve long-standing scalability challenges associated with the popular Postgres database. The startup, founded by experienced infrastructure and application engineers, has developed a system that introduces a proxy layer to enable horizontal scaling.
PgDog's core proposition is to allow Postgres to efficiently manage datasets exceeding 100 terabytes and sustain query rates of over a million per second. This addresses a perceived limitation that has driven many large-scale applications to adopt NoSQL alternatives like MongoDB or DynamoDB. The project asserts that with PgDog, Postgres can become a viable, unified database solution for demanding workloads.
The developers report significant traction for their solution. PgDog claims to be actively serving more than two million queries per second across numerous production environments, managing over 20 terabytes of sharded data. The open-source nature of the project has contributed to its adoption, with over 1.4 million Docker pulls recorded on GitHub. The team is actively engaged with its growing community, offering support and releasing updates weekly.
Sources
The WireByte editorial team synthesises technology news from multiple primary sources, verifies the facts, and links every source. Articles are produced with AI assistance and reviewed under our editorial policy.