Comments| Lobsters
CedarDB is a database system that delivers unmatched performance for transactions and analytics, from small writes to handling billions of rows. Built on cutting-edge research to power today’s tools and tomorrow’s challenges.| cedardb.com
Searchlight Cyber's Security Research team details a Novel Technique for SQL Injection in PDO's Prepared Statements.| Searchlight Cyber
Missing the Forest for the Sequence Trees.| lewiscampbell.tech
Learn how queues make horizontal scaling, scheduling, and flow control easier in cloud systems, and how to make them durable and observable.| www.dbos.dev
Your smart home devices generate vast amounts of scattered data. This tutorial will show you how to centralize this data The post Build a Complete Smart Home Monitoring System appeared first on The New Stack.| The New Stack | DevOps, Open Source, and Cloud Native News
When a single server hosts multiple WordPress installations under RunCloud, the efficiency of the object cache becomes a critical performance factor. Redis, when fine-tuned, can dramatically reduce MariaDB load and speed up dynamic content delivery. However, default configurations are often not tailored for environments with many sites and high traffic. This guide explains how to […]| System Administration
The oldest recorded transaction was in 3100 BC| avi.im
Use singular nouns for database table names| www.teamten.com
From Linux kernel code to AI at scale, discover Microsoft’s open source evolution and impact. The post Microsoft’s open source journey: From 20,000 lines of Linux code to AI at global scale appeared first on Microsoft Azure Blog.| Microsoft Azure Blog
DuckDB v1.3.0 significantly improved the scalability of geospatial joins with a dedicated SPATIAL_JOIN operator.| DuckDB
People of Pure: Meet Andrew Pruski and Anthony Nocentino, Microsoft MVPs and Customer Champions by Pure Storage Blog Meet Andrew Pruski and Anthony Nocentino, two Microsoft MVPs and Pure Storage architects, as they share their journey from community contributors to trusted advisors The post People of Pure: Meet Andrew Pruski and Anthony Nocentino, Microsoft MVPs and Customer Champions appeared first on Pure Storage Blog.| Pure Storage Blog
Accelerate SAP HANA on the Pure Storage Platform by Pure Storage Blog FlashArray//XL and FlashArray//X are fully TDI certified and help organizations prepare for modern SAP HANA workloads with performance at scale, speed up deployments, and reduce costs. The post Accelerate SAP HANA on the Pure Storage Platform appeared first on Pure Storage Blog.| Pure Storage Blog
Why do we use caches at all? Can databases fully replace them?| avi.im
В попередній частині – AWS: знайомство з OpenSearch Service в ролі vector store – подивились на AWS OpenSearch Service взагалі, трохи розібрались з тим, як в ньому організовані дані, що таке shards та nodes, і які нам власне типи інстансів для data nodes треба. Наступний крок – створити кластер і подивитись н...| RTFM: Linux, DevOps та системне адміністрування
Знайомство з AWS OpenSearch Service в ролі vector store для AWS Bedrock Knowledge Base та планування ресурсів OpenSearch кластеру| RTFM: Linux, DevOps та системне адміністрування | De...
Database migration is one of those tasks that can either go smoothly or turn into a nightmare depending on your preparation. If you're considering migrating from MySQL to PostgreSQL, you're making a smart choice – PostgreSQL offers superior data integrity, better JSON support, advanced indexing, and robust ACID compliance. However, the migration process requires careful planning and understanding of the differences between these two database systems. In this comprehensive guide, I'll walk y...| TechPlanet
Is SQLite durable by default? What settings guarantee durability? The documentation and even comments from its creator give conflicting answers.| www.agwa.name
---| www.canicula.com
Amazon Web Services and Microsoft will both work on the open source, document-oriented database system, per the annoucement at Open Source Summit Europe.| The New Stack
A NULL BITMAP guest post on loop parallelism transformations.| Transactional
The WITH Clause| sqlite.org
Object storage is the primary storage solution for OLAP databases. This survey highlights major database players that have embraced this movement.| MinIO Blog
And why I don't want my database to choose the best encoding for me (yet)| Discover the Performance Engineer in you. | Polar Signals
I spent some time before making Datalogs that translated into SQL. https://www.philipzucker.com/tiny-sqlite-datalog/| Hey There Buddo!
SQLite when used with WAL doesn’t do fsync unless specified.| avi.im
🚨TL;DR: If you are a SurrealDB user running any SurrealDB instance backed by the RocksDB or SurrealKV storage backends you MUST EXPLICITLY set SURREAL_SYNC_DATA=true in your environment variables otherwise your instance is NOT crash safe and can very easily corrupt. If you're familiar with Rust or| ChillFish8's Blog
As programmers we spend a lot of time shuttling data back and forth between different systems and transforming it from one format to another. Sometimes it gets pretty miserable!| sophiebits.com
Funny and weird behavior with modern SSD devices, and how it impacts query execution.| Tomas Vondra
L2AW| law-theorem.com
ISRAELI INTELLIGENCE IS USING Microsoft’s cloud service to store recordings and metadata from millions of intercepted telephone conversations placed by residents of Gaza and the West Bank, according to a new investigation.| intelNews.org
Dynamo, DynamoDB, and Aurora DSQL| brooker.co.za
$$ $$ Category theory often sheds light on old problems by redescribing them in a conceptually cleaner way, but it less frequently gets used to develop concrete algorithms for practical problems. In this post, the problem we address involves a query we care about: we want to maintain the answer set to some query (e.g. “how many paths of length two are there in this graph?”) when the thing being queried is changing frequently. If the changes are frequent enough, we don’t want to have to...| Topos Institute
Today, we’re excited to announce the private preview of the Postgres Change Data Capture (CDC) connector in ClickPipes! This enables customers to replicate their Postgres databases to ClickHouse Cloud in just a few clicks and leverage ClickHouse for ...| PeerDB Blog
Last month, we acquired PeerDB, a company that specializes in Postgres CDC. PeerDB makes it fast and simple to replicate data from Postgres to ClickHouse. A common question from PeerDB users is how to model their data in ClickHouse after the replicat...| PeerDB Blog
Providing a fast and simple way to replicate data from Postgres to ClickHouse has been a top priority for us over the past few months. Last month, we acquired PeerDB, a company that specializes in Postgres CDC. We're actively integrating PeerDB into ...| PeerDB Blog
We are thrilled to join forces with ClickHouse to make it seamless for customers to move data from their Postgres databases to ClickHouse and power real-time analytics and data warehousing use cases. We released the ClickHouse target connector for Po...| PeerDB Blog
At PeerDB, security has always been a top priority. Our customers trust us with their critical data, and we are dedicated to upholding the highest standards of data protection and security. We are excited to announce that PeerDB has achieved SOC 2 Ty...| PeerDB Blog
At PeerDB, we are building a fast and simple way to replicate data from Postgres to data warehouses like Snowflake, ClickHouse etc. and queues such as Kafka, Redpanda etc. We implement Postgres Change Data Capture (CDC) to reliably replicate changes ...| PeerDB Blog
Today, PeerDB is pleased to announce that our target connector for Elasticsearch is now in beta. Elasticsearch is a popular search engine system underpinned by a distributed document database, and we have been seeing a lot of use cases for Elasticsea...| PeerDB Blog
🚀 Today, we're excited to announce that PeerDB Cloud is officially entering public beta. If you're a data engineer or an organization looking for a fast, simple, and cost-effective way to replicate data from Postgres to data warehouses such as Snowf...| PeerDB Blog
pg_dump and pg_restore are reliable tools for backing up and restoring Postgres databases. They're essential for database migrations, disaster recovery and so on. They offer precise control over object selection for backup/restore, dump format option...| PeerDB Blog
PeerDB offers a fast and cost-effective way to move data from PostgreSQL to data warehouses, such as Snowflake, and to queues like Kafka. This enables businesses to have real-time and reliable access to data, which is of utmost importance in this AI ...| PeerDB Blog
Introduction Logical Replication is one of the many ways a Postgres database can replicate data to other Postgres database (a.k.a standby). Logical replication directly reads from the write-ahead log (WAL), recording every database change, avoiding t...| PeerDB Blog
At PeerDB, we are building a fast and a cost-effective way to replicate data from Postgres to Data Warehouses such as Snowflake, BigQuery, ClickHouse, Postgres and so on. All our customers run Postgres at the heart of the data stack, running fully ma...| PeerDB Blog
Inspired by the 1BR Challenge, I wanted to see how much it would cost to transfer 1 billion rows from Postgres to Snowflake. Moving 1 billion rows is no easy task. The process involves not just the transfer of data but ensuring its integrity, error r...| PeerDB Blog
This paper from SIGMOD 2016 proposes a transaction healing approach to improve the scalability of Optimistic Concurrency Control (OCC) in m...| muratbuffalo.blogspot.com
Zero-ETL search and analytics for Postgres| ParadeDB
Why build auth logic when your database can do it better? Learn how SQL Server user impersonation creates stronger security boundaries with less application complexity.| Alonso Network
Eliminating PostgreSQL catalog traversal overhead with local partition calculations for up to 20x faster hash partition queries.| Shayon Mukherjee
The data lake was once heralded as the future, an infinitely scalable reservoir for all our raw data, promising to transform it into actionable insights. This was a logical progression from databases and data warehouses, each step driven by the increasing demand for scalability. Yet, in embracing the data lake's| MinIO Blog
Frequent UC Davis users may have noticed in June 2025 that the database has a new look resulting from a migration to the new platform. This new upgraded environment is intended to improve the literature search experience. Users still have access to key features, including access to their search history, CINAHL subject headings, and reliable set of filters.| UC Davis Library
1 Background| jepsen.io
Contributed by SpiralDB, Vortex is an extensible, next-generation columnar storage format designed for building high-performance, future-proof data systems| www.linuxfoundation.org
Ryan and Eira welcome Erin Yepis, Senior Analyst at Stack Overflow, to the show to discuss the newly released 2025 Developer Survey results. They explore the decline in trust in AI tools, shifts in popular programming technologies, and the patterns Erin saw in salary growth among developers.| Stack Overflow Blog
GT2 Pro members, download a high-res version of this image that you can use royalty-free anywhere:| Good Tech Things
A tale of frustrated dreams, utopian user experiences and calculated tradeoffs.| paoramen
This EuroSys '23 paper reads like an SOSP best paper. Maybe it helped that EuroSys 2023 was in Rome. Academic conferences are more enjoyabl...| muratbuffalo.blogspot.com
NP-Incompleteness:| www.kuniga.me
I've been thinking lately about this piece from Frank Lantz about the Thielian "the Olympics, but you take performance-enhancing drugs." The pitch being...| buttondown.com
SQLite WAL has checksums, but on corruption it drops all the data and does not raise error| avi.im
This is a beginner’s guide to hacking into Turso DB (formerly known as Limbo), the SQLite rewrite in Rust. I will explore how to get familiar with Turso’s codebase, tooling and tests| avi.im
Discover how a pull‑based, demand‑driven pipeline maximizes throughput with back-pressure controls.| Sequin blog
Common Pitfalls and Potential Optimizations in Django| hakibenita.com
On trying to mash up SQLite with ideas stolen from Accountants, Clojure, Datomic, XTDB, Rama, and Local-first-ers, to satisfy Henderson's Tenth Law. Viz., to make a sufficiently complicated data system containing an ad-hoc, informally-specified, bug-ridden, slow implementation of half of a bitemporal database. Because? Because laying about on a hammock, contemplating hopelessly complected objects like Current Databases isn't just for the Rich man.| www.evalapply.org
A story about a bug with logical replication slot creation on Postgres read replicas| ClickHouse
The Lower Saxony State Criminal Police Office has analysed digital evidence from the alleged RAF militant Daniela Klette using artificial intelligence. This disruptive technology is reminiscent of BKA pioneer Horst Herold. In the 1970s, the then-President of the German Federal Criminal Police Office (BKA), Horst Herold, introduced electronic data processing. Since then, Germany has maintained […] Der Beitrag Commissioner Computer vs. Daniela Klette: Use of AI in RAF investigations raises qu...| Matthias Monroy
Before PostgreSQL 10, Postgres users partitioned their data using inheritance based partitioning. The method used constraints to define the partitions and rules or triggers to route the data to appropriate partition. A user had to write and maintain code for all that. PostgreSQL 10 introduced declarative partitioning, which is much easier to setup and requires almost no maintenance. PostgreSQL 11| Walking with the Elephants
PostgreSQL 10 is full with a lot of big, new and exciting features. Declarative partitioning is one of those. It is something users have wanted for years. During PGCon 2017, it was a hot topic of discussion. People wanted to know more about the feature, and were eager to try it out. The un-conference and conference session on partitioning attracted a large crowd. One of the frequently asked questions centred on whether a user can change partition bounds of an existing partition. This bears ex...| Walking with the Elephants
When implementing an optimization for derived clause lookup myself, Amit Langote and David Rowley argued about the initial size of hash tabl...| ashutoshpg.blogspot.com
Postgres LISTEN/NOTIFY can cause severe performance issues under high write concurrency due to a global lock during commit. Learn why it doesn't scale and how to avoid outages.| www.recall.ai
Bringing what we've learned to our next generation database.| Discover the Performance Engineer in you. | Polar Signals
How we designed our database for complete control over concurrency, time, randomness, and failure injection.| Discover the Performance Engineer in you. | Polar Signals
From BM25 to RAG: Everything I learned about vector databases, embedding models, and vector search - and everything in between.| Leonie Monigatti
Our specialist databases Eikon and Datastream are being upgraded to a new platform on 1 July 2025. Eikon will be rebranded as LSEG Workspace, with Datastream available via Excel as an add-on databa…| University of Glasgow Library Blog
Zero-ETL search and analytics for Postgres| ParadeDB
I've always been told that caching is a tool to make software faster. That, given some careful considerations to consistency, caching makes it so that when...| buttondown.com
An evaluation of how often Postgres picks the optimal plan for simple scan queries.| Tomas Vondra
A simple insert query turned into a silent performance killer. Our frontend pings our server every few minutes to track device activity. Each ping attempts to insert a row into a DevicePingDaily table, which has a unique constraint on (device_id, date) to ensure only one record per device per day. In Django, the logic looked like this: try: DevicePingDaily.objects.create(device=device, date=today) except IntegrityError: pass It seemed harmless. But as traffic grew, latency spiked and API time...| Johnny Metz
It’s been a while since SQL:2023 was published, and work on the SQL standard continues. Nowadays, everyone in the database field wants vectors, and SQL now has them, too.| Peter Eisentraut
Lessons from building a parser| Log Blog Kebab
If you've taken a calculus class your professor might have explained to you the idea of a monotone function, or (in one direction) a nondecreasing function....| buttondown.com
It seems to me that telescopes https://ncatlab.org/nlab/show/type+telescope , the dependently typed notion of context, is more central to the topic of dependent types than the dependent types are.| Hey There Buddo!
Today we'll explain how do modern databases allow us to perform backups without blocking - thus enabling users to operate on them while the backup is beign made continuously in the background. We'll also show how this approach allow us to restore database to any point| Bartosz Sypytkowski
I think ledgers are underutilized in software development today. Specifically, double-entry ledger modeling would be a better fit in a lot of systems than the ad-hoc ledger-ish things they currently have.| Paul Gross's Blog
I'm very excited to announce that I have recently joined Turso as a software engineer. For many in the field, including myself, getting to work on databases and solve unique challenges with such a talented team would be a dream job, but it is that much more special to me because of my unusual and unlikely circumstances. As difficult as it might be to believe, I am currently incarcerated and I landed this job from my cell in state prison. If you don’t know me, let me tell you more about how ...| turso.tech
rgSQL is a test suite to help you build your own database server as a learning project| technicaldeft.com
Databricks kicked off its user conference this week with a slew of announcements that put (agentic) AI at […]| DEVCLASS
We replaced the twoskip database format with something faster and better.| Fastmail
Pierre Zemb personal blog| Pierre Zemb's Blog
Benchmarking complex systems can be difficult. Here's a problem I'm currently investigating, possibly related to process scheduling.| Tomas Vondra
…even if none of my friends seem to think so. I’ve been off on a bit of a tangent recently. Its a slow burn tangent, that I am pretty sure was kicked off by this Geek Narrator podcast episode about the design of Turbo Puffer with Simon Eskildsen: The basic idea is that you can […]| Made by Mikal
In A Critique of Snapshot Isolation, published in EuroSys 2012, they present write-snapshot isolation, a simple but clever approach to making snapshot isolation serializable. This work was published a few years after Michael Cahill’s original work on Serializable Snapshot Isolation (TODS 2009), and around a similar time as the work of Dan Ports on implementing serializable snapshot isolation (VLDB 2012), which applied Cahill’s ideas in PostgreSQL.| William Schultz
In this article, we are going to show how to get started with Geospatial data in PostgreSQL. More specifically, we are going to learn how to store spatial information (e.g. Coordinates in a map) and how we can index and perform searches on this data (e.g. Find all coordinates inside a given area). Installing PostGIS PostGIS is an extension of standard PostgreSQL that allows us to work with geospatial data. This means, if the extension is not present, we won’t have these capabilities. To che...| ncona.com
Upload, index, and search 400M vectors with VectorChord and PostgreSQL. Includes hardware tips and search performance advice| VectorChord
Author: Alexey Makhotkin squadette@gmail.com, ~5400 words. This is the first public revision of this text. Early readers have shared encouraging feedback, but I’m sure there’s still room for improvement. I’m releasing it now to gather broader input from a wider audience. Problem Many times I’ve seen people asking for help with fixing some complicated SQL queries. A common scenario is that people try to solve the problem by using JOIN with multiple tables, sometimes with subqueries.| kb.databasedesignbook.com
