I’ve been investigating a performance issue with a slow query that is generated by Entity Framework (9.x) running on a v15 SQL Server database. The query is pretty simple. It’s just selecting rows based on one or more values that are in an indexed string column. But when executed, it doesn’t appear that the index […] The post The Entity Framework: WHERE IN vs. OPENJSON Problem appeared first on Atomic Spin.| Atomic Spin
How to create a private on-demand PostgreSQL instance accessible only| /dev/posts/
近年来，时序数据的增长是 Data Infra 领域一个不容忽视的趋势。这主要得益于万物互联带来的自然时序数据增长，以及软件应用上云和自身复杂化后的可观测性需求。前者可以认为是对联网设备的可观测性，而可观测性主要就建构在设备或应用不断上报的指标和日志等时序数据上。 分析时序数据的演变史几乎是大数据分析演变史的复现，即一开始都是把数据存在关系型数据...| 夜天之书
Spatial Joins in DuckDB Extremely detailed overview by Max Gabrielsson of DuckDB's new spatial join optimizations.Consider the following query, which counts the number of NYC Citi Bike Trips for each of the neighborhoods defined by the NYC Neighborhood Tabulation Areas polygons and returns the top three: SELECT neighborhood, count(*) AS num_rides FROM rides JOIN hoods ON ST_Intersects( rides.start_geom, hoods.geom ) GROUP BY neighborhood ORDER BY num_rides DESCLIMIT3; The rides table contains...| Simon Willison's Weblog
So, you build a great predictive model. Now what? MLOps is hard. Deploying a model involves different tools, skills, and risks than model development. This dooms some data science projects to die on their creator’s hard drive. Tools like dbt and SQLMesh entered the scene to solve a similar problem for data analysts. These tools offer an opinionatee frameowrk for organizing multiple related SQL scripts into fully tested, orchestrated, and version conotrolled projects. Data analysts can deliv...| Emily Riederer
Alternate title: How do I tell how far I am on that command? This little command (frequently with a WHERE ... Continue reading| SQL Studies
SQLMesh is an open-source framework for managing, versioning, and orchestrating SQL-based data transformations. It’s in the same “data transformation” space as dbt, but with some important design and workflow differences. What SQLMesh Is SQLMesh is a next-generation data transformation framework designed to ship data quickly, efficiently, and without error. Data teams can efficiently run and […]| Confessions of a Data Guy
This month’s TSQL Tuesday invite is from my good friend, long standing MVP and community volunteer Taiob Ali – Taiob’s call is to blog on how AI, (the biggest invention since the internet, accordin…| Curious..about data
Postgres.ai team is proud to present version 0.5.0 of Joe bot, an SQL query optimization assistant|
I had been toying around with writing SQL code to redraft one of the most talent rich drafts in NBA history (my apologies to the 1984 and 2003 NBA drafts) and sharing the results on my YouTube chan…| Smoak Signals | Data Analytics Blog
Lee Markum, guest blogger, explains steps for selecting the right SQL Server expert, or consulting service, to meet your company's needs.| SQL Tailor Consulting
This article provides a hypothetical case study that walks readers through the process of a financial investigation in which the data extraction, analysis, and forensic reconciliation are integrated seamlessly by accounting and data experts who understand both sides of an investigation.| QuickRead | News for the Financial Consulting Professional
You know, after literally multiple decades in the data space, writing code and SQL, at some point along that arduous journey, one might think this problem would be solved by me, or the tooling … yet alas, not to be. Regardless of the industry or tools used, such as Pandas, Spark, or Postgres, duplicates are […] The post Duplicates in Data and SQL appeared first on Confessions of a Data Guy.| Confessions of a Data Guy
Squall is a SQLite viewer and editor that runs in your terminal. Squall is written in Python and uses the Textual package. Squall allows you to view and edit SQLite databases using SQL. You can check out the code on GitHub. Screenshots Here is what Squall looks like using the Chinook database: Command-Line Options Currently, there is […] The post Announcing Squall: A TUI SQLite Editor appeared first on Mouse Vs Python.| Mouse Vs Python
I am responding late to a T-SQL Tuesday invite from John Sterrett. John’s call is about various ways to grow young data community/speakers. I’m going to take a brief detour to talk abou…| Curious..about data
Hands-on guide to the upcoming SQL/PGQ graph syntax using a patched Postgres 18 beta.| Gavin Ray Blog
T-SQL Tuesday response: ways SQL professionals can grow the next generation of SQL professionals & speakers through personal connections.| SQL Tailor Consulting
In today’s rapidly evolving tech landscape, artificial intelligence (AI) is no longer a futuristic concept—it’s now a crucial part of how businesses manage data, streamline operations, and drive insights. SQL Server 2025, the latest version of Microsoft’s flagship database platform, is designed to be fully AI-ready, making it a key player in AI-driven business transformation. […] The post Why SQL Server 2025 Is AI-Ready with Microsoft Fabric—and How XTIVIA Can Help appeared first ...| XTIVIA Microsoft Solutions
Cloud SQL Server costs creeping up? Learn how to optimize performance and cut waste—read the blog to save your budget (and lunch money).| Virtual-DBA Remote DBA Services & Support - Certified Database Experts
Discover how Apache Iceberg, DuckDB, and open catalogs transform data lakes into powerful lakehouses. Learn to query S3 data with SQL interfaces.| Data Engineering Blog
En sistemas distribuidos que usan bases de datos relacionales como SQL Server, es común que múltiples hilos o procesos intenten leer y modificar simultáneamente la misma entidad. Este fenómeno se llama concurrencia y, lejos de ser un bug, es una consecuencia natural de los entornos altamente paralelos y asincrónicos.| JMFLORESZAZO
Andy Pavlo of the CMU Database Group is well known for saying that while NoSQL databases acquire cyclical popularity, all databases eventually iterate back to a SQL interface — it happened with MongoDB and Google’s BigTable for example.| Made by Mikal
Learn what the pros said about troubleshooting weird database problems in this T-SQL Tuesday Round Up by Joe Fleming.| SQL Tailor Consulting
Pierre Zemb personal blog| Pierre Zemb's Blog
Imagine you’re working with a table full of data – say, employee bonuses stored across five columns: bonus1, bonus2, bonus3, bonus4, and bonus5. Each row represents an employee, and the bonuses are scattered across these columns, with some entries missing (i.e., NULL). Your boss walks in and says, “I want all the actual bonus values … Continue reading Taming the Nulls: Column Shifting Values Left in SQL| Paulzip's Oracle Blog
Access Control Entries (ACEs) control which principals (users or roles) can access different resources, primarily network services, but also Oracle Wallets – which store credentials like private keys, certificates, and other sensitive data needed for secure communication and authentication. ACEs were introduced in Oracle Database 12c and supersede the older Access Control Lists (ACLs) by … Continue reading Script for Exporting Access Control Entries (ACEs)| Paulzip's Oracle Blog
Oracle’s JSON_TABLE provides a facility to un-nest arrays using the nested path clause, but if you try to use that with sibling arrays you can end up with unexpected results. In my previous post JSON Sibling Arrays – Without Ordinal Association, I covered the situation where sibling arrays have no connection through ordinal position, they … Continue reading JSON Sibling Arrays – With Ordinal Association| Paulzip's Oracle Blog
Oracle’s JSON_TABLE provides a facility to un-nest arrays using the nested path clause, but if you try to use that with sibling arrays you can end up with unexpected results. Sibling arrays here mean separate arrays, but at the same level under the same parent object. There are two types of sibling array scenarios: 1. … Continue reading JSON Sibling Arrays – Without Ordinal Association| Paulzip's Oracle Blog
Oracle’s TO_CHAR function can convert a decimal into Roman Numerals, for example : The format model ‘FMRN‘ is made up of two parts, FM = Fill Mode, this modifier suppresses whitespace padding in the return value.RN = Roman numerals (upper case). You can use rn for lower case Roman Numerals. However, Oracle doesn’t have a … Continue reading Converting Roman Numerals to Decimal| Paulzip's Oracle Blog
Someone on the Oracle Community forum asked “Is there a way to parse unknown depth level of nested json?”. In other words, if you had a JSON structure which kept nesting data to an unkn…| Paulzip's Oracle Blog
Lately, I had to deal with a timestamp value with an overly long sequence of decimal digits, coming as a string in ISO 8601 format : 1970-01-04T15:20:34.49899986153468675 The goal was to build an Oracle TIMESTAMP instance from this lexical representation, but rounded to 3 decimal places : 1970-01-04 15:20:34.499 In SQL, when we already have … Continue reading Rounding Timestamp Values with Fractional Seconds| Odie's Oracle Blog
I don’t know – or remember – if this was ever qualified as a bug or an unimplemented feature, but starting with Oracle 18c, we are now able to make static references to pipelined table functions returning an ANYDATASET instance in PL/SQL. This enhancement comes together with the release of Polymorphic Table Functions (PTF) in … Continue reading Oracle 18c : PL/SQL support for pipelined table functions returning ANYDATASET| Odie's Oracle Blog
These days, I am looking into the latest additions to SODA in Oracle Database 18c, in particular the REST implementation available via Oracle REST Data Services (ORDS) : SODA for REST. I wrote once…| Odie's Oracle Blog
SQL Server Transactional Replication Part 2, Setup and Initialization Complications This is part 2 in a series on SQL Server transactional replication. Read Part 1, Introduction and Basics if necessary. You’ve examined all the options and have decided that Microsoft SQL Server transactional replication is the solution to your problem. Congratulations! Also, my condolences. While […]| SQL Tailor Consulting
SQL Server Transactional Replication: Part 1, Introduction and Basics “I want to look at my data, and I want to look at it IN REAL TIME!” No matter how irrational or unreasonable this request is, it’s a very common one in today’s tech world. It often leads to a lot of pain as business users […]| SQL Tailor Consulting
5 Things Your Database Administrator Wishes You Knew In the business of database management, or any IT role, there is a lot that customers just don’t know. There are also many expectations they have that are unrealistic. If you’re working with a DBA, you can short-circuit a lot of problems and get to the solution […]| SQL Tailor Consulting
NOLOCK is not the devil. Wow, that felt weird to say. The subject of NOLOCK hints (also known as the Read Uncommitted isolation level in SQL Server) is one that can spark very heated arguments. The arguments typically revolve around concurrency — how many processes can simultaneously access your data at once — and data reliability […]| SQL Tailor Consulting
Databricks has a new feature called SQL Pipeline Syntax. What is it and when to use it?| The Anttidote
A while ago I published sql-workbench.com and the accompanying blog post called "Using DuckDB-WASM for in-browser Data Engineering". The SQL Workbench enables its users to analyze local or remote data directly in the browser. This lowers the bar rega...| tobilg.com
Introduction DuckDB, the in-process DBMS specialized in OLAP workloads, had a very rapid growth during the last year, both in functionality, but also popularity amongst its users, but also with developers that contribute many projects to the Open Sou...| tobilg.com
Using AWS Serverless services and DuckDB as near-realtime Data Lake backend infrastructure| tobilg.com
A discussion on techniques available to overcome semantic errors in syntax when generating dialect-specific SQL| Gavin Ray Blog
Maybe you’re luckier than me. Maybe you’ve never opened a .sql file or an Airflow DAG only to be greeted by a 5,000+ line query…a true monster of a script that leaves you wondering where to begin. I’ve seen plenty of these, and every time, I ask myself: Why in the world do these exist? And, more… Read more| Seattle Data Guy
With the announcement of SQL Server 2025 Public Preview, hopefully you are interested in test driving Vector Search. Microsoft has already posted demo code, but it’s only for OpenAI on Azure.…| Every Byte Counts
One practical use-case for using large language models in network operations is to help query large datasets of network telemetry faster and more easily by using natural language. This can improve NetOps and facilitate better data-driven insights for engineers and business leaders. However, the volume and nature of the data types we commonly utilize in... Continue Reading →| {networkphil}
A follow-up exploration into PostgreSQL CTE materialization, diving deeper into why non-idempotent subqueries can execute multiple times, leading to unexpected results.| Shayon Mukherjee
tSQLike is my Python 3 module to work with tabular data using SQL approach with such “primitives” as “select” or “join”. The idea was to make the library small and useful, while for the rest of tasks you can still … Continue reading →| #define me human
All you need to know to execute native SQL statements with Hibernate, handle the query result and avoid common performance pitfalls.| Thorben Janssen
TL;DR ; This post shares a quick experiment I ran to test how effective (or ineffective) small language models are at generating SQL from natural language questions when provided with a well-defined semantic model. It is purely an intellectual curiosity; I don’t think we are there yet. Cloud Hosted LLMs are simply too good, efficient, … Continue reading "A Non-scientific Benchmark of Text-to-SQL using Small Language Models"| Small Data And self service
Note: The blog and especially the code were written with the assistance of an LLM. TL;DR I built a simple Fabric Python notebook to orchestrate sequential SQL transformation tasks in OneLake using …| Small Data And self service
How a seemingly straightforward DELETE query using a CTE and LIMIT returned more rows than expected due to query planner optimization.| Shayon Mukherjee
This is more or less the industry consensus on how a Lakehouse architecture should look in 2025. By now, it’s become clear that Parquet is the de facto standard for storing data, and using an object store to separate storage from compute makes a lot of sense. Another interesting development is how vendors want to … Continue reading "An Excel User’s Perspective on Lakehouse Architecture"| Small Data And self service
🌟 Introduction While testing the DuckDB ODBC driver, which is getting better and better (not production ready but less broken compared to two years ago), I noticed something unexpected. Running que…| Small Data And self service
A few forward looking SQL dialects have started introducing lambda expressions to be used with functions operating on arrays| Java, SQL and jOOQ.
Photo by Kvistholt Photography on Unsplash It is common to run some commands via the postgres account as it is the de facto PostgreSQL super user. This means that if you're running these commands remotely, you'll need to chain sudo: ssh pg-host sudo -i sudo -u postgres ... If you're in char| Ian's notes
Flexter guide to convert XML to SQL & Database online for free. No code. Supports XSD, Snowflake, ER diagrams, and source-to-target mapping.| Sonra
Kevin and I are| The Flerlage Twins: Analytics, Data Visualization, and Tableau
A SQL MERGE statement performs actions based on a RIGHT JOIN between target and source tables| Java, SQL and jOOQ.
I was asked to create an endpoint that gets an SQL query and replies with a JSON list of the results. The prototype was ready in 10 minutes:| BackSlasher
In my previous post, I tried to use views and macros together as an equivalent to parameterized views. Unfortunately, my generic macro can’t handle bind variables, which are crucial because i…| An Oracle Programmer
The article discusses the evolution of business intelligence (BI) tools, questioning their longevity compared to the enduring nature of spreadsheets. It highlights how spreadsheets facilitated decision-making in the past but have become inadequate as data complexity increased. The author envisions a future "Spreadsheets 2.0," integrating advanced features, better orchestration, and AI support to revitalize the role of spreadsheets in data workflows.| DataDuel.co
The database schema should be described as code, in your repository. And you should be able to semi-automatically update your database schema on new deployments. Now in Kotlin, with Gradle and Flyway.| Alexandru Nedelcu - Blog
Ever had the need to deliver messages on your queue at a certain timestamp in the future? Look no further, because your RDBMS can do it. This is part 1 of a series that builds a solution from scratch.| Alexandru Nedelcu - Blog
The database schema should be described as code, in your repository. And you should be able to semi-automatically update your database schema on new deployments.| Alexandru Nedelcu - Blog
Learn why articulating property relationships through Schema Markup and RDF is a cornerstone of effective SEO and AI readiness.| Schema App Solutions
Know the key differences between SQL and NoSQL with its advantages and disadvantages. Check the importance of SQL in a database management system| Web Solutions Blog
DTO projections are the most efficient ones for read operations. Let me show you how to use them in JPQL, Criteria and native queries. You can even use them without a DTO class| Thorben Janssen
If you’re a Tableau Cloud user, then| The Flerlage Twins: Analytics, Data Visualization, and Tableau
When using PostgreSQL with PostGIS, we can do various operations using polygons. In this article, we learn how to do that both through raw SQL queries and the Drizzle ORM. Storing polygons using the Drizzle ORM To store polygons using the Drizzle ORM, we use a custom data type and the [crayon-679ae68c520c4302843708-i/] table. database-schema.ts [crayon-679ae68c520c7894633936/] […] The post API with NestJS #185. Operations with PostGIS Polygons in PostgreSQL and Drizzle appeared first on Mar...| Marcin Wanago Blog – JavaScript, both frontend and backend
PostgreSQL, together with PostGIS, allows us to store various types of geographical data. Besides working with simple coordinates, we can also store entire areas in the form of polygons. In this article, we learn how to handle polygons with PostgreSQL and the Drizzle ORM. While Drizzle ORM does not support it out of the box, we […] The post API with NestJS #184. Storing PostGIS Polygons in PostgreSQL with Drizzle ORM appeared first on Marcin Wanago Blog - JavaScript, both frontend and back...| Marcin Wanago Blog – JavaScript, both frontend and backend
We use PostgreSQL with PostGIS and Drizzle ORM to calculate distances and find locations within a radius| Marcin Wanago Blog - JavaScript, both frontend and backend
I attended the PASS Data Community Summit held in Seattle in person this year after a long gap of 4 years and after RedGate software took over running the summit. The place I work at had stopped pa…| Curious..about data
JetBrains has published its 2025 plans for Rider, its cross-platform .NET IDE, including mixed mode debugging for .NET […]| DEVCLASS
StackOverflow, once the favoured destination of developers in search of coding help, is suffering from declining activity, with […]| DEVCLASS
Many applications rely on geographical data to calculate distances and track locations. PostgreSQL offers several ways to store geospatial data, each designed with different goals. In this article, we learn how to store coordinates when working with PostgreSQL and the Drizzle ORM. Latitude and longitude A coordinate consists of two numbers that pinpoint a location […] The post API with NestJS #182. Storing coordinates in PostgreSQL with Drizzle ORM appeared first on Marcin Wanago Blog - Jav...| Marcin Wanago Blog – JavaScript, both frontend and backend
TL;DR: SCCM maintenance tasks for WSUS no longer work if you are using WSUS with the Windows Internal Database (WID). When looking at the SCCM wsyncmgr.log, I noticed some SQL exceptions that […]| Out of Office Hours
AI tools like Codium's Windsurf IDE are reshaping coding practices through projects like updating a theme for Evidence.dev and developing a Terraform provider for MotherDuck. These experiences highlighted the strengths and limitations of AI in development, showcasing its potential as a collaborative partner despite issues with project understanding and syntax handling.| DataDuel.co
Thanks to Kevin Chant for inviting us to write this month’s T-SQL Tuesday. This month is special, as Kevin mentioned due to the Festive Tech Calendar, which I have been speaking about for a c…| Deepthi Goguri's SQL Server Blog
Performance matters! I decided to break down some quick tips to help you write faster, more efficient SQL queries. 1. Limit Your Use of SELECT * While SELECT * seems like a quick and easy solution,…| Smoak Signals | Data Analytics Blog
We learn what SQL migrations are and how to use them in a project with the Drizzle ORM and NestJS| Marcin Wanago Blog - JavaScript, both frontend and backend
Discover the best XML to Database Converter tools, learn XML to SQL mapping, automate the conversion to databases & tables, & optimise schemas with expert tips.| Sonra
In this blog post I am here to defend the art of working with SQL and show some appreciation for its talented practitioners. Here is my hot take, it can be very difficult to write …| Smoak Signals | Data Analytics Blog
Executive Summary Firmographic data, like industry classification, employee count, and location, is notoriously messy and challenging to analyze. Modern databases offer a unique opportunity to clean and maintain this data: by leveraging an LLM, you can synthesize industry information for your accounts directly within a SQL query. I recently took on exactly this challenge, so … Continue reading LLMs in SQL? A real-world application to clean up your CRM data The post LLMs in SQL? A real-world...| DataDuel.co
Uncover SQL visualisation techniques with query diagrams, ER diagrams, lineage, and tools to make complex SQL easy to understand.| Sonra
Learn Oracle SQL functions EXTRACT & EXTRACTVALUE for XML extraction with examples. A complete guide for XML querying & data retrieval.| Sonra
I’ve been planning to do this write-up for a while now, but I decided to wait for at least 40 days after reporting this bug before disclosing it, as it concerns the e-class software used by most universities in Greece. The bug reported here has indeed been fixed on the same day that I reported it, so the first part of this shouldn’t be possible anymore. I’m also glad to see my own university’s e-class has been updated to the latest version, which is safe against this. The e-class soft...| nikofil’s blog
For direct solution go to the end of this article| Franck RICHARD's Blog
We implement a polymorphic association using Drizzle ORM, PostgreSQL, and NestJS| Marcin Wanago Blog - JavaScript, both frontend and backend
I recently got to work on prototyping a small Django-based website that was somewhat like a message board. One of the features requested was allowing users to upload a profile picture, which necessitated storing said pictures somewhere. Django is very opinionated about storing such files in a filesystem, but I prefer storing them in a DB. Here are my reasons:| BackSlasher
We implement a full-text search in an app with PostgreSQL, NestJS, and the Drizzle ORM| Marcin Wanago Blog - JavaScript, both frontend and backend
Object Relational Mapping (ORM) is a technique used in creating a "bridge" between object-oriented programs and, in most cases, relational databases. Put another way, you can see the ORM as the layer that connects object oriented programming (OOP) to...| freeCodeCamp.org
2024 Thursday June 20th Meeting 6:30pm:8:30pm Location: American Red Cross 3131 N Vancouver Ave · Portland, OR Speaker: Paul Jungwirth I am so excited to announce that this month we have Paul presenting on temporal data. In this presentation, we’re … Continue reading →| PDXPUG
This post focuses on how Iceberg and MinIO complement each other and how various analytic frameworks (Spark, Flink, Trino, Dremio, and Snowflake) can leverage the two.| MinIO Blog
I have always recommended that if you develop SQL based analytics, you should have some understanding of indexes when it comes to speeding up queries. Sometimes we do not have access to create inde…| Smoak Signals | Data Analytics Blog
Over the years I have conducted a number of interviews with candidates who claimed to know SQL, but could not clearly verbalize their understand of some basic concepts. I want you to understand the…| Smoak Signals | Data Analytics Blog
Difference between SQL and NoSQL database. When to choose NoSQL over SQL. Decision tree to pick from RDBMS, key-value, wide column, document, graph dbs.| Machine Learning for Developers
Introduction In this blog, we’ll go over the different methods we can use to encrypt and decrypt data in a PostgreSQL database. Having some experience with Linux and PostgreSQL is necessary, while experience with encryption is not but is nice to have. This blog was written using PostgreSQL 16 running on Ubuntu 23.04. First I’ll| Highgo Software Inc. - Enterprise PostgreSQL Solutions
