This is a quick blog post to remind me how to connect Apache Flink to a Kafka topic on Confluent Cloud. You may wonder why you’d want to do this, given that Confluent Cloud for Apache Flink is a much easier way to run Flink SQL. But, for whatever reason, you’re here and you want to understand the necessary incantations to get this connectivity to work. There are two versions of this connectivity - with, and without, using the Schema Registry for Avro. MVP: Just connect to a Kafka topic; n...| rmoff's random ramblings
Not got time for all this? I’ve marked 🔥 for my top reads of the month :)| Interesting links - July 2025
ℹ️ For more in-depth notes on this subject, check out Alex Merced’s article.| Keeping your Data Lakehouse in Order: Table Maintenance in Apache Iceberg
Kafka Connect is a framework for data integration, and is part of Apache Kafka.| Writing to Apache Iceberg on S3 using Kafka Connect with Glue catalog
Not got time for all this? I’ve marked 🔥 for my top reads of the month :)| Interesting links - June 2025
I’m using Flink 1.20, since as of the time of writing (2025-06-24) the Iceberg connector doesn’t yet support Flink 2.0 (it’s due with Iceberg 1.10.0).| Writing to Apache Iceberg on S3 using Flink SQL with Glue catalog
After a week’s holiday ("vacation", for y’all in the US) without a glance at anything work-related, what joy to return and find that the DuckDB folk have been busy, not only with the recent 1.3.0 DuckDB release, but also a brand new project called DuckLake.| Digging into Ducklake
Not got time for all this? I’ve marked 🔥 for my top reads of the month :)| Interesting links - May 2025