[EDA] Running a Local Kafka Cluster with SASL SCRAM Authentication (Docker Compose)

E2E testing is critical for validating production-ready applications. But how do you simulate a secure Kafka environment locally—especially with SASL authentication? This post demonstrates how to spin up a Kafka cluster with both SCRAM-SHA-256 and SCRAM-SHA-512 using Docker Compose.

March 28, 2025 · 6 min · 1257 words · dingyu

[EDA] Kafka (MSK) Monitoring with Burrow Prometheus And Thanos

Still monitoring Kafka using only low-level Input/Output Bytes? Let’s build topic-level monitoring using Burrow, JMX, and Node Exporter.

March 21, 2025 · 8 min · 1665 words · dingyu

[EDA] Schema Registry

How can we ensure backward and forward compatibility for event schemas?

February 24, 2025 · 4 min · 807 words · dingyu

[EDA] Flink Dynamic Job Case Study

Do we really need to redeploy the job every time the policy changes? A deep dive into executing Flink jobs dynamically.

December 6, 2024 · 4 min · 703 words · dingyu