WarpStream Tableflow's architecture takes inspiration from React's virtual DOM, enabling exactly-once ingestion and millions of Iceberg updates per second while ensuring data lake correctness.
We originally launched our BYOC Schema Registry product with full support for Avro schemas. We’re excited to share that our Schema Registry now supports Protobuf schemas, with complete compatibility with Confluent’s Schema Registry.
We launched a new product called WarpStream Tableflow that is the easiest, cheapest, and most flexible way to convert Kafka topic data into Iceberg tables with low latency, and keep them compacted.
With WarpStream Multi-Region Clusters, we can now ensure that you will also be protected from region-wide cloud provider outages, or single-region control plane failures.
Disaster recovery and data sharing between regions are intertwined. We explain how to handle them on Kafka and WarpStream, as well as talk about RPO=0 Active-Active Multi-Region clusters, a new product that ensures you don't lose a single byte if an entire region goes down.
Excited about the recent 85% drop in S3 Express One Zone (S3EOZ) prices? We've supported S3EOZ since December 2024. This latest pricing update means our latency is 3x better at only a 15% higher TCO.
Distributed systems built on object storage all have one common problem: removing files that have been logically deleted either due to data expiry or compaction. We review the pros and cons of five ways to solve this problem.
Pprof is an amazing tool for debugging memory leaks, but what about when it's not enough? Read about how we used gcore and viewcore to hunt a particularly nasty memory leak in a large distributed system.