Schema registry and validation in your own cloud account.
No third parties. Schema sits in your own cloud and object storage buckets and can never be accessed outside your cloud. WarpStream scales the metadata.
Validation works with any Kafka-compatible schema registry (like Confluent Schema Registry) as well as non-Kafka sources like AWS Glue.
Leverage S3-compatible object storage instead disks and zone-aware routing to avoid interzone networking fees.
Agents can read and write – no need to wait for leader election. No more ZooKeeper or backing topics.
Everything happens in the WarpStream Agent. Enable auto-scaling to seamlessly handle changes in schema-related workloads and use Agent Groups to isolate and scale clusters independently.
Don’t just validate IDs, validate records. Prevent malformed data from being ingested. Catch issues like missing fields and incorrect data types, and enable debugging and observability.
Use a warning-only configuration property to identify records instead of rejecting them to assist with testing and monitoring during schema migration and validation. No need to leverage dead-letter queues or risk data loss.
Don't see an answer to your question? Check our docs, or contact us directly.
WarpStream supports schema evolution, allowing multiple schema versions to coexist. Users can specify compatibility rules to govern schema updates.
Avro.
Any Kafka-compatible schema registries (like Confluent Schema Registry and WarpStream BYOC Schema Registry) and AWS Glue.