Kafka

Kafka is an open-source distributed event streaming platform used by companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.

With Kafka, you can ingest Superblocks logs and to stream them to your Observability vendor of choice to create monitoring, alerting, and analysis dashboard for Superblocks.

Send logs from Superblocks to Kafka

To send Superblocks logs to Kafka, you will need:

1. A Kafka cluster with a topic where you want to receive logs
2. (Optional) If using Superblocks Cloud, add Superblocks's IPs to your allowlist. This is not necessary for On-Premise-Agent

Set up Observability in Superblocks

1. Log in to Superblocks
2. Navigate to Organization Settings → Observability
3. Click the Kafka tile
4. Provide the following settings:

Setting	Description
Bootstrap Server	The Kafka server to connect to in the format <HOST>:<PORT>.
Topic	Kafka topic to send logs to.
SASL Username/Password	Follow the format <USERNAME>:<PASSWORD>. A username and password that can authenticate with the Kafka server. This uses the SASL/PLAIN authentication mechanism.

5. Click Create

success

You're done! The next time a user takes an action in Superblocks, you'll receive a copy of the log to your Kafka topic. Learn more about log types and schemas.