lbradstreet

When computers handle big life altering decisions in a company, there needs to be an override for humans to take over. Otherwise, well, they fire employees.

Running your Kafka deployment on Amazon EC2 provides a high performance, scalable solution for ingesting streaming data. To deploy Kafka on Amazon EC2, you need to select and provision your EC2 instance types, install and configure the software components including Kafka and Apache Zookeeper, and then provision the block storage required to accommodate your streaming data throughput using Amazon Elastic Block Store (EBS). To help your Kafka cluster manage unexpected events like spikes in data volumes above the stream's capacity, you can build replication using Apache Zookeeper, which keeps track of the nodes in your Kafka cluster and coordinates distribution of processes across the nodes. Once Kafka is installed, you will need to deploy HTTPS, maintain certificate authorities, and configure the Kafka instances for SSL to ensure the security of your Kafka cluster.

Schema Registry いいなぁ。

In this post, I am going to discuss Apache Kafka and how Python programmers can use it for building distributed systems.