Part One: What Is a Log?

> A log is perhaps the simplest possible storage abstraction. It is an append-only, totally-ordered sequence of records ordered by time.

Part Two: Data Integration

> Data integration is making all the data an organization has available in all its services and systems.

Part Three: Logs & Real-time Stream Processing

Part Four: System Building

This short series of articles is going to show you how to stream data from a database (MySQL) into Apache KafkaTM and from Kafka into both a text file and Elasticsearch—all with the Kafka Connect API.
Why? To demonstrate how easy it is to integrate data from sources into targets, with no coding needed!

Watch this six-part series of online talks presented by Kafka experts. You will learn the key considerations in building a scalable platform for real-time stream data processing, with Apache Kafka at its core.
Needs registration

Slides from my @apachekafka #London meetup talk: How to implement a message queue on top of #Kafka?

This post covers how Apache Kafka and its Streams API are used for storing and processing all the articles ever published by The New York Times

Debezium is an open source distributed platform for change data capture.

No longer maintained, but the discussion is still interesting.

"This post attempts to illustrate the difficulty of performing an event-time join between two time series with a stream processing framework. It also describes one solution based on Kafka Streams 0.11.0.0.

An event-time join is an attempt to join two time series while taking into account the timestamps. More precisely, for each event from the first time series, it looks up the latest event from the other that occurred before it."