kafka   4661

« earlier    

The Log: What every software engineer should know about real-time data's unifying abstraction | LinkedIn Engineering
Part One: What Is a Log?

> A log is perhaps the simplest possible storage abstraction. It is an append-only, totally-ordered sequence of records ordered by time.

Part Two: Data Integration

> Data integration is making all the data an organization has available in all its services and systems.

Part Three: Logs & Real-time Stream Processing

Part Four: System Building
3 days ago by mafredri
The Simplest Useful Kafka Connect Data Pipeline In The World (Part 1)
This short series of articles is going to show you how to stream data from a database (MySQL) into Apache KafkaTM and from Kafka into both a text file and Elasticsearch—all with the Kafka Connect API.
Why? To demonstrate how easy it is to integrate data from sources into targets, with no coding needed!
kafka  MySQL  tutorial  blog  RobinMoffat  2017 
3 days ago by dlb
Apache Kafka Online Talk Series
Watch this six-part series of online talks presented by Kafka experts. You will learn the key considerations in building a scalable platform for real-time stream data processing, with Apache Kafka at its core.
Needs registration
kafka  video  tutorial  introduction 
3 days ago by dlb
Kafka as a message queue
Slides from my meetup talk: How to implement a message queue on top of ?
Kafka  London  from twitter_favs
4 days ago by romac
Publishing with Apache Kafka at The New York Times | Confluent
This post covers how Apache Kafka and its Streams API are used for storing and processing all the articles ever published by The New York Times
4 days ago by pks
Debezium is an open source distributed platform for change data capture.
Kafka  postgres 
4 days ago by andrewrjones
Svend Vanderveken - Event time low-latency joins with Kafka Streams
"This post attempts to illustrate the difficulty of performing an event-time join between two time series with a stream processing framework. It also describes one solution based on Kafka Streams

An event-time join is an attempt to join two time series while taking into account the timestamps. More precisely, for each event from the first time series, it looks up the latest event from the other that occurred before it."
Kafka  Development 
6 days ago by jonchambers

« earlier    

related tags

!rl  2017  apache.kafka  apache  apache_kafka  api  applications  architecture  article  authentication  avro  aws  big.data  bigdata  blog  blogged  cms  comparison  concentration  connector  cross-region  data  database  dataengineering  datascience  db  design  development  devops  distributed-systems  distributed.computing  distributed  distributedsystems  distsys  engine  etl  event_sourcing  events  eventsourcing  example  fast  fluentd  formation  framework  go  golang  hacker  heroku  ifttt  interesting  internet1.0  introduction  journalism  kappa  kinesis  kleppmann  ksql  lambda  library  linux  log.follower  log  logbased  logging  logs  london  messaging  microservices  monitoring  mq  mysql  nats  natsd  node  nyt  nytimes  operation  operations  opinion  ops  philosophy  pipeline  pipelines  pocket  postgres  presentation  processing  programming  publishing  pubsub  queue  queues  quickstart  rails  redux  reference  registry  robinmoffat  scalability  schema  sep17  servicebus  shh17  snowplow  software-architecture  software  sql  stack  storage  stream.processing  stream  streaming  streams  system-design  system  systemdesign  testing  toread  tr-2017-09  tutorial  video  web-publishing  web 

Copy this bookmark: