Redis Streams and the Unified Log — Brandur Leach


50 bookmarks. First posted by jkirkwood 10 days ago.


Redis Streams and the Unified Log — Brandur Leach
from twitter
8 days ago by espencer
Years ago an article came out of LinkedIn about the unified log, a useful architectural pattern for services in a distributed system share state with one another. In the log’s design, services emit state changes into an ordered data structure in which each new record gets a unique ID.
ifttt  tfav  twitter  getpocket 
9 days ago by linkt
Useful look at how to use redis for a unified transaction log
webdev  log_analysis 
9 days ago by amcewen
A Nov 2017 peek at using Redis as the log service in a CQRS architecture.
redis  kafka  logging  architecture  cqrs 
10 days ago by ivar
Redis Streams and the Unified Log — Brandur Leach
from twitter
10 days ago by wschenk
ather than emit directly to Redis, a “staged” record is created in Postgres. This indirection is useful so that in case the request’s transaction rolls back due to a serialization error or other problem, no invalid data (i.e. data that was only relevant in a now-aborted transaction) is left in the log. This principle is identical to that of transactionally-staged job drains, which do the same thing for background work.

The staged records relation in Postgres look like:

CREATE TABLE staged_log_records (
id BIGSERIAL PRIMARY KEY,
action TEXT NOT NULL,
data JSONB NOT NULL,
object TEXT NOT NULL
);
architecture  redis  logging  kafka  best 
10 days ago by hellsten
Architecture unifiedlog
10 days ago by amarandon
Years ago an article came out of LinkedIn about the unified log, a useful architectural pattern for services in a distributed system share state with one another. In the log’s design, services emit state changes into an ordered data structure in which each new record gets a unique ID.
IFTTT  Pocket 
10 days ago by deepblue