Storage Infrastructure Behind Facebook Messages
october 2011 by jm
HBase and Haystack; all data LZO-compressed; very interesting approach to testing -- they 'shadow the real production workload into the test cluster to test before going into production'. This catches a 'high percentage' of issues before production. nice
testing
shadowing
haystack
hbase
facebook
scalability
lzo
messaging
sms
via:james-hamilton
october 2011 by jm
Avoiding Full GCs in HBase with MemStore-Local Allocation Buffers
october 2011 by jm
Fascinating. Evading the Java GC by reimplementing a slab allocator, basically
memory
allocation
java
gc
jvm
hbase
memstore
via:dehora
slab-allocator
october 2011 by jm
Facebook's New Realtime Analytics System: HBase to Process 20 Billion Events Per Day
march 2011 by jm
Scribe logs events, "ptail" (parallel tail presumably) tails logs from Scribe stores, Puma batch-aggregates, writes to HBase. Java and Thrift on the backend, PHP in front
facebook
hbase
scalability
performance
hadoop
scribe
events
analytics
architecture
tail
append
from delicious
march 2011 by jm
Copy this bookmark: