jm + cbor + snappy   1

How Uber Engineering Evaluated JSON Encoding and Compression Algorithms to Put the Squeeze on Trip Data
Key conclusions:

Simply compressing JSON with zlib would yield a reasonable tradeoff in size and speed. The result would be just a little bigger, but execution was much faster than using BZ2 on JSON.
Going with IDL-based protocols, Thrift and Protocol Buffers compressed with zlib or Snappy would give us the best gain in size and/or speed.
compression  json  performance  python  serialization  protobuf  zlib  snappy  cbor  messagepack  thrift  bz2 
8 weeks ago by jm

Copy this bookmark: