asteroza + compression   156

KIP-110: Add Codec for ZStandard Compression - Apache Kafka - Apache Software Foundation
Apparently Cloudflare implemented this for big gains in reduced network traffic
kafka  Zstandard  ZSTD  compression 
march 2019 by asteroza
inikep/lizard: Lizard (formerly LZ5) is an efficient compressor with very fast decompression.
A fork/variant of LZ4 using interesting tricks. A codec now in Blosc2 when coupled with huffman encoding (and gives better than memcpy compression speeds at 4 threads!)
lizard  compression  codec  library  opensource  software 
march 2019 by asteroza
itty.bitty
making a microsite by compressing data and stuffing it into the URL directly. Up to 2K characters generally, some browsers allow up to 4K
small  tiny  website  URL  compression  portable  self  publishing  web 
july 2018 by asteroza
dropbox/divans: Building better compression together
Apparently the format supports seeks in 4mb chunks but the library doesn't do it natively yet
DivANS  compression  algorithm  ANS  Brotli 
june 2018 by asteroza
Building better compression together with DivANS | Dropbox Tech Blog
So another ANS approach like Zstd? But they seem to be splitting apart the problem differently...
DivANS  compression  algorithm  ANS  Brotli 
june 2018 by asteroza
Compression · facebook/rocksdb Wiki
Huh, so RocksDB has support for both LZ4 and ZSTD, both by Mr. Collet, who now works for Facebook...
ZSTD  Zstandard  LZ4  RocksDB  compression  database 
february 2018 by asteroza
ImminentFate/CompactGUI: Visual Interface for the Windows Compact.exe cmdlet
The new compact in windows 10 does special program/file compression using faster realtime codecs, and should be safe for 40GB files (unlike native NTFS compression which uses DEFLATE)
sysadmin  tools  utilities  compression  compact  windows  10  GUI  file  filesystem  realtime 
october 2017 by asteroza
Terark/terarkdb: TerarkDB is a high performance database with the best compression
interesting database using context aware compression with point accessible zip formatting to boost random reads, normally runs as a RocksDB compatible submodule/engine
china  dabatase  software  RocksDB  engine  compressed  data  compression  point  accessible  ZIP 
june 2017 by asteroza
DjVu.org - the premier menu for djvu resources
Alternative format for scanned documents, with capabilities similar to PDF.
djvu  scanned  document  digital  format  compression  PDF  alternative  software  opensource  Delicious 
march 2017 by asteroza
DataDog/zstd: Zstd wrapper for Go
go wrapper for zstandard compression, zstandard being the followon to LZ4
LZ4  zstandard  go  wrapper  compression  library  software  opensource  Delicious 
march 2017 by asteroza
Advanced CO2Compression with Supersonic Technology
Looks like Dresser-Rand is marketing RamGen CO2 supersonic rampressor work as DATUM-S compressor
ramgen  supersonic  CO2  compressor  ram  inlet  rotary  aerodynamics  research  compression  Delicious 
december 2016 by asteroza
Yogesh Khatri's forensic blog: WofCompressed streams in Windows 10
Hrm, I wonder if it clears the old limit for NTFS compression for greater than 64GB (really 40GB)?
windows  10  ADS  alternate  data  stream  compression  NTFS  file  Delicious 
november 2016 by asteroza
google/brotli: Brotli compression format
optimized for the web and has a static dictionary that has words from a number of common internet character sets/languages, so not quite general purpose...
Brotli  google  data  compression  algorithm  chrome  webdev  software  compressor  codec  opensource  Delicious 
march 2016 by asteroza
MAgneto Hydrodynamic Explosive Munition (MAHEM)
Using FCG's to make a tunable magnetic force for explosively formed projectiles, allowing dial-a-yield as well and engineered fragmentation/shrapnel.
DARPA  MAHEM  flux  compression  generator  ferromagnetic  ceramic  liner  explosively  formed  projectile  variable  yield  warhead  weapon  research  technology  Delicious 
december 2015 by asteroza
Google Developers Blog: Compress data more densely with Zopfli
High CPU time compression algorithm, compatible with deflate/zlib/zip decompressors. Good for precompressing static content for CDN's.
google  Zopfli  high  compression  algorithm  software  deflate  zlib  compressor  zip  Delicious 
june 2015 by asteroza
Data Saver (Beta)
Like the old Opera web accelerator, proxying/compressing/caching everything through google servers. Might be good on bandwidth limited situations though.
google  chrome  web  browser  plugin  addon  extension  proxy  compression  service  Delicious 
april 2015 by asteroza
Cyan4973/zstd
From the maker of LZ4, better suited for transmission speeds less than 50MB/s and/or memory limited environments.
Zstandard  codec  compression  decompression  algorthm  opensource  software  Delicious 
march 2015 by asteroza
« earlier      
per page:    204080120160

related tags

2U  3D  7z  600dpi  abuse  accelerated  acceleration  accelerator  access  accessible  accessories  adapter  addon  ADS  aerodynamics  aerogel  AI  air  ajax  algorithm  algorithms  algorthm  alternate  alternative  amazon  AMD  amplifier  amplitude  analysis  android  ANS  antivirus  apache  app  apple  appliance  archive  archiver  archiving  array  ASCII  ASP.NET  assembly  ASU  asymmetric  attack  audio  backup  bag  ball  bandwidth  battery  bazooka  bbc  benchmark  bgz  bigdata  binary  biometrics  bitmap  blade  blanket  block  blosc  board  bot  BPG  brayton  brotli  browser  bug  buoy  bzip  BZIP2  C#  C++  CAB  CABARC  CABARC.EXE  cabinet  Cabot  CABSDK  CABSDK.EXE  cache  caching  CAES  camera  cap  capture  carbon  CCC  CD  ceramic  channel  china  chip  chrome  cleanup  client  clothing  cloud  cluster  CO2  codec  collector  column  combustion  communication  compact  comparison  compatibility  compatible  competition  compressed  compression  compressive  compressor  computing  concurrency  condensate  configuration  conservation  control  converter  cooling  CoolR  copy  cost  Courgette  CPU  crawler  cryogenic  CyberLocator  cycle  cyclotrimethylene  cylinder  dabatase  DARPA  data  database  datacenter  dataframe  date  Dean  decode  decoder  decompress  decompression  decompressor  dedup  deduplication  deep  defense  deflate  Delicious  dependency  deployment  design  desktop  detection  development  devices  devops  dictionary  dielectric  diff  digital  Dirac  discussion  dish  disk  displacement  distilled  Distiller  distributed  DivANS  djvu  document  DSP  duplicate  DVD  dynamic  ECC  efficiency  elastomer  electromagnetic  electronics  EM  EMF  EMP  encapsulation  encoder  encrypted  encryption  energy  engine  enhancement  enterprise  entropy  exe  executable  exhaust  EXI  EXIF  expander  expansion  exploration  explosive  explosively  extension  external  extract  extractor  facebook  factor  fast  FastLZ  FCG  ferromagnetic  fiber  file  filesystem  fingerprint  finite  flash  flue  flux  folded  folder  force  forensics  fork  form  format  formed  forum  framework  freeware  ftp  fujitsu  FUSE  fusion  fuzzed  fuzzing  GaaS  GaiKai  game  games  gaming  GAN  gas  gear  generator  GENOME  GIF  go  google  gorilla  GPG  GPU  grafold  graph  graphene  graphics  graphing  gravity  green  grid  gRPC  gstreamer  GUI  gzip  GZipbomb  hacking  hadoop  hardware  hidden  high  host  hosting  HPC  HTML  http  https  humor  hybrid  hydraulic  hydro  hydroelectric  IETF  IIS  image  imaging  implementation  index  indoor  industrial  infiniband  information  injection  inlet  inline  insulation  interface  internal  internet  iOS  iPhone  ISCSI  IsoEngine  isothermal  jacket  java  javascript  JPEG  JPEG-XL  JPEG2000  JPEGXL  JPG  js  Judge  kafka  Kamen  key  keyvalue  kinetic  KVCD  lander  lawsuit  leak  leakage  learning  LevelDB  LHA  library  liner  link  linking  linux  liquid  lizard  LMDB  LN2  location  long  loopback  lossless  lossy  low  lucene  luggage  LuxIO  LZ4  LZ4HC  LZ5  lz77  LZFSE  LZMA  LZO  LZOP  LZSSE  LzTurbo  mac  machine  magnet  MAHEM  mass  materials  membrane  memory  message  metacompressor  metered  methane  method  microsoft  microwave  military  minimization  mist  MLC  mobile  modulation  module  mod_pagespeed  monolithic  motor  mount  moving  MPEG  MPI  MPIBZIP2  MSI  multi  multicore  multimedia  NAND  nanogel  nanotechnology  nanotube  NASA  natural  Net2Display  network  nginx  nitrogen  node  noSQL  NTFS  numeral  obfuscator  online  OnLive  Opendedup  openGL  opensource  OPSEC  optical  optics  optimization  optimizer  OSX  OTOY  output  PaaS  pack  package  packaging  packer  packing  paper  parallel  parquet  passing  patent  PBZIP2  PC  PCoIP  PCoverIP  PDF  pentesting  performance  photo  physical  physics  picture  pigz  pipline  piston  plugin  PNG  PNGOUT  point  polaris  portable  position  positive  PostgreSQL  power  powerpoint  prank  pressure  process  processing  programming  projectile  prometheus  proposal  protection  PROTOS  proxy  publishing  pulse  pulsed  pumped  purification  push  PyPi  python  QAM  QAM4096  QuickLZ  quine  RaaS  rackmount  radio  RAID  ram  ramgen  ramjet  rampressor  range  RAR  ratio  RDX  realtime  receiver  recompression  recursion  reference  remote  render  rendering  repacker  research  response  retrieval  reversal  RF  Ricardo  robot  RocksDB  rotary  rotor  RTL  RTLS  rubber  S3  s3backer  SaaS  sack  saw  scaling  scanned  scanning  schrodinger  Schrödinger  science  SCP  Scuderi  SDCH  SDR  security  self  sensing  sensor  separator  serialization  series  server  serverside  service  setting  shared  shelf  shockwave  signal  silicon  SIMD  singleton  small  snappy  software  solar  SolarCAT  solaris  sort  space  SPDY  specification  spectral  spectrum  speed  split  SQL  SQLite  SSE  standard  startup  static  stone  storage  store  stream  streaming  strength  structure  succint  super  supercomputer  supersonic  surface  symbian  sysadmin  system  SZIP  table  takeoff  tar  technology  telecommunications  temperature  tensegrity  tension  TensorFlow  Teradici  test  testing  text  texture  thermal  thermoelectric  thermopower  thin  tiger  TigerVNC  time  timescaleDB  timeseries  timezone  tiny  tips  TokuKV  tokyo  tools  toonel  toonel.net  tor  traffic  transcoding  transport  travel  tricks  trinitramine  turbine  turbogenerator  tutorial  tweaking  ubuntu  uncompress  universal  unpacker  UnRarX  URL  USB  utilities  utility  value  Vapor  variable  variant  VDI  video  virtual  VirtualGL  virtualization  visual  VMware  VNC  VP8  VPN  WAM  WAN  warhead  water  wave  waveblanket  weapon  web  webdev  WebM  WebP  website  wet  Whiptail  windows  wire  wrapper  XAR  XLR8r  XML  XMPP  XP10  yield  zambezi  zip  zipbomb  zipquine  Ziproxy  zlib  Zopfli  ZRAM  zstandard  ZSTD 

Copy this bookmark:



description:


tags: