iceberg   280

« earlier    

Apache Iceberg (incubating)
Coming to presto soon apparently....
Iceberg tracks individual data files in a table instead of directories. This allows writers to create data files in-place and only adds files to the table in an explicit commit.

Table state is maintained in metadata files. All changes to table state create a new metadata file and replace the old metadata with an atomic operation. The table metadata file tracks the table schema, partitioning config, other properties, and snapshots of the table contents.

The atomic transitions from one table metadata file to the next provide snapshot isolation. Readers use the latest table state (snapshot) that was current when they load the table metadata and are not affected by changes until they refresh and pick up a new metadata location.


excellent -- this will let me obsolete so much of our own code :)
presto  storage  s3  hive  iceberg  apache  asf  data  architecture 
9 weeks ago by jm
Twitter
A huge iceberg with straight sides has been found in Antarctica by NASA's survey.

IceBridge  Iceberg  NASA  from twitter_favs
october 2018 by brokenrhino
Two Luxembourgs, 10 Madrids, one Delaware: How a giant iceberg in Antarctica is described around the world — Quartz
As news traveled around the world that one of the largest icebergs ever observed had finally broken off from Antarctica, reporters were faced with a question of scale. Few among us can visualize just how large a 2,200 square-mile (5,698 square-kilometer) hunk of ice really is, so they had to come up with a reference their readers might recognize.
communicatintechniques  earth  iceberg  selling  dataviz 
july 2017 by JohnDrake

« earlier    

related tags

<  150mm  2015  2018-08-01  282  500px  adventure  afghanistan  aftermath  alberta  algorithm  allinone  american  andrea  anger  antarctic  antarctica  antartica  apache  apple  architecture  arctic  art  asf  aurora  avocado  bacon  banff  banquise  bay  beach  beautiful  becher  bidirectionalcharging  black  blue-cheese  blue  bluecheese  borderland  borealis  botto  break  breaks  breiðamerkursandur  bullshit  calving  canada  canadian  carrots  ceo  change  chasing_ice  chile  climate  climate_change  climatechange  clouds  cloudscape  cold  communicatintechniques  compass  complexity  computer  conflict  content  controlrelease  cop21  crisis  crystal-clear  culture  d800  dark  data  dataviz  david  december  deceptions  deep  development  dinoto  disko  display  dji  documentary  don't  dooooooom  dressing  earth  earthvitalsigns  ed  edge  eggleston  eisberg  emotion  entrepreneur  envy  expedition  exposure  filter  firewall  firewire  flickr  flour  flüchtlinge  food  fotos  futureproof  garbage  gif  giorgio  glace  glacier  globalwarming  go-to  google  gottman  gratitude  green  greenland  greenwood  grinnell  grit  growth  hashtag  help  hike  hive  holder  humanresources  hummingbird  ice  icebergs  icebridge  iceland  ifttt  illusion  illusions  ilulisaat  index  indexical  indexicality  island  islande  islandia  ithemes  james  jiehao  jo  job  jobs  joel_on_software  joelonsoftware  jokulsarlon  journey  juice  junk  jökulsárlón  ka-boom  kayak  killing  kultur  lagon  lagoon  lake  landscape  langham  leapfrog  lemon  lemonzest  lettuce  life  lifestyl  light  lightroom  lon  long  mac  management  marketing  melting  mindset  mississippi  mmm  model  mountains  mustard  n  nasa  national  natur  nature  netflix  netflix:iceberg  newconnectionoverlord  nice_photo  night  nisi  nladventure  no  norfolk  norway  now  ocean  oceans  of  oneport  organisationalculture  organisations  packaging  paine  painting  panda  panorama  park  parsley  patagonia  penguin  people  phantom  photo  photography  picture  pines  pixel  podcast  portal  power  presto  pristine  pumpkinseeds  pxlnv  radishes  ranking  recipe  renault  research  rms  ro  rockies  s3  salad  sand  science  script  sculpture  sea  sealevel  sealevelrise  see  selfie  selling  seniormanagers  shape  shipping  simon  singularity  sky  snowflake  software  sony  sound  spectacular  stand-out  startup  stayte  stokknes  storage  strategy  su  success  sugar  sunset  support  swen  systems-thinking  systems  tagged  taken  the  time  tip  titanic  tom  tomato  tomatoes  torres  travel  truth  tumblr  typology  unique  univeralstandard  universalorbust  usb  usbc  user_interface  video  vinegar  war  water  watts  web  wells  what  wild  wildlife  william  winnersmentality  winter  withholding  writing  yearinspace  yogurt 

Copy this bookmark:



description:


tags: