asteroza + latency   28

Latency Round Robin PSP in ESXi 6.7 Update 1 | Cody Hosterman
Not quite the IOPS zero/queuedepth type roudd robin people hoped for
VMware  ESXi  storage  latency  roundrobin  sysadmin  tips  tricks 
october 2018 by asteroza
C4: the continuously concurrent compacting collector - c4_paper_acm.pdf
Lock free high performance low latency GC, currently used in the Zing java JVM by bankers. Requires 100x page remapping performance compared to page allocation, but they are achieving something like 700TB/s remapping so they are doing pretty good.
algorithm  research  software  C4  low  latency  garbage  collector  concurrent  high  performance  collection  programming  development  lockfree  Delicious 
july 2016 by asteroza
Twitter / PieCalculus: Example Time Scale of System ...
1 CPU Cycle 0.3ns L1 access 0.9ns L2 access 2.8ns L3 access 12.9ns DRAM 120.0ns SSD 50-150 microsec HDD 1-10ms Internet SF-NYC 40ms Internet SF-UK 81ms Internet SF-AUS 183ms TCP retransmit 1-3s OS virtualization system reboot 4s SCSI command timeout 30s Hardware virtualization system reboot 40s Physical system reboot 300s
computer  time  scale  operations  IO  latency  programming  development  optimization  reference  information  Delicious 
may 2014 by asteroza
x-OSC | x-io Technologies
apparently a very low latency wifi enabled microcontroller with high precision motion sensors
x-OSC  high  precision  motion  sensor  IO  board  microcontroller  arduino  wifi  wireless  low  latency  hardware  electronics  devices  Delicious 
april 2014 by asteroza
Netflix/SimianArmy · GitHub
Netflix's AWS management tools, opensourced. Chaos Monkey randomly kills resources to prove you have resiliency. Janitor Monkey looks for zombie and orphaned resources and kills them. Latency monkey introduces latency to detect bottlenecks. Feels like a BOFH almost wrote this...
BOFH  cloud  monkey  latency  janitor  chaos  opensource  sysadmin  software  utilities  tools  management  EBS  EC2  AWS  amazon  army  simian  Netflix  Delicious 
january 2013 by asteroza
Visualizing System Latency - ACM Queue
Some interesting stuff showing latency spreads involving multiple disks, mirroring, JBOD, ZIL (and maybe L2ARC), which makes for interesting reading. There seems to be some weirdness regarding bus contention. Does this have implications for SAS/SATA port expanders and/or JBOD enclosures when using ZFS?
ZFS  disk  latency  research  heatmap  througput  performance  analysis  storage  information  visualization  JBOD  ZIL  SAS  SATA  port  expander  Delicious 
june 2010 by asteroza
[ネットワーク性能]70Mビット/秒に迫るWAN速度 - 検証!ニフティクラウド:ITpro
Nifty Public Cloud is roughly 50-70 Mbps on the public network interface, and naturally latency is good due to being a domestic datacenter. Amazon EC2 in comparison only gets around 20 Mbps from the Singapore zone and the latency that entails. Interesting to note that there seems to be few resource controls in place, so the potential for abuse is there. The interesting side note is that Nifty Cloud is a VMware ESX(ESXi?) deployment it seems, because they are using the VMXNET 10Gbps network driver, which allows some virtual machines potentially 5Gbps of throughput on the internal interface. The raw network performance alone seems to trounce Amazon, and Amazon would be hard pressed to match it even with a domestic Japan zone. There is no mention of what time of day these tests were conducted which is suspicious, because of night batch jobs and data dump effects, as well as well known net gridlock times such as lunch and just after the end of the official working day.
Nifty  cloud  service  japan  performance  benchmark  network  speed  bandwidth  latency  VMware  ESX  VMXNET  Delicious 
june 2010 by asteroza
ZFS with Cloud Storage or Faraway Storage - Jignesh Shah's Weblog
Cool idea of using ZFS ZIL/L2ARC on local storage (preferably on fast local storage tiers like SSD's, but if the scale of data is too large you may have to go back to spinning disk) to provide low latency random local writes, while flushing acceptable high latency bulk writes out to a final cloud based iSCSI tier, and using a local read cache to overcome the seek/latency hit of remote iSCSI storage (assuming your cache is filled well).

Pushing the idea farther, Use Amazon EC2 and S3, store main partitions as files in S3 and use EC2 instances to export iSCSI LUN's of those backing files.
ZFS  ZIL  L2ARC  iSCSI  fast  low  latency  local  cache  storage  tier  remote  cloud  OpenSolaris  SSD  mixed  hybrid  SAN  postgresql  performance  sysadmin  tips  tricks  system  architecture  database  Delicious 
april 2010 by asteroza

related tags

6.7  algorithm  amazon  AMD  analysis  appliance  arbitrage  architecture  arduino  army  AWS  bandwidth  benchmark  blade  board  BOFH  bug  C4  cache  chaos  check  cloud  CloudSleuth  collection  collector  comcast  communication  computer  concurrent  connection  correction  database  Delicious  development  devices  devops  disk  distance  DNS  DRAM  EBS  EC2  electronics  error  ESX  ESXi  expander  facebook  fast  FEC  finance  flash  forward  gaming  garbage  global  glove  haptic  hardware  HCI  health  heatmap  HFT  HID  high  HPC  humor  hybrid  ICMP  information  injection  internet  IO  IOmeter  IOPS  iSCSI  janitor  japan  JBOD  kernel  keyboard  keypress  L2ARC  lambda  latency  LatencyTOP  linux  live  load  local  lockfree  long  lossy  low  management  map  measurement  measurment  memory  microcontroller  mixed  monitoring  monkey  motion  NAND  Netflix  network  networking  neutrino  Nifty  OpenSolaris  opensource  openVPN  operations  opteron  optimization  page  peering  perception  performance  perl  ping  poor  port  postgresql  precision  programming  provider  psychology  QA  radio  RAM  realtime  reference  remote  report  research  restriction  roundrobin  SAN  SAS  SATA  scale  science  SDR  sensor  server  serverless  service  shortwave  simian  simpleDB  simulation  simulator  Slice  SNS  software  speed  SQS  SSD  statistics  status  storage  sysadmin  system  TCP  telecommunications  test  testing  Themis  throughput  througput  tier  time  tips  tools  traffic  tricks  tunnel  UDP  unstable  USB  utilities  UX  view  Violin  visualization  VMware  VMXNET  VPN  VR  way  web  webdev  wifi  wireless  world  x-OSC  ZFS  ZIL 

Copy this bookmark: