asteroza + zfs   91

Linux 5.0 compat: SIMD compatibility · zfsonlinux/zfs@e5db313
So the linux kernel effectively outlawed userland FPU (wasn't the kernel NOT supposed to screw up userland?!?), so skeezy bypasses needed. This might kneecap ZFS Send ops...
linux  ZFS  kernel  filesystem  FPU  userland  access  restriction  sysadmin  tips  tricks  reference  information 
july 2019 by asteroza
ZFS Encryption by tcaputi · Pull Request #5769 · zfsonlinux/zfs
Native encryption means you can ZFS send a natively encrypted backup to an untrusted server without sending the decryption keys. Which means you can do whole backup to any untrusted provider easily and they can't go fishing in your backups.
ZFS  native  encryption  security 
june 2019 by asteroza
ZFS Volume Manipulation
Oh this is kinda important, migratiing ZFS zvols lose LU device ID if migrated to another pool. Use ZFS user defined property to keep a record of the ID with the zvol
sysadmin  tips  tricks  ZFS  zvol  migration  device  ID  LUN 
february 2018 by asteroza
OmniOS Community Edition
illumos based server OS with ZFS, DTrace, Crossbow, SMF, KVM and Linux zone support
OmniOS  Illumos  fork  storage  SAN  OS  solaris  ZFS  iSCSI 
february 2018 by asteroza
Time Series database, forked/improved on Riak core, uses PostgreSQL for metadata, has some features that benefit from a ZFS storage engine.
DalmatinerDB  TSDB  time  series  database  opensource  Riak  PostgreSQL  ZFS  metrics  analytics  distributed  grafana  analysis 
november 2017 by asteroza
lundman/ZFSin: OpenZFS ports
A windows port of ZFS? By a core OpenZFS developer? In his spare time as a hobby? Jebus...
windows  filesystem  ZFS  OpenZFS 
october 2017 by asteroza
Slow zpool export and import
OZMT seems to be handy for ZFS import/export
OZMT  ZFS  pool  import  export  Delicious 
october 2016 by asteroza
Modified "zpool" for NexentaStor 3.1.0 - Solarismen
Here's the patched nexenta zpool to force ashift 12 zpool creation, called zpool-nx310
nexenta  NexentaStor  force  ZFS  ashift  12  binary  4K  sector  HDD  zpool  sysadmin  tips  tricks  tools  utilities  Delicious 
september 2016 by asteroza
Containerizing ZFS for real cloud portability and failover. Basically link ZFS capabilities into Docker management. Snapshot/rollback are ZFS snapshot operations. Same with cloning. Real distributed cloud ops by sending Docker containers to other servers via ZFS send.
cloud  operations  management  software  service  docker  ZFS  automation  failover  cluster  hosting  redundant  Delicious 
june 2014 by asteroza
richardelling/tools · GitHub
some dtrace scripts for examining loads on storage servers by client, for iSCSI and a few other protocols, plus ZIL usage.
iscsi  load  tracing  dtrace  trace  sysadmin  tools  utilities  software  solaris  opensolaris  illumian  illumnos  ZFS  NDS  CIFS  ZIL  statistics  Delicious 
december 2013 by asteroza
zilstat - Richard Elling Consulting
tool for monitoring ZIL usage/performance for ZFS systems
software  monitoring  ZIL  status  performance  nexenta  ZFS  script  Delicious 
august 2013 by asteroza
RSF-1 ZFS HA High Availability Open Storage Cluster
Apparently this is the core of the Nexenta HA cluster plugin, but available for linux/solaris generically.
software  HA  cluster  high  ZFS  Nexenta  filesystem  plugin  storage  availability  Delicious 
march 2013 by asteroza
L2ARC Screenshots (Brendan Gregg)
If using L2ARC, this guy recommends a 1:40 DRAM/SSD ratio, and that's for DRAM dedicated to L2ARC work, not the normal OS/ZFS DRAM cache itself.
ZFS  L2ARC  filesystem  record  sizing  sysadmin  tips  tricks  howto  tutorial  reference  SSD  readzilla  Delicious 
september 2011 by asteroza
Bcache - BcacheWiki
Interesting work on a filesystem agnostic block device cache implementation using SSD's, as a linux kernel patch. Very similar to ZFS' L2ARC cache which is also intended for use with SSD's. But the big difference is that this is a read/write cache, so technically it is a hybrid of ZIL and L2ARC. Creator works for Google, so this might have legs...
Bcache  linux  kernel  patch  software  block  device  caching  accelerator  writeback  SSD  ZFS  L2ARC  ZIL  programming  development  performance  storage  cache  filesystem  Delicious 
september 2011 by asteroza
Making ZFS faster… | Alexander Leidinger
Using a cheapish USB stick for ZFS L2ARC on an EHCI connected USB port is ghetto but tenable...
ghetto  ZFS  L2ARC  cache  EHCI  USB  SSD  storage  flash  disk  sysadmin  tips  tricks  Delicious 
september 2011 by asteroza
Buy: STEC ZeusRAM™ 3.5" 8G DRAM 6G SAS-2 SSD
Okay, instead of the rumored $10K it's $3K, which makes it much more attractive relative to the DDRdrive. DDRdrive is ($2K,2Gbit,35K-300K IOPs) vs this which is reported as ($3K,6Gbit, 80K IOPs). The DDRdrive guys need to step up their game from PCIe 1.1 x1 if they want to spank this.
STEC  ZeusRAM  DRAM  RAM  SSD  storage  hardware  electronics  devices  SAS  SAS2  ZFS  L2ARC  ZIL  Delicious 
august 2011 by asteroza
Someone spent time backporting KVM onto OpenSolaris/Illumos and spun up a custom distro. Wait, OpenSOlaris kernel, BSD package management, and GNU toolchain? This is one bastard child of an operating system...
joyent  SmartOS  KVM  solaris  opensolaris  illumos  kernel  BSD  package  management  GNU  toolchainzones  ZFS  distro  OS  DTrace  hybrid  Delicious 
august 2011 by asteroza
Visualizing System Latency - ACM Queue
Some interesting stuff showing latency spreads involving multiple disks, mirroring, JBOD, ZIL (and maybe L2ARC), which makes for interesting reading. There seems to be some weirdness regarding bus contention. Does this have implications for SAS/SATA port expanders and/or JBOD enclosures when using ZFS?
ZFS  disk  latency  research  heatmap  througput  performance  analysis  storage  information  visualization  JBOD  ZIL  SAS  SATA  port  expander  Delicious 
june 2010 by asteroza
interesting alternative to the backblaze storage pod, which allows access to individual drives for more throughput
SAS  SATA  storage  server  ZFS  solaris  opensolaris  alternative  backblaze  storagepod  hardware  electronics  devices  filetype:jpg  media:image  Delicious 
may 2010 by asteroza
James Neal
Apparently this guy got a Backblaze StoragePod working with OpenSolaris, so it should be possible to do Nexenta on one. Though he probably did some tweaking to the choice of motherboard and RAID cards, plus he probably used a very recent build of OpenSolaris to get over the port multiplier issue.
OpenSolaris  Nexenta  ZFS  SATA  Backblaze  storagepod  storage  server  hardware  electronics  devices  tips  tricks  Delicious 
may 2010 by asteroza
ZFS with Cloud Storage or Faraway Storage - Jignesh Shah's Weblog
Cool idea of using ZFS ZIL/L2ARC on local storage (preferably on fast local storage tiers like SSD's, but if the scale of data is too large you may have to go back to spinning disk) to provide low latency random local writes, while flushing acceptable high latency bulk writes out to a final cloud based iSCSI tier, and using a local read cache to overcome the seek/latency hit of remote iSCSI storage (assuming your cache is filled well).

Pushing the idea farther, Use Amazon EC2 and S3, store main partitions as files in S3 and use EC2 instances to export iSCSI LUN's of those backing files.
ZFS  ZIL  L2ARC  iSCSI  fast  low  latency  local  cache  storage  tier  remote  cloud  OpenSolaris  SSD  mixed  hybrid  SAN  postgresql  performance  sysadmin  tips  tricks  system  architecture  database  Delicious 
april 2010 by asteroza
« earlier      
per page:    204080120160

related tags

4K  5U  accelerator  access  ACK  adapter  aeonDrive  alternative  analysis  analytics  appliance  ARC  architecture  article  ashift  AutoMAID  automation  availability  backblaze  backup  Bcache  binary  block  blog  bonjour  BSD  bug  build  bus  cache  caching  card  case  chassis  CIFS  cloud  cloudstack  clud  cluster  commentary  commodity  compatibility  configuration  controller  critque  DalmatinerDB  database  datacenter  Datto  Debian  dedup  deduplication  delayed  Delicious  development  device  devices  devops  direct  disk  distributed  distro  DIY  docker  documentation  Dokan  DRAM  driver  dtrace  EHCI  electronics  embedded  encryption  EON  error  ESX  ESXi  expander  export  failover  fast  file  filesystem  filetype:jpg  fix  flash  force  fork  FPU  FreeBSD  FreeNAS  FUSE  ghetto  GNU  GPFS  grafana  guest  guide  HA  hack  hard  hardware  HBA  HDD  heatmap  high  hosting  howto  hybrid  ID  illumian  illumnos  illumos  import  information  infosec  initiator  install  installation  IOPS  iscsi  japan  JBOD  joyent  kernel  KVM  L2ARC  large  latency  linux  list  LLNL  load  local  low  LUN  mac  machine  maczfs  MAID  management  mapping  MarFS  mDNS  media:image  metrics  migration  mixed  mode  module  monitoring  NAND  NAS  native  NDS  network  nexenta  NexentaStor  NFS  object  OCZ  offsite  OmniOS  only  onsite  Open  opensolaris  opensource  openstack  OpenZFS  operating  operations  OS  osx  OZMT  package  passthrough  patch  PCIe  performance  perl  plugin  pod  pool  pooling  port  POSIX  postgresql  problem  profile  programming  python  RAID  RAID-Z  RAIDZ  RAM  raw  RDM  read  readzilla  record  recovery  redundant  reference  registry  reimplementation  remote  removal  research  reseller  reset  restriction  Riak  RSYNC  SAN  SAS  SAS2  SATA  script  sector  security  selection  send  series  server  service  settings  setup  sharing  sizing  SmartOS  SMB  snapshot  software  solaris  SSD  statistics  status  STEC  storage  storagepod  subsystem  sun  supermicro  support  sysadmin  sysadmn  system  target  TCP  technology  througput  thumper  tier  time  tips  toolchainzones  tools  trace  tracing  tricks  TrueNAS  TSDB  tuning  tutorial  Ubuntu  USB  user  userland  utilities  vdev  virtual  virtualization  visualization  VM  VMware  walkthrough  windows  writeback  youtube  ZeusRAM  ZEVO  zfs  ZIL  zpool  zvol 

Copy this bookmark: