ec2-consistent-snapshot
Handy!
ubuntu
ec2
aws
linux
ebs
snapshots
ops
tools
alestic
7 days ago by jm
This program creates an EBS snapshot for an Amazon EC2 EBS volume. To
help ensure consistent data in the snapshot, it tries to flush and
freeze the filesystem(s) first as well as flushing and locking the
database, if applicable.
Filesystems can be frozen during the snapshot. Prior to Linux kernel
2.6.29, XFS must be used for freezing support. While frozen, a
filesystem will be consistent on disk and all writes will block.
There are a number of timeouts to reduce the risk of interfering with
the normal database operation while improving the chances of getting a
consistent snapshot.
If you have multiple EBS volumes in a RAID configuration, you can
specify all of the volume ids on the command line and it will create
snapshots for each while the filesystem and database are locked. Note
that it is your responsibility to keep track of the resulting snapshot
ids and to figure out how to put these back together when you need to
restore the RAID setup.
Handy!
7 days ago by jm
Understanding Elastic Block Store Availability and Performance [slides]
19 days ago by jm
fantastic in-depth presentation on EBS usage; lots of good advice here if you're using EBS volumes with/without PIOPS
piops
ebs
performance
aws
ec2
ops
storage
amazon
presentations
19 days ago by jm
Under the Covers of DynamoDB
4 weeks ago by jm
mostly a DynamoDB puff-piece from last week's Amazon Cloud Connect, but contains some good real-world figures for a 20-billion-GUID deduping table use-case at end. ($4,150 per month, to cut to the chase)
dynamodb
aws
figures
costs
architecture
ec2
dedupe
cloud-connect
slides
4 weeks ago by jm
Latency's Worst Nightmare: Performance Tuning Tips and Tricks [slides]
4 weeks ago by jm
the basics of running a service stack (web, app servers, data stores) on AWS. some good benchmark figures in the final slides
benchmarks
aws
ec2
ebs
piops
services
scaling
scalability
presentations
4 weeks ago by jm
Increasing EBS Performance - Amazon Elastic Compute Cloud
6 weeks ago by jm
good docs from EC2
ec2
ebs
performance
piops
docs
6 weeks ago by jm
TCP Tune
Some tips for maximizing HPC network performance for the intra-DC case; recommended by the LinkedIn Kafka operations page.
tuning
network
tcp
sysadmin
performance
ops
kafka
ec2
6 weeks ago by jm
These notes are intended to help users and system administrators maximize TCP/IP performance on their computer systems. They summarize all of the end-system (computer system) network tuning issues including a tutorial on TCP tuning, easy configuration checks for non-experts, and a repository of operating system specific instructions for getting the best possible network performance on these platforms.
Some tips for maximizing HPC network performance for the intra-DC case; recommended by the LinkedIn Kafka operations page.
6 weeks ago by jm
High Performance MongoDB Clusters with Amazon EBS Provisioned IOPS
6 weeks ago by jm
yeah yeah, Mongo. bookmarking for the good data on EBS+PIOPS
ebs
piops
aws
performance
tips
ops
ec2
mongodb
presentations
6 weeks ago by jm
By the numbers: How Google Compute Engine stacks up to Amazon EC2
9 weeks ago by jm
Scalr's thoughts on Google's EC2 competitor.
gce
cloud
ec2
amazon
aws
google
scalr
with Google Compute Engine, AWS has a formidable new competitor in the public cloud space, and we’ll likely be moving some of Scalr’s production workloads from our hybrid aws-rackspace-softlayer setup to it when it leaves beta. There’s a strong technical case for migrating heavy workloads to GCE, and I’ll be grabbing popcorn to eagerly watch as the battle unfolds between the giants.
9 weeks ago by jm
Big Data Analytics at Netflix. Interview with Christos Kalantzis and Jason Brown.
12 weeks ago by jm
Good interview with the Cassandra guys at Netflix, and some top Mongo-bashing in the comments
cassandra
netflix
user-stories
testimonials
nosql
storage
ec2
mongodb
12 weeks ago by jm
Ironfan
january 2013 by jm
'an expressive toolset for constructing scalable, resilient [service] architectures. It works in the cloud, in the data center, and on your laptop, and it makes your system diagram visible and inevitable. Inevitable systems coordinate automatically to interconnect, removing the hassle of manual configuration of connection points (and the associated danger of human error).' Looks like a pretty neat cluster deployment tool; driven from a single configuration file, using Chef, integrating closely with AWS and providing many useful additional features
chef
deployment
clusters
knife
services
aws
ec2
ops
ironfan
demo
january 2013 by jm
How Team Obama’s tech efficiency left Romney IT in dust | Ars Technica
november 2012 by jm
The web-app dev and ops best practices used by the Obama campaign's tech team. Some key tools: Puppet, EC2, Asgard, Cacti, Opsview, StatsD, Graphite, Seyren, Route53, Loggly, etc.
obama
campaigns
tools
ops
asgard
ec2
aws
route53
november 2012 by jm
Cloudsmith Stack Hammer
february 2012 by jm
something Chris Horn sent on -- using Puppet to build stacks and deploy to AWS using a simple point-and-click interface. looks cool
github
ec2
aws
puppet
stacks
cloudsmith
stack-hammer
via:chorn
february 2012 by jm
Benchmarking Cassandra Scalability on AWS - Over a million writes per second
november 2011 by jm
NetFlix' benchmarks -- impressively detailed. '48, 96, 144 and 288 instances', across 3 EC2 AZs in us-east, successfully scaling linearly
ec2
aws
cassandra
scaling
benchmarks
netflix
performance
november 2011 by jm
Amazon EC2 outage: summary and lessons learned
april 2011 by jm
Rightscale CTO on last week's outage; pretty detailed, good round-up of useful commentary from around the web, too
ebs
ec2
aws
cloud
availability
slas
rightscale
amazon
april 2011 by jm
CloudSplit – Real Time Cloud Analytics
september 2009 by jm
interesting idea from Joe -- track your cloud-hosting spend in real-time
cloudsplit
hosting
amazon
ec2
azure
joe-drumgoole
analytics
real-time
from delicious
september 2009 by jm
related tags
advent ⊕ alestic ⊕ amazon ⊕ analytics ⊕ architecture ⊕ asgard ⊕ availability ⊕ aws ⊕ azure ⊕ benchmarks ⊕ c10k ⊕ campaigns ⊕ cassandra ⊕ chef ⊕ cloud ⊕ cloud-connect ⊕ cloudsmith ⊕ cloudsplit ⊕ clusters ⊕ costs ⊕ dedupe ⊕ demo ⊕ deployment ⊕ docs ⊕ dynamodb ⊕ ebs ⊕ ec2 ⊖ figures ⊕ gce ⊕ github ⊕ google ⊕ hosting ⊕ ironfan ⊕ java ⊕ joe-drumgoole ⊕ kafka ⊕ knife ⊕ linux ⊕ mongodb ⊕ netflix ⊕ netty ⊕ network ⊕ nio ⊕ nosql ⊕ obama ⊕ ops ⊕ performance ⊕ piops ⊕ presentations ⊕ puppet ⊕ real-time ⊕ rightscale ⊕ route53 ⊕ s3 ⊕ scalability ⊕ scaling ⊕ scalr ⊕ services ⊕ slas ⊕ slides ⊕ snapshots ⊕ stack-hammer ⊕ stacks ⊕ storage ⊕ sysadmin ⊕ tcp ⊕ testimonials ⊕ tips ⊕ tools ⊕ tuning ⊕ ubuntu ⊕ urban-airship ⊕ user-stories ⊕ via:chorn ⊕Copy this bookmark: