jm + deployment 23
Videos from the Continuous Delivery track at QCon SF 2012
20 days ago by jm
Think we'll be watching some of these in work soon -- Jez Humble's talk (the last one) in particular looks good:
continuous-integration
continuous-delivery
build
release
process
dev
deployment
videos
qcon
towatch
hp
Amazon, Etsy, Google and Facebook are all primarily software development shops which command enormous amounts of resources. They are, to use Christopher Little’s metaphor, unicorns. How can the rest of us adopt continuous delivery? That’s the subject of my talk, which describes four case studies of organizations that adopted continuous delivery, with varying degrees of success.
One of my favourites – partly because it’s embedded software, not a website – is the story of HP’s LaserJet Firmware team, who re-architected their software around the principles of continuous delivery. People always want to know the business case for continuous delivery: the FutureSmart team provide one in the book they wrote that discusses how they did it.
20 days ago by jm
Testing Your Automation [slides]
10 weeks ago by jm
Test-driven infrastructure, using Chef -- slides from Big Ruby 2013. Tools used: foodcritic (lol), Chefspec, minitest-chef-handler, fauxhai, cucumber chef. This is really good to see -- TDD applied to ops. Video at: http://confreaks.com/videos/2309-bigruby2013-testing-your-automation-ttd-for-chef-cookbooks
devops
ops
chef
automation
testing
tdd
infrastructure
provisioning
deployment
10 weeks ago by jm
The first pillar of agile sysadmin: We alert on what we draw
12 weeks ago by jm
'One of [the] purposes of monitoring systems was to provide data to allow us, as engineers, to detect patterns, and predict issues before they become production impacting. In order to do this, we need to be capturing data and storing it somewhere which allows us to analyse it. If we care about it - if the data could provide the kind of engineering insight which helps us to understand our systems and give early warning - we should be capturing it. ' .... 'There are a couple of weaknesses in [Nagios' design]. Assuming we’ve agreed that if we care about a metric enough to want to alert on it then we should be gathering that data for analysis, and graphing it, then we already have the data upon which to base our check. Furthermore, this data is not on the machine we’re monitoring, so our checks don’t in any way add further stress to that machine.' I would add that if we are alerting on a different set of data from what we collect for graphing, then using the graphs to investigate an alarm may run into problems if they don't sync up.
devops
monitoring
deployment
production
sysadmin
ops
alerting
metrics
12 weeks ago by jm
SoloWizard
march 2013 by jm
'bootstrap an OSX development machine with a one-liner'.
osx
chef
mac
build-out
ops
macosx
deployment
developers
desktops
laptops
mysql
rabbitmq
activemq
nginx
Many teams use chef to manage their production machines, but developers often build their development boxes by hand. SoloWizard makes it painless to create a configurable chef solo script to get your development machine humming: mysql, sublime text, .bash_profile tweaks to OS-X settings - it's all there!
march 2013 by jm
A Continuous Packaging Pipeline
february 2013 by jm
presentation describing some nice automation tools for packaging vendor code for deployment
deployment
fosdem
presentations
slides
debian
deb
fpm
apt-get
february 2013 by jm
Ironfan
january 2013 by jm
'an expressive toolset for constructing scalable, resilient [service] architectures. It works in the cloud, in the data center, and on your laptop, and it makes your system diagram visible and inevitable. Inevitable systems coordinate automatically to interconnect, removing the hassle of manual configuration of connection points (and the associated danger of human error).' Looks like a pretty neat cluster deployment tool; driven from a single configuration file, using Chef, integrating closely with AWS and providing many useful additional features
chef
deployment
clusters
knife
services
aws
ec2
ops
ironfan
demo
january 2013 by jm
OmniTI's Experiences Adopting Chef
january 2013 by jm
A good, in-depth writeup of OmniTI's best practices with respect to build-out of multiple customer deployments, using multi-tenant Chef from a version-controlled repo. Good suggestions, and I am really looking forward to this bit:
'Chef tries to turn your system configuration into code. That means you now inherit all the woes of software engineering: making changes in a coordinated manner and ensuring that changes integrate well are now an even greater concern. In part three of this series, we’ll look at applying software quality assurance and release management practices to Chef cookbooks and roles.'
chef
deployment
ops
omniti
systems
vagrant
automation
'Chef tries to turn your system configuration into code. That means you now inherit all the woes of software engineering: making changes in a coordinated manner and ensuring that changes integrate well are now an even greater concern. In part three of this series, we’ll look at applying software quality assurance and release management practices to Chef cookbooks and roles.'
january 2013 by jm
How We Vagrant
december 2012 by jm
the enStratus “solo installer”; what they use for one-box testing, staging, and customer stack deployment, using chef-solo and Vagrant
chef
virtualization
vagrant
chef-solo
deployment
enstratus
cluster
stack
december 2012 by jm
Shell Scripts Are Like Gremlins
+1. I have to wean myself off the habit of automating with shell scripts where a clean, well-unit-tested piece of code would work better.
shell-scripts
scripting
coding
automation
sysadmin
devops
chef
deployment
december 2012 by jm
Shell Scripts are like Gremlins. You start out with one adorably cute shell script. You commented it and it does one thing really well. It’s easy to read, everyone can use it. It’s awesome! Then you accidentally spill some water on it, or feed it late one night and omgwtf is happening!?
+1. I have to wean myself off the habit of automating with shell scripts where a clean, well-unit-tested piece of code would work better.
december 2012 by jm
Ansible
july 2012 by jm
'SSH-Based Configuration Management & Deployment'. deploy via SSH; no target-side daemons required. GPLv3 licensed, unfortunately :(
ansible
devops
configuration
deployment
sysadmin
python
ssh
july 2012 by jm
Exclusive: a behind-the-scenes look at Facebook release engineering
april 2012 by jm
'Facebook gave me an exclusive behind-the-scenes look at the process it uses to deploy new functionality. I watched first-hand as the company's release engineers rolled out the new "timeline" feature for brand pages'. Hiphop, BitTorrent, 1.5GB binaries, and IRC!
facebook
deployment
engineering
releases
via:bos
april 2012 by jm
Building with Legos
august 2011 by jm
Netflix tech blog on how they deploy their services. Notably, they avoid the Puppet/Chef approach, citing these reasons: 'One is that it eliminates a number of dependencies in the production environment: a master control server, package repository and client scripts on the servers, network permissions to talk to all of these. Another is that it guarantees that what we test in the test environment is the EXACT same thing that is deployed in production; there is very little chance of configuration or other creep/bit rot. Finally, it means that there is no way for people to change or install things in the production environment (this may seem like a really harsh restriction, but if you can build a new AMI fast enough it doesn't really make a difference).'
devops
cloud
aws
netflix
puppet
chef
deployment
august 2011 by jm
Silver Lining
april 2011 by jm
'an application packaging format, a server configuration library, a cloud server management tool, a persistence management tool, and a tool to manage the application with respect to all these services over time.' interesting, possibly too Pythonic
python
programming
dist
deployment
packaging
from delicious
april 2011 by jm
Using Git to manage a web site
february 2011 by jm
simple, basic demo of a git post-receive hook to auto-check-out every rev committed to a git repository
git
deployment
howto
via:hackernews
from delicious
february 2011 by jm
Etsy's metrics infrastructure
december 2010 by jm
I never really understood how useful a good metrics infrastructure could be for operational visibility until I joined Amazon. Here's a good demo of Etsy's metrics system (via Netlson)
via:nelson
metrics
deployment
change-monitoring
etsy
software
monitoring
ops
from delicious
december 2010 by jm
GitHub scheduled maintainance due to Redis upgrade
may 2010 by jm
good comments on the processes useful for large-scale Redis upgrades
upgrades
redis
spof
nosql
databases
github
deployment
from delicious
may 2010 by jm
What Second Life can teach your datacenter about scaling Web apps
february 2010 by jm
good scaling advice from Linden Labs' Ian Wilkes (who doesn't seem to have a blog, sadly)
linden
ian-wilkes
scaling
datacenters
scalability
deployment
ops
services
from delicious
february 2010 by jm
A new way to deploy web applications
january 2010 by jm
interesting Django/Pythonic approach, based on concepts from AppEngine
django
python
virtualenv
deployment
web-apps
linux
appengine
from delicious
january 2010 by jm
Deployment is just a part of dev/ops cooperation, not the whole thing
december 2009 by jm
metrics, monitoring, instrumentation, fault tolerance, load mitigation called out as other factors by Allspaw
ops
deployment
operations
engineering
metrics
devops
monitoring
fault-tolerance
load
from delicious
december 2009 by jm
Code: Flickr Developer Blog » Flipping Out
december 2009 by jm
Flickr don't use branches. mental
branching
integration
branch
version-control
coding
flickr
sysadmin
wtf
deployment
from delicious
december 2009 by jm
Infrastructures.Org: Best Practices in Automated Systems Administration and Infrastructure Architecture: Gold Server
july 2009 by jm
well-written, and it's good to see version control listed right at the top of the list. But quite dead; interesting for historical reasons only at this stage
via:fanf
deployment
sysadmin
unix
rsync
ssh
cvs
infrastructure
cfengine
july 2009 by jm
related tags
activemq ⊕ alerting ⊕ ansible ⊕ appengine ⊕ apt-get ⊕ automation ⊕ aws ⊕ branch ⊕ branching ⊕ build ⊕ build-out ⊕ cfengine ⊕ change-monitoring ⊕ chef ⊕ chef-solo ⊕ cloud ⊕ cluster ⊕ clusters ⊕ coding ⊕ configuration ⊕ continuous-delivery ⊕ continuous-integration ⊕ continuousintegration ⊕ cvs ⊕ databases ⊕ datacenters ⊕ deb ⊕ debian ⊕ demo ⊕ deployinator ⊕ deployment ⊖ desktops ⊕ dev ⊕ developers ⊕ devops ⊕ dist ⊕ django ⊕ ec2 ⊕ engineering ⊕ enstratus ⊕ etsy ⊕ facebook ⊕ fault-tolerance ⊕ flickr ⊕ fosdem ⊕ fpm ⊕ git ⊕ github ⊕ howto ⊕ hp ⊕ ian-wilkes ⊕ infrastructure ⊕ integration ⊕ ironfan ⊕ knife ⊕ laptops ⊕ linden ⊕ linux ⊕ load ⊕ mac ⊕ macosx ⊕ metrics ⊕ monitoring ⊕ mysql ⊕ netflix ⊕ nginx ⊕ nosql ⊕ omniti ⊕ operations ⊕ ops ⊕ osx ⊕ packaging ⊕ presentations ⊕ process ⊕ production ⊕ programming ⊕ provisioning ⊕ puppet ⊕ python ⊕ qcon ⊕ rabbitmq ⊕ redis ⊕ release ⊕ releases ⊕ rsync ⊕ scalability ⊕ scaling ⊕ scripting ⊕ services ⊕ shell-scripts ⊕ slides ⊕ software ⊕ spof ⊕ ssh ⊕ stack ⊕ sysadmin ⊕ systems ⊕ tdd ⊕ testing ⊕ towatch ⊕ unix ⊕ upgrades ⊕ vagrant ⊕ version-control ⊕ via:bos ⊕ via:fanf ⊕ via:hackernews ⊕ via:nelson ⊕ videos ⊕ virtualenv ⊕ virtualization ⊕ web-apps ⊕ wtf ⊕Copy this bookmark: