sechilds + backup   24

Linux Crypto: Backups - Arabesque
Duplicity, a Python tool built around librsync, excels at this, and can use our GnuPG assymetric key setup for the file encryption. It’s available in Debian-derived systems in the duplicity package. Note that, as before, a GnuPG key setup with an agent is required for this to work.
crypto  backup 
july 2013 by sechilds
The Locker Project
A Locker is a container for personal data, which gives the owner the ability to control how it's protected and shared. It retrieves and consolidates data from multiple sources, to create a single collection of the things you see and do online: the photos you take, the places you visit, the links you share, contact details for the people you communicate with, and much more. It also provides flexible APIs for developers to build rich applications with access to all of this information.

The Locker Project is an open source development effort, permissively licensed, and sponsored by Singly. Singly provides a personal data service based on this technology, and also welcomes its use by anyone for any purpose.
backup  data  security 
march 2012 by sechilds
apenwarr/bup - GitHub
It uses a rolling checksum algorithm (similar to rsync) to split large files into chunks. The most useful result of this is you can backup huge virtual machine (VM) disk images, databases, and XML files incrementally, even though they're typically all in one huge file, and not use tons of disk space for multiple versions.
It uses the packfile format from git (the open source version control system), so you can access the stored data even if you don't like bup's user interface.
Unlike git, it writes packfiles directly (instead of having a separate garbage collection / repacking stage) so it's fast even with gratuitously huge amounts of data. bup's improved index formats also allow you to track far more filenames than git (millions) and keep track of far more objects (hundreds or thousands of gigabytes).
Data is "automagically" shared between incremental backups without having to know which backup is based on which other one - even if the backups are made from two different computers that don't even know about each other. You just tell bup to back stuff up, and it saves only the minimum amount of data needed.
You can back up directly to a remote bup server, without needing tons of temporary disk space on the computer being backed up. And if your backup is interrupted halfway through, the next run will pick up where you left off. And it's easy to set up a bup server: just install bup on any machine where you have ssh access.
Bup can use "par2" redundancy to recover corrupted backups even if your disk has undetected bad sectors.
Even when a backup is incremental, you don't have to worry about restoring the full backup, then each of the incrementals in turn; an incremental backup acts as if it's a full backup, it just takes less disk space.
You can mount your bup repository as a FUSE filesystem and access the content that way, and even export it over Samba.
It's written in python (with some C parts to make it faster) so it's easy for you to extend and maintain.
Git  backup 
february 2012 by sechilds
sickill/bitpocket - GitHub
bitpocket is a small but smart script that does 2-way directory synchronization. It uses rsync to do efficient data transfer and tracks local file creation/removal to avoid known rsync problem when doing 2-way syncing with deletion.

bitpocket can use any server which you have ssh access to for its central storage. If you have gigabytes of free disk space on your hosting server you can finally make use of it.
backup  sync 
january 2012 by sechilds
Disable Local Time Machine Backups
If you’ve installed Lion on a laptop, you might’ve noticed great swathes of disk space disappearing for no apparent reason.

The culprit? Time Machine, which now stores backups locally if it runs when your external drive isn’t plugged in.

A great feature if you’ve got oodles of drive space to spare, but when you’re running Lion on a 48 GB SSD, losing 5 GB overnight isn’t ideal.

If you’re using a small drive, you can disable local backups with tmutil, like so:
OS_X  backup  from google
august 2011 by sechilds
Arq S3 Data Format
Arq stores backup data in S3 in a format similar to that of the open-source
version control system 'git'.

When you first run Arq and give it your public and private S3 keys, it creates
an S3 "bucket" with the name "<yourpublickey>.com.haystacksoftware.arq". It
also creates a "universally unique identifier" (UUID) for your computer.
arq  backup 
february 2011 by sechilds
Backups - Articles - The Productive Student
There are no good online backup solutions out there. Back in 2004, I lost all of my data because of a fried motherboard. Back then, I was fledgling through high school, high-speed internet had just become widespread in Switzerland and Facebook was still a college-only network. I didn’t try to recover my data from the hard drive. My “computer was broken”, so I threw it away as a single entity. Luckily, I didn’t have many pictures,…
february 2011 by sechilds
Online Backup for Mac | Arq | Haystack Software
Arq backs up the critical files on your Mac to the Internet.

Your backups are stored at Amazon S3 ("Simple Storage Service"), the gold standard of reliable online storage in the industry, backed by, a large stable company.

Backups of your Mac are complete and accurate, including all "metadata" -- something that many other online backup offerings can't claim (see results).
amazon  backup 
january 2011 by sechilds
Frank Chimero - The Setup
A few weeks ago I mentioned on Twitter I’m using a top-of-the-line 13” MacBook Air as my primary machine. The 27” behemoth of an iMac is gone: I sold it to a kindly soul on Twitter, and watched him as he threw his weight to one side and awkwardly dragged the giant box out of my apartment. I offered to help, but he said he could handle it. Super nice guy.

For some reason, this decision was of interest to other people. I got mixed responses, ranging anywhere from simple curiosity to guffaws. A few asked for me to write something up about this, so here we sit. If this type of stuff bores you, go ahead and skip over this post. It’s long, hairy, and thorough, and I realize this is of interest to maybe 3 of you. For you three, let’s get into it.

>>> Computer setup -- 13" MacBook Air
via:popular  backup  setup  software 
january 2011 by sechilds
the schwalBlog » Daily Encrypted Off-site Backup using Dropbox and Scripts
I wanted to share a solution I came up with awhile back that uses Dropbox, a few bash scripts, and some ingenuity to make a free, daily, encrypted, incremental off-site backup to keep track of important files that are changed daily.

The idea: For those not yet acquainted, Dropbox is a free service which allows you to sync 2.25 gigs of information (which can be increased by referrals or money) in a specific folder with their offsite server. You are able to access this info from any computer and from many Mobile devices (including iPhone).

Why bother? It’s important to back up data because eventually all drives will die. Incremental backups are important because it allows you to track changes from day to day. The solution I have here isn’t perfect, but it allows for a few folders to be saved for 30 days before they are overwritten. The benefit of this is that if a huge error is caught 5 days after it was made, then you can revert to the file that was saved 6 days ago.
november 2010 by sechilds
Offsite daily encrypted backup via Dropbox - Mac OS X Hints
Using some shell scripting + crontab + Dropbox, I've created a method for doing a daily encrypted backup of folders, lasting for 31 days.

Why bother? It's important to back up data because eventually all drives will die. Incremental backups are important because it allows you to track changes from day to day. The solution I have here isn't perfect, but it allows for a few folders to be saved for 30 days before they are overwritten. The benefit of this is that if a huge error is caught 5 days after it was made, then you can revert to the file that was saved 6 days ago.

Following is the script that does the job. I named this file and had it run every day at 3am, when nobody is likely to be editing or messing with files. The result of the code is a disk image (.dmg) that will be password protected, and will have the name of backup[1-31].dmg (based on the current date). You'll need to edit the first few variable to match your setup.
backup  Dropbox 
november 2010 by sechilds - Instapaper's backup method
mentioned earlier on Twitter that my home computer downloaded a 22 GB database dump every three days as part of Instapaper’s backup method, and a lot of people expressed interest in knowing the full setup.

The code and database are backed up separately. The code is part of my regular document backup which uses a combination of Time Machine, SuperDuper, burned optical discs, and Backblaze.

The database backup is based significantly on MySQL replication. For those who aren’t familiar, it works roughly like this:

The “master” database is configured to write a binary log (“binlog”) of every change it makes to the data.
A snapshot of the entire database is taken, noting the current position in the binlog, and copied to the “slave” server.
The slave server can then start itself up with that snapshot, knowing what binlog position it needs to start from, and continuously stream the binlog data from the master, replicating every change that the master makes, to keep itself up to date.
And the binlogs can be decoded, edited, or replayed against the database however you like. This is incredibly powerful: given a snapshot and every binlog file since it was taken, you can recreate the database as it was at any point in time, or after any query, between the time it was taken and the time your binlogs end.
backup  mysql  Instapaper 
november 2010 by sechilds
Daring Fireball: An Ode to DiskWarrior, SuperDuper, and Dropbox
Three weeks ago the hard drive in my MacBook Pro went bad. So far as I can tell, I didn’t lose a single byte of data. Here’s how.

First, what happened. I was on vacation for a few days with my wife immediately after Macworld Expo. Thursday 18 February was my first day back at home for a normal day of work. When I woke the machine up from sleep, everything was terribly slow. Closing windows. Opening new windows. Switching between apps. These things were all taking 30 seconds or longer. (I’d last used the machine on the airplane on my way home the night before. I noticed nothing wrong then.)

This was bad news, of course. So I saved everything that was open and rebooted. I gave it some time but the login screen didn’t appear.
backup  John_Gruber 
july 2010 by sechilds
Gmail Backups Now With Oauth For IMAP
Backing up your Gmail just got a whole lot safer. Up until now, the Gmail API only allowed us to pull contacts and the number of unread messages. We couldn’t actually pull email messages. To pull messages for backup, we had to use IMAP, which required us to store your username and password.

In general, we try to avoid storing any username and password info and use Oauth or some similar protocol whenever possible. In situations where we have to store sensitive information, we use strong encryption and security. Today, your Gmail backup got a lot better because Google announced their Oauth access to IMAP/SMTP implementation for Gmail. This means now you can authenticate your Gmail account using Oauth, and we never have to store your email username and password. You can login to Gmail and revoke our access at any time. It gives you more control, which is what we like.
Gmail  OAuth  backupify  backup 
july 2010 by sechilds -- Making the Jump to Subversion
If you haven't checked out Subversion, you should. It's a free, open source, powerful revision control system that was built to be a better CVS. It was created with clear design goals and built on top of robust, time-tested technologies.
backup  development  subversion  howto  mac 
july 2008 by sechilds
Daring Fireball: Leopard
My nutshell take is this: I’ve been using Leopard full-time for about three months, and there’s no question it’s a worthy update. Is 10.5.0 truly ready for production use, or would most users be better off waiting for 10.5.1? We’ll see.
apple  backup  mac  news  leopard  timemachine  review  OS_X  John_Gruber 
october 2007 by sechilds

Copy this bookmark: