dusko + python   108

Roundup Issue Tracker
Roundup's homepage is at http://roundup-tracker.org/. Roundup has been deployed for:

bug tracking and TODO list management (the classic installation)
customer help desk support (with a wizard for the phone answerers, linking to networking, system and development issue trackers)
issue management for IETF working groups
sales lead tracking
conference paper submission and double-blind referee management
weblogging (well, almost :)
sysadmin  opensource  free  tool  web  projectmanagement  python 
14 days ago by dusko
borgmatic is a simple Python wrapper script for the Borg backup software that initiates a backup, prunes any old backups according to a retention policy, and validates backups for consistency. The script supports specifying your settings in a declarative configuration file rather than having to put them all on the command-line, and handles common errors.
automation  backup  script  cli  python 
7 weeks ago by dusko
imbox - Python IMAP for Human beings
Python library for reading IMAP mailboxes and converting email content to machine readable data.
imap  email  python 
8 weeks ago by dusko
modoboa - Mail hosting made simple
Modoboa is a mail hosting and management platform including a modern and simplified Web User Interface. It provides useful components such as an administration panel or a webmail.
mailserver  postfix  dovecot  mysql  mariadb  python  sysadmin 
10 weeks ago by dusko
zedenv ZFS Boot Environment Manager
I just finished the first alpha release of zedenv, ZFS Boot Environment Manager for FreeBSD and Linux. I created the project because I enjoyed having the use of a boot environment manager while using my FreeBSD servers, and missed having access to one when I was on Linux. zedenv works similarly to the FreeBSD beadm, which is in turn based on the Solaris beadm.

zedenv is written completely in Python 3, and is is open source and licensed under the BSD-3-Clause License. If anyone would like to contribute, the code is available on GitHub.

Boot Environments

To skip ahead to creating a boot environment, see the next section

First of all, for anyone not familiar with the idea, what does a boot environment manager do? Boot environments are basically a way to have a snapshot of a system, so that changes to a system can be made without having the fear of bringing the system into an unusable state. It’s not a new idea, and they’ve been used on Solaris, FreeBSD, and to some extent on Linux, however not to the amount they have been used on the prior two systems.
sysadmin  zfs  snapshot  python 
10 weeks ago by dusko
MkDocs - Project documentation with Markdown.
MkDocs is a fast, simple and downright gorgeous static site generator that's geared towards building project documentation. Documentation source files are written in Markdown, and configured with a single YAML configuration file.
markdown  staticsitegenerator  documentation  python 
10 weeks ago by dusko
Our Lessons - Software Carrpentry Workshopw
A Software Carpentry workshop is taught by two trained and badged instructors. Over two days, they teach our three core topics: the Unix shell, version control with Git, and a programming language (Python or R). Curricula for these lessons in English and Spanish (select lessons only) are below.

- The Unix Shell
- Version Control with Git
- Programming with Python
- Plotting and Programming with R
- R for Reproducible Scientific Analysis
coding  programming  data  learning  tutorial  versioncontrol  shell  unix  python  diagram 
october 2018 by dusko
PyRoom - distraction free writing
Just you and your thoughts

Writing prose in a world as busy as the online world can be hard. Instant messengers, busy websites and other distractions can always get into your way when all you want to do is write.
Enter PyRoom

PyRoom is a free editor that stays out your way - and keeps other things out of your way, too. As a fullscreen editor without buttons, widgets, formatting options, menus and with only the minimum of required dialog windows, it doesn't have any distractions and lets you focus on writing and only writing. It is distributed under the GNU General Public Licence v3.
editor  writing  plaintext  python  terminal  shell  cli 
october 2018 by dusko
ttsiodras/utils: Short shell/perl/python utils I wrote that I use every day
Shell / perl / python scripts that I wrote and use on a daily basis - i.e. my own dogfood :-).
script  shell  unix  python  perl 
october 2018 by dusko
Economics Nobel laureate Paul Romer is a Python programming convert
Romer believes that open-source notebooks are the way forward for sharing research. He believes they support integrity, while proprietary software encourage secrecy. “The more I learn about proprietary software, the more I worry that objective truth might perish from the earth,” he wrote.
python  coding  programming  opensource  data 
october 2018 by dusko
Sitarba is a simple backup tool to create full, differential or incremental tarballs
Sitarba is a simple backup tool to create full, differential or incremental tarballs of given file sets. Each backup belongs to an epoch (e.g. hour, day, week, month, year). Sitarba keeps for every epoch a configured number of backups.


Full, differential and incremental backups.
Restoring backups using tar. Afraid that backup creation did not work as expected? – Just have a look into the tarball!
Cronjob friendly: automated decision on mode and epoch when creating backups and automatically pruning old backups. No need to manually decide which backup is to be pruned.
User defined epochs to, e.g., to run a backup every other hour or on a biweekly basis.
Exclude patterns for tar (globally, per file set, per epoch).

I use sitarba on my notebook in two ways:

I create a backup every week (differentially), every month (full) and every year of my notebook to an external USB hard drive.

Using a shell script, which is called by cron, and sshfs I create every hour (incrementally), every day (differentially) and every week (full) a backup of parts of my home directory that are stored on my office computer. In particular, for the hourly backups the thunderbird directory is excluded, as the mails reside on IMAP servers anyhow.

backup  shell  cli  python  sysadmin 
september 2018 by dusko
PyX - Python graphics package
PyX is a Python package for the creation of PostScript, PDF, and SVG files. It combines an abstraction of the PostScript drawing model with a TeX/LaTeX interface. Complex tasks like 2d and 3d plots in publication-ready quality are built out of these primitives.
tex  latex  diagram  graph  svg  python  documentation 
september 2018 by dusko
Jazzband - a collaborative community to share the responsibility of maintaining Python-based projects
Jazzband is a collaborative community to share the responsibility of maintaining Python-based projects.

It gives maintainers and contributors the ability to “play in the same band” instead of being forced into “artist” and “audience” roles
september 2018 by dusko
Tool recommendations - Python Packaging User Guide
Tool recommendations

If you’re familiar with Python packaging and installation, and just want to know what tools are currently recommended, then here it is.
september 2018 by dusko
aafigure -- ASCII art figures can be parsed and output as SVG, PNG, JPEG, PDF and more
ASCII art figures can be parsed and output as SVG, PNG, JPEG, PDF and more. This project provides a python package and a command line script.

This project provides a python package and a command line script.

ascii  diagram  graph  documentation  python  svg  pdf 
september 2018 by dusko
ASCII Tables (astropy.io.ascii)
astropy.io.ascii provides methods for reading and writing a wide range of ASCII data table formats via built-in Extension Reader classes. The emphasis is on flexibility and ease of use, although readers can optionally use a less flexible C/Cython engine for reading and writing for improved performance.

The following shows a few of the ASCII formats that are available, while the section on Supported formats contains the full list.

Basic: basic table with customizable delimiters and header configurations
Cds: CDS format table (also Vizier and ApJ machine readable tables)
Daophot: table from the IRAF DAOphot package
Ecsv: ECSV format for lossless round-trip of data tables
FixedWidth: table with fixed-width columns (see also Fixed-width Gallery)
Ipac: IPAC format table
HTML: HTML format table contained in a <table> tag
Latex: LaTeX table with datavalue in the tabular environment
Rdb: tab-separated values with an extra line after the column definition line
SExtractor: SExtractor format table
ascii  csv  tsv  python  data  dataanalysis  plaintext 
april 2018 by dusko
Astropy - Python Datamining for Astronomy
The Astropy Project is a community effort to develop a core package for astronomy using the Python programming language and improve usability, interoperability, and collaboration between astronomy Python packages. The core astropy package contains functionality aimed at professional astronomers and astrophysicists, but may be useful to anyone developing astronomy software. The Astropy Project also includes "affiliated packages," Python packages that are not necessarily developed by the core development team, but share the goals of Astropy, and often build from the core package's code and infrastructure.
python  data 
april 2018 by dusko
Asciitable — asciitable 0.8.0 documentation
Generate output in tabular form (in a number of formats) as well as parsing data presented in that form and converting it to, for instance, a list of lists.


This package is no longer being developed.

The asciitable package has been moved into the Astropy project and is now known as astropy.io.ascii. This new version is very compatible with asciitable and most existing code should work.

The astropy.io.ascii package is being actively developed and contains many new features and bug fixes relative to asciitable. Users are strongly encouraged to migrate to astropy.io.ascii. If you have any questions or problems please send mail to the AstroPy mailing list (astropy@scipy.org).
python  plaintext  ascii 
april 2018 by dusko
Beautiful Soup
Beautiful Soup is a Python library designed for quick turnaround projects like screen-scraping.
december 2017 by dusko
Backup and Recovery with Native OS Tools
* Linux Complete Backup and Recovery HOWTO - Charles Curley

* Linux Complete Backup and Recovery HOWTO - Charles Curley

* Chapter 8. Backup and Restore Procedures - Charles Curley

* Linux / UNIX Tar Full and Incremental Tape Backup Shell Script

* Full System Backup with rsync - ArchWiki

* FreeBSD - Backup Basics

* FreeBSD UFS/ZFS Snapshot Management Environment

* Howto: Backup and restore your system! (Ubuntu forums)

* Bare Metal Recovery by Charles Curley

* Creating a clone of current server

* Cloning a server in RHEL 4

* Copying config files from one RHEL server to another

* Cloning Hard Drives with GNU/Linux

* DAR -- Disk ARchive

* tar -- Unix Tape Archiver

* Tar options for bare metal recovery

* Easy Automated Snapshot-Style Backups with Linux and Rsync

* How To Backup Your Entire Linux System Using Rsync

* Rsnapshot

* Clonezilla

* rclone - rsync for cloud storage and local filesystem

* Disk and Partition Backup and Cloning

* Cloning systems, disks and partitions

* Cloning parition table on a new disk

* BackInTime

* TimeShift - functionality similar to the System Restore feature in Windows and the Time Machine tool in Mac OS.

* SUSE Backup and Restore

* Usage of Knoppix with Partimage

* Solaris Backup/Restore

* Solaris snapshots

* Usage of Relax-and-Recover on RHEL

* GNU tar: an archiver tool

* cpio command

* Cloning harddrives and partitions using dd

* DD Command

* GNU ddrescue

* Linux LVM-based Snapshots

* Recovery of LVM partitions

* Back Up (And Restore) LVM Partitions With LVM Snapshots

* Perl and Shell Backup Scripts

* luckyBackup - a powerful, fast and reliable backup and sync tool

* rotate-backups

* bash-backup-rotation-script

* Shell script to mirror backups to another server in pull mode using rsync

* Continuous Archiving for Postgres

* Macrium Reflect - Free backup, disk imaging and cloning solution for personal and commercial use

* storeBackup's Top Features
Restore easily - even without storeBackup! The most important aspect of a backup tool is easy restoring from a transparent (native) storage format.
Copies / compresses files to another disk and generates backups with time stamps while saving space by recognizing files with identical contents (even if renamed or copied) and hardlinking them (so each backup is totally complete, independent and autonomous)
Detects identical files in different, independent backups (eg. of different computers)
Splits big image files (from e.g., TrueCrypt, mbox, Xen, KVM, VMware, etc.) or complete devices into small pieces and saves only differences to existing backups, thereby saving space and time
Sophisticated possibilities for including and excluding files and directories.
Support of sparse files.
Supports isolated incremental backups (e.g., when travelling with a laptop) and later integration in master backup.
Supports time shifted replication of backups to additional other disks / locations, even for complex schemes.
Supports checking of backups via md5 sums to eg. recognize bit rot of the hard disk.
Enables checking of (old) files in the source directory with md5 sums in the backup to eg. recognize bit rot of the hard disk.
Fast backups even over slow or high latency network connections.
Contains an entire suite of backup-related tools.

>> storeBackup

>> storeBackup Documentation

✭ Copy hard disk or partition image to another system using a network and netcat (nc)

* Shell Script To Dump All MySQL Databases Every Hour To NAS Storage

* Back Up and Restore MySQL Server (MariaDB) Databases

* MySQL Server (MaridaDB) Backups

* MySQL Backup Bash Shell Script

* Shell script to backup all db's (MySQL Server / MariaDB)

✭ How do I clone an OpenLDAP database - Stack Overflow

* Keep a Backup of Installed Packages
You might prefer to have a clean system on reinstall but sometimes it is nice to reinstall applications from a previous machine/setup. Keeping a backup list of packages will make this a snap. Just give your package manager a list of all the packages you want it to install and let it rip.
- Here are the backup and restore methods for each of the major distros/package managers.










backup  linux  freebsd  sysadmin  tar  rsync  perl  snapshot  lvm  config  zfs  cli  commandline  shell  python  from notes
december 2017 by dusko
NoPriv.py - Easy IMAP Email Backup. - Raymii.org
NoPriv.py is a python script to backup any IMAP capable email account to a bowsable HTML archive and a Maildir folder. Not one huge file (mbox), only needing a web browser to view and no proprietary code, so you can make sure I won't steal your password.

backup  email  imap  python 
november 2017 by dusko
NetworkX - Software for complex networks
NetworkX is a Python package for the creation, manipulation, and study of the structure, dynamics, and functions of complex networks.

Data structures for graphs, digraphs, and multigraphs
Many standard graph algorithms
Network structure and analysis measures
Generators for classic graphs, random graphs, and synthetic networks
Nodes can be "anything" (e.g., text, images, XML records)
Edges can hold arbitrary data (e.g., weights, time-series)
Open source 3-clause BSD license
Well tested with over 1800 unit tests and >90% code coverage
Additional benefits from Python include fast prototyping, easy to teach, and multi-platform
python  graph 
august 2017 by dusko
Outline to Graphviz - Convert a tab-delimited outline into a Graphviz diagram
Here's a script ( http://radio.weblogs.com/0104369/stories/2004/02/17/o2g.html ) that converts a tab-delimited outline into a high quality graphviz diagram (generating dotscript and running the Graphviz tools under the hood).
python  graph 
august 2017 by dusko
IPython provides a rich architecture for interactive computing with:
* A powerful interactive shell.
* A kernel for Jupiter (https://jupyter.org/).
* Support for interactive data visualization and use of GUI toolkits (http://ipython.org/ipython-doc/stable/interactive/reference.html#gui-event-loop-support).
* Flexible, embeddable (http://ipython.org/ipython-doc/stable/interactive/reference.html#embedding-ipython) interpreters to load into your own projects.
* Easy to use, high performance tools for parallel computing (https://ipyparallel.readthedocs.io/en/latest/).
To get started with IPython in the Jupyter Notebook, see our official example collection (http://nbviewer.ipython.org/github/ipython/ipython/blob/master/examples/Index.ipynb). Our notebook gallery (https://github.com/ipython/ipython/wiki/A-gallery-of-interesting-IPython-Notebooks) is an excellent way to see the many things you can do with IPython while learning about a variety of topics, from basic programming to advanced statistics or quantum mechanics.
To learn more about IPython, you can download our talks and presentations (http://ipython.org/presentation.html), or read our extensive documentation (http://ipython.org/documentation.html).
Jupyter and the future of IPython: IPython is a growing project, with increasingly language-agnostic components. IPython 3.x was the last monolithic release of IPython, containing the notebook server, qtconsole, etc. As of IPython 4.0, the language-agnostic parts of the project: the notebook format, message protocol, qtconsole, notebook web application, etc. have moved to new projects under the name Jupyter (https://jupyter.org/). IPython itself is focused on interactive Python, part of which is providing a Python kernel for Jupyter.
july 2017 by dusko
Project Jupyter
Project Jupyter is an open source project was born out of the IPython Project (https://ipython.org/) in 2014 as it evolved to support interactive data science and scientific computing across all programming languages. Jupyter will always be 100% open source software, free for all to use and released under the liberal terms of the modified BSD license (https://opensource.org/licenses/BSD-3-Clause).
july 2017 by dusko
ParaText: CSV parsing at 2.5 GB per second
A library for reading text files over multiple cores. ---- Despite extensive use of distributed databases and filesystems in data-driven workflows, there remains a persistent need to rapidly read text files on single machines. Surprisingly, most modern text file readers fail to take advantage of multi-core architectures, leaving much of the I/O bandwidth unused on high performance storage systems. Introduced here, ParaText, reads text files in parallel on a single multi-core machine to consume more of that bandwidth. The alpha release includes a parallel Comma Separated Values (CSV) reader with Python bindings. ----For almost 50 years, CSV has been the format of choice for tabular data. Given the ubiquity of CSV and the pervasive need to deal with CSV in real workflows  - where speed, accuracy, and fault tolerance is a must  - we decided to build a CSV reader that runs in parallel.
cvs  tsv  python  dataanalysis 
july 2017 by dusko
Interactive Python
Interactive Python is a project of Runestone Interactive. We host a growing number of Open Source, interactive textbooks you can use in a course. Written by award winning authors. Used by some of the best schools.
python  programming 
december 2016 by dusko
PyMOTW-3 - Python 3 Module of the Week
PyMOTW-3 is a series of articles written by Doug Hellmann (http://doughellmann.com/) to demonstrate how to use the modules of the Python 3 (http://www.python.org/) standard library. It is based on the original PyMOTW (http://pymotw.com/2/) series, which covered Python 2.7. See About Python Module of the Week (https://pymotw.com/3/about.html) for details including the version of Python and tools used.
sysadmin  python  programming 
december 2016 by dusko
PyMOTW - Python Module of the Week - Python 2
The Python Module of the Week (http://www.doughellmann.com/PyMOTW/) series, or PyMOTW, is a tour of the Python (http://www.python.org/) standard library through short examples.
sysadmin  python  programming 
december 2016 by dusko
Dive Into Python - Python from novice to pro
Dive Into Python is a free Python book for experienced programmers. It was originally hosted at DiveIntoPython.org, but the author has pulled down all copies. It is being mirrored here. You can read the book online (http://www.diveintopython.net/toc/index.html), or download it (http://www.diveintopython.net/index.html#download) in a variety of formats. It is also available in multiple languages.
sysadmin  python  programming 
november 2016 by dusko
EasyInstall - Python
PEAK (Python Enterprise Application Kt) Easy Install ---- Easy Install is a python module (easy_install) bundled with setuptools that lets you automatically download, build, install, and manage Python packages.
july 2016 by dusko
waybackpack - Download the entire Wayback Machine archive for a given URL
Waybackpack is a command-line tool that lets you download the entire Wayback Machine archive for a given URL.
web  archive  tool  python  script 
may 2016 by dusko
Requests - Python HTTP requests for Humans
Python HTTP Requests for Humans (http://python-requests.org) ---- Requests allows you to send organic, grass-fed HTTP/1.1 requests, without the need for manual labor. There's no need to manually add query strings to your URLs, or to form-encode your POST data. Keep-alive and HTTP connection pooling are 100% automatic, powered by urllib3 (https://github.com/shazow/urllib3), which is embedded within Requests.
http  python 
april 2016 by dusko
« earlier      
per page:    204080120160

Copy this bookmark: