nhaliday + cloud   37

Ask HN: What's a promising area to work on? | Hacker News
hn  discussion  q-n-a  ideas  impact  trends  the-bones  speedometer  technology  applications  tech  cs  programming  list  top-n  recommendations  lens  machine-learning  deep-learning  security  privacy  crypto  software  hardware  cloud  biotech  CRISPR  bioinformatics  biohacking  blockchain  cryptocurrency  crypto-anarchy  healthcare  graphics  SIGGRAPH  vr  automation  universalism-particularism  expert-experience  reddit  social  arbitrage  supply-demand  ubiquity  cost-benefit  compensation  chart  career  planning  strategy  long-term  advice  sub-super  commentary  rhetoric  org:com  techtariat  human-capital  prioritizing  tech-infrastructure  working-stiff  data-science 
27 days ago by nhaliday
Sage: Open Source Mathematics Software: You don't really think that Sage has failed, do you?
> P.S. You don't _really_ think that Sage has failed, do you?

After almost exactly 10 years of working on the Sage project, I absolutely do think it has failed to accomplish the stated goal of the mission statement: "Create a viable free open source alternative to Magma, Maple, Mathematica and Matlab.".     When it was only a few years into the project, it was really hard to evaluate progress against such a lofty mission statement.  However, after 10 years, it's clear to me that not only have we not got there, we are not going to ever get there before I retire.   And that's definitely a failure.   
mathtariat  reflection  failure  cost-benefit  oss  software  math  CAS  tools  state-of-art  expert-experience  review  comparison  saas  cloud  :/ 
july 2019 by nhaliday
renamed to https://perkeep.org/

very similar thing by Rob Pike: https://upspin.io
Hi, Camlistore author here.
Andrew Gerrand worked with me on Camlistore too and is one of the Upspin authors.

The main difference I see is that Camlistore can model POSIX filesystems for backup and FUSE, but that's not its preferred view of the world. It is perfectly happy modeling a tweet or a "like" on its own, without any name in the world.

Upspin's data model is very much a traditional filesystem.

Also, upspin cared about the interop between different users from day 1 with keyservers etc, whereas for Camlistore that was not the primary design criteria. (We're only starting to work on that now in Camlistore).

But there is some similarity for sure, and Andrew knows both.
tools  golang  cloud  yak-shaving  software  libraries  google  oss  exocortex  nostalgia  summer-2014  retention  database  dbs  multi  rsc  networking  web  distributed  hn  commentary 
october 2016 by nhaliday
What does Bret Taylor think of Dropbox's future, given that we're moving to a world without files? - Quora
That is why I think Dropbox will probably start moving “up the stack” to make products like Google Apps and Quip. They need their customers to work with “Dropbox,” not with a folder that syncs, or their risk of churn to cheaper alternatives goes up over time.
prediction  business  reflection  software  sv  cloud  expert  dropbox  q-n-a  qra  tech  expert-experience 
april 2016 by nhaliday
Would it be logical to opt for EC2 instead of a custom built desktop solution for deep learning? - Quora
- advice from expert (Alex Smola) on deep learning hardware
- note this was back in 2016, may have changed RE: GPU quality, tho prob. not so much the cost

Short answer - buy a GPU.

Long answer - each g2.8xlarge instance has 4 GPUs but they're not terribly fast (they're Tesla K20 chips). Plus, the hourly rates are $2.60 (unless you're using spot instances). Compare that to $300 for a GTX 970 (which will give you about 50% the performance of the g2.8xlarge but less memory) or $120 for a GTX 750. So, after 2 or 5 days of computation you've broken even relative to using AWS. Of course, this is assuming that you've got a desktop PC at home that can handle this (make sure your power supply is good enough).

If you also need to buy the entire PC it's a different story. But most likely you'll find someone at your university who will let you install a GPU in their PC. Or you can resell the system after you're done. Or you can let your 16 year old brother shoot aliens with it.

Lastly, if you want to test scaling, i.e. running things on 1000 GPUs at the same time, you will obviously want to use EC2 instead of building it. Note that CPUs are very different since Amazon, Google, Microsoft and others all offer fairly up-to-date machines. Unfortunately the GPU situation on AWS is not great, though (@Amazon @NVIDIA please fix this).
reflection  deep-learning  machine-learning  programming  advice  best-practices  expert  qra  q-n-a  ama  expert-experience  cost-benefit  comparison  cloud  amazon  tech-infrastructure 
april 2016 by nhaliday
The Next Generation of Software Stacks | StackShare
most interesting part to me:
GECS have a clear bias towards certain types of applications and services as well. These preferences are particularly apparent in the analytics stack. Tools typically aimed primarily at marketing teams—tools like Crazy Egg, Optimizely, and Google Analytics, the most popular tool on Stackshare—are extremely unpopular among GECS. These services are being replaced by tools that are aimed a serving both marketing and analytics teams. Segment, Mixpanel, Heap, and Amplitude, which provide flexible access to raw data, are well-represented among GECS, suggesting that these companies are looking to understand user behavior beyond clicks and page views.
data  analysis  business  startups  tech  planning  techtariat  org:com  ecosystem  software  saas  network-structure  integration-extension  cloud  github  oss  vcs  amazon  communication  trends  pro-rata  crosstab  visualization  sv  programming  pls  web  javascript  frontend  marketing  tech-infrastructure 
april 2016 by nhaliday
The Setup / Russ Cox
I swear by the small Apple keyboard (in stores they have one that size with a USB cable too) and the Evoluent mouse.


I run acme full screen as my day to day work environment. It serves the role of editor, terminal, and window system. It's hard to get a feel for it without using it, but this video helps a little.

Rob Pike's sam editor deserves special mention too. From a UI standpoint, it's a graphical version of ed, which you either love or hate, but it does two things better than any other editor I know. First, it is a true multi-file editor. I have used it to edit thousands of files at a time, interactively. Second, and even more important, it works insanely well over low-bandwidth, high-latency connections. I can run sam in Boston to edit files in Sydney over ssh connections where the round trip time would make vi or emacs unusable. Sam runs as two halves: the UI half runs locally and knows about the sections of the file that are on or near the screen, the back end half runs near the files, and the two halves communicate using a well-engineered custom protocol. The original target environment was 1200 bps modem lines in the early 1980s, so it's a little surprising how relevant the design remains, but in fact, it's the same basic design used by any significant JavaScript application on the web today. Finally, sam is the editor of choice for both Ken Thompson and Bjarne Stroustroup. If you can satisfy both of them, you're doing something right.


I use Unison to sync files between my various computers. Dropbox seems to be the hot new thing, but I like that Unison doesn't ever store my files on someone else's computers.


I want to be working on my home desktop, realize what time it is, run out the door to catch my train, open my laptop on the train, continue right where I left off, close the laptop, hop off the train, sit down at work, and have all my state sitting there on the monitor on my desk, all without even thinking about it.
programming  hardware  plan9  rsc  software  recommendations  techtariat  devtools  worse-is-better/the-right-thing  nostalgia  summer-2014  interview  ergo  osx  linux  desktop  consumerism  people  editors  tools  list  google  cloud  os  profile  summary  c(pp)  networking  performance  distributed  config  cracker-prog  heavyweights  unix  workflow  client-server 
july 2014 by nhaliday

bundles : engtechie

related tags

:/  ability-competence  academia  accessibility  acm  acmtariat  advice  ama  amazon  analysis  anonymity  aphorism  api  apple  applications  arbitrage  automation  backup  best-practices  bio  biohacking  bioinformatics  biotech  bitcoin  blockchain  blog  blowhards  books  brands  browser  business  c(pp)  calculator  career  CAS  chart  checking  checklists  client-server  cloud  code-organizing  collaboration  commentary  communication  comparison  compensation  composition-decomposition  computer-vision  concept  conceptual-vocab  concurrency  config  confluence  consumerism  correctness  correlation  cost-benefit  cracker-prog  creative  CRISPR  critique  crosstab  crypto  crypto-anarchy  cryptocurrency  cs  culture  data  data-science  database  dataset  dbs  debugging  decentralized  deep-learning  desktop  devops  devtools  direct-indirect  discussion  distributed  distribution  documentation  dropbox  duplication  dynamic  ecosystem  editors  eh  engineering  ergo  essay  estimate  exocortex  expert  expert-experience  facebook  failure  flux-stasis  frameworks  frontend  git  github  gnon  golang  google  gotchas  graphics  grugq  guide  hardware  healthcare  heavyweights  hmm  hn  howto  human-capital  ideas  idk  impact  incentives  init  integration-extension  internet  interview  intricacy  investing  ios  javascript  jobs  jvm  kaggle  knowledge  learning  lens  let-me-see  libraries  links  linux  lisp  list  local-global  long-term  low-hanging  machine-learning  management  maps  marketing  math  mathtariat  media  metabuch  metrics  microbiz  mobile  money  multi  music  network-structure  networking  nibble  nitty-gritty  nostalgia  numerics  objektbuch  oly  opsec  org:bleg  org:com  org:med  org:popup  organization  os  oss  osx  paas  parsimony  paste  people  performance  pessimism  philosophy  plan9  planning  play  pls  plt  pragmatic  prediction  prioritizing  priors-posteriors  privacy  pro-rata  profile  programming  python  q-n-a  qra  quora  r-lang  randy-ayndy  ranking  rant  recommendations  reddit  reference  reflection  repo  retention  review  rhetoric  roadmap  rsc  saas  scaling-tech  scholar  sci-comp  security  SIGGRAPH  skunkworks  social  software  speedometer  stackex  startups  state  state-of-art  static-dynamic  strategy  sub-super  subculture  summary  summer-2014  supply-demand  sv  systems  tech  tech-infrastructure  technology  techtariat  the-bones  theory-practice  thiel  thinking  time-series  tools  top-n  track-record  tradecraft  trends  tutorial  types  ubiquity  universalism-particularism  unix  urbit  usa  vcs  video  visualization  vr  web  webapp  wire-guided  workflow  working-stiff  worse-is-better/the-right-thing  yak-shaving  yarvin  yc  🖥 

Copy this bookmark: