nhaliday + repo   54

Call graph - Wikipedia
I've found both static and dynamic versions useful (former mostly when I don't want to go thru pain of compiling something)

best options AFAICT:

C/C++ and maybe Go: https://github.com/gperftools/gperftools

static: https://github.com/Vermeille/clang-callgraph
I had to go through some extra pain to get this to work:
- if you use Homebrew LLVM (that's slightly incompatible w/ macOS c++filt, make sure to pass -n flag)
- similarly macOS sed needs two extra backslashes for each escape of the angle brackets

another option: doxygen

Go: https://stackoverflow.com/questions/31362332/creating-call-graph-in-golang
both static and dynamic in one tool

Java: https://github.com/gousiosg/java-callgraph
both static and dynamic in one tool

more up-to-date forks: https://github.com/daneads/pycallgraph2 and https://github.com/YannLuo/pycallgraph
old docs: https://pycallgraph.readthedocs.io/en/master/
I've had some trouble getting nice output from this (even just getting the right set of nodes displayed, not even taking into account layout and formatting).
- Argument parsing syntax is idiosyncratic. Just read `pycallgraph --help`.
- Options -i and -e take glob patterns (see pycallgraph2/{tracer,globbing_filter}.py), which are applied the function names qualified w/ module paths.
- Functions defined in the script you are running receive no module path. There is no easy way to filter for them using the -i and -e options.
- The --debug option gives you the graphviz for your own use instead of just writing the final image produced.

static: https://github.com/davidfraser/pyan
more up-to-date fork: https://github.com/itsayellow/pyan/
one way to good results: `pyan -dea --format yed $MODULE_FILES > output.graphml`, then open up in yEd and use hierarchical layout

various: https://github.com/jrfonseca/gprof2dot

I believe all the dynamic tools listed here support weighting nodes and edges by CPU time/samples (inclusive and exclusive of descendants) and discrete calls. In the case of the gperftools and the Java option you probably have to parse the output to get the latter, tho.

IIRC Dtrace has probes for function entry/exit. So that's an option as well.

old pin: https://github.com/nst/objc_dep
Graph the import dependancies in an Objective-C project
concept  wiki  reference  tools  devtools  graphs  trees  programming  code-dive  let-me-see  big-picture  libraries  software  recommendations  list  top-n  links  c(pp)  golang  python  javascript  jvm  stackex  q-n-a  howto  yak-shaving  visualization  dataviz  performance  structure  oss  osx  unix  linux  static-dynamic  repo  cocoa 
july 2019 by nhaliday
c++ - Debugging template instantiations - Stack Overflow
Yes, there is a template metaprogramming debugger. Templight

Seems to be dead now, though :( [ed.: Partially true. They've merged pull requests recently tho.]
Metashell is still in active development though: github.com/metashell/metashell
q-n-a  stackex  nitty-gritty  pls  types  c(pp)  debugging  devtools  tools  programming  howto  advice  checklists  multi  repo  wire-guided  static-dynamic  compilers  performance  measurement  time  latency-throughput 
may 2019 by nhaliday
Burrito: Rethinking the Electronic Lab Notebook
Seems very well-suited for ML experiments (if you can get it to work), also the nilfs aspect is cool and basically implements exactly one of the my project ideas (mini-VCS for competitive programming). Unfortunately gnarly installation instructions specify running it on Linux VM: https://github.com/pgbovine/burrito/blob/master/INSTALL. Linux is hard requirement due to nilfs.
techtariat  project  tools  devtools  linux  programming  yak-shaving  integration-extension  nitty-gritty  workflow  exocortex  scholar  software  python  app  desktop  notetaking  state  machine-learning  data-science  nibble  sci-comp  oly  vcs  multi  repo  paste  homepage  research 
may 2019 by nhaliday
Which benchmark programs are faster? | Computer Language Benchmarks Game
includes Scala

very outdated but more languages: https://web.archive.org/web/20110401183159/http://shootout.alioth.debian.org:80/

OCaml seems to offer the best tradeoff of performance vs parsimony (Haskell not so much :/)
old official: https://web.archive.org/web/20130731195711/http://benchmarksgame.alioth.debian.org/u64q/code-used-time-used-shapes.php
Haskell does better here

other PL benchmarks:
BF 2.0:
Kotlin, C++ (GCC), Rust < Nim, D (GDC,LDC), Go, MLton < Crystal, Go (GCC), C# (.NET Core), Scala, Java, OCaml < D (DMD) < C# Mono < Javascript V8 < F# Mono, Javascript Node, Haskell (MArray) << LuaJIT << Python PyPy < Haskell < Racket <<< Python << Python3
C++ (GCC) << Crystal < Rust, D (GDC), Go (GCC) < Nim, D (LDC) << C# (.NET Core) < MLton << Kotlin << OCaml << Scala, Java << D (DMD) << Go << C# Mono << Javascript Node << Haskell (MArray) << LuaJIT < Python PyPy << F# Mono <<< Racket
C++, Rust, Java w/ custom non-stdlib code < Python PyPy < C# .Net Core < Javscript Node < Go, unoptimized C++ (no -O2) << PHP << Java << Python3 << Python
comparison  pls  programming  performance  benchmarks  list  top-n  ranking  systems  time  multi  🖥  cost-benefit  tradeoffs  data  analysis  plots  visualization  measure  intricacy  parsimony  ocaml-sml  golang  rust  jvm  javascript  c(pp)  functional  haskell  backup  scala  realness  generalization  accuracy  techtariat  crosstab  database  repo  objektbuch  static-dynamic  gnu  mobile 
december 2018 by nhaliday
Use and Interpretation of LD Score Regression
LD Score regression distinguishes confounding from polygenicity in genome-wide association studies: https://sci-hub.bz/10.1038/ng.3211
- Po-Ru Loh, Nick Patterson, et al.


Both polygenicity (i.e. many small genetic effects) and confounding biases, such as cryptic relatedness and population stratification, can yield inflated distributions of test statistics in genome-wide association studies (GWAS). However, current methods cannot distinguish between inflation from bias and true signal from polygenicity. We have developed an approach that quantifies the contributions of each by examining the relationship between test statistics and linkage disequilibrium (LD). We term this approach LD Score regression. LD Score regression provides an upper bound on the contribution of confounding bias to the observed inflation in test statistics and can be used to estimate a more powerful correction factor than genomic control. We find strong evidence that polygenicity accounts for the majority of test statistic inflation in many GWAS of large sample size.

Supplementary Note: https://images.nature.com/original/nature-assets/ng/journal/v47/n3/extref/ng.3211-S1.pdf

An atlas of genetic correlations across human diseases
and traits: https://sci-hub.bz/10.1038/ng.3406


Supplementary Note: https://images.nature.com/original/nature-assets/ng/journal/v47/n11/extref/ng.3406-S1.pdf

ldsc is a command line tool for estimating heritability and genetic correlation from GWAS summary statistics. ldsc also computes LD Scores.
nibble  pdf  slides  talks  bio  biodet  genetics  genomics  GWAS  genetic-correlation  correlation  methodology  bioinformatics  concept  levers  🌞  tutorial  explanation  pop-structure  gene-drift  ideas  multi  study  org:nat  article  repo  software  tools  libraries  stats  hypothesis-testing  biases  confounding  gotchas  QTL  simulation  survey  preprint  population-genetics 
november 2017 by nhaliday
Spaceship Generator | Hacker News
some interesting discussion of the value of procedural generation in the comments
commentary  hn  graphics  games  programming  libraries  repo  oss  project  SIGGRAPH  random  generative 
june 2016 by nhaliday
dwimmer means sorcery, but idk what this is otherwise, maybe a logic programming repl?

relevant?: https://ai-alignment.com/learning-and-logic-e96bd41b1ab5
rationality  programming  tools  thinking  idk  worrydream  repo  clever-rats  ratty  multi  org:med  acmtariat  ai-control 
april 2016 by nhaliday
The goal of the Lean Forward project is to collaborate with number theorists to formally prove theorems about research mathematics and to address the main usability issues hampering the adoption of proof assistants in mathematical circles. The theorems will be selected together with our collaborators to guide the development of formal libraries and verified tools.

mostly happening in the Netherlands


A Review of the Lean Theorem Prover: https://jiggerwit.wordpress.com/2018/09/18/a-review-of-the-lean-theorem-prover/
- Thomas Hales
seems like a Coq might be a better starter if I ever try to get into proof assistants/theorem provers

edit: on second thought this actually seems like a wash for beginners

An Argument for Controlled Natural Languages in Mathematics: https://jiggerwit.wordpress.com/2019/06/20/an-argument-for-controlled-natural-languages-in-mathematics/
By controlled natural language for mathematics (CNL), we mean an artificial language for the communication of mathematics that is (1) designed in a deliberate and explicit way with precise computer-readable syntax and semantics, (2) based on a single natural language (such as Chinese, Spanish, or English), and (3) broadly understood at least in an intuitive way by mathematically literate speakers of the natural language.

The definition of controlled natural language is intended to exclude invented languages such as Esperanto and Logjam that are not based on a single natural language. Programming languages are meant to be excluded, but a case might be made for TeX as the first broadly adopted controlled natural language for mathematics.

Perhaps it is best to start with an example. Here is a beautifully crafted CNL text created by Peter Koepke and Steffen Frerix. It reproduces a theorem and proof in Rudin’s Principles of mathematical analysis almost word for word. Their automated proof system is able to read and verify the proof.

research  math  formal-methods  msr  multi  homepage  research-program  skunkworks  math.NT  academia  ux  CAS  mathtariat  expert-experience  cost-benefit  nitty-gritty  review  critique  rant  types  learning  intricacy  functional  performance  c(pp)  ocaml-sml  comparison  ecosystem  DSL  tradeoffs  composition-decomposition  interdisciplinary  europe  germanic  grokkability  nlp  language  heavyweights  inference  rigor  automata-languages  repo  software  tools  syntax  frontier  state-of-art  pls  grokkability-clarity  technical-writing  database  lifts-projections 
january 2016 by nhaliday

bundles : meta

related tags

abstraction  academia  accretion  accuracy  acm  acmtariat  advanced  advertising  advice  aggregator  ai-control  algorithms  allodium  analysis  anthropology  api  app  arrows  article  atoms  automata-languages  backup  behavioral-gen  ben-recht  benchmarks  best-practices  biases  big-picture  bio  biodet  bioinformatics  bitcoin  blockchain  blog  books  bots  browser  c(pp)  caching  career  carmack  CAS  cheatsheet  checking  checklists  classification  clever-rats  client-server  cloud  cocoa  code-dive  cog-psych  collaboration  commentary  communication  comparison  compilers  composition-decomposition  computer-vision  concept  conference  config  confluence  confounding  cool  correctness  correlation  cost-benefit  coupling-cohesion  critique  crosstab  cryptocurrency  d-lang  d3  dan-luu  data  data-science  database  dataviz  dbs  debugging  deep-learning  desktop  detail-architecture  devtools  differential-privacy  diogenes  distributed  documentation  dotnet  DSL  dynamic  ecosystem  editors  embedded  embeddings  engineering  europe  examples  exocortex  expert-experience  explanation  exposition  facebook  features  finance  flux-stasis  form-design  formal-methods  frameworks  frontend  frontier  functional  games  gene-drift  generalization  generative  genetic-correlation  genetics  genomics  germanic  git  github  gnu  golang  google  gotchas  graphical-models  graphics  graphs  grokkability  grokkability-clarity  guide  GWAS  gwern  hardware  haskell  heavyweights  history  hmm  hn  homepage  homo-hetero  howto  huge-data-the-biggest  human-ml  hypothesis-testing  ideas  idk  IEEE  inference  info-foraging  init  integration-extension  interdisciplinary  internet  interview-prep  intricacy  investigative-journo  investing  iteration-recursion  jargon  javascript  jobs  jvm  keyboard  language  latency-throughput  latent-variables  learning  lecture-notes  lectures  let-me-see  levers  lexical  libraries  lifts-projections  links  linux  lisp  list  llvm  long-short-run  machine-learning  maps  math  math.NT  mathtariat  measure  measurement  mechanics  media  meta:rhetoric  metal-to-virtual  methodology  minimalism  minimum-viable  mobile  model-class  money  move-fast-(and-break-things)  msr  multi  networking  nibble  nihil  nitty-gritty  nlp  nostalgia  notetaking  numerics  objektbuch  ocaml-sml  oly  oly-programming  org:bleg  org:com  org:med  org:nat  os  oss  osx  outliers  p2p  p:*  p:someday  p:whenever  parsimony  paste  pdf  pennsylvania  performance  personal-finance  physics  pinboard  plots  pls  pop-structure  population-genetics  pragmatic  preprint  presentation  pro-rata  productivity  programming  progression  project  protocol-metadata  prudence  psychology  psychometrics  puzzles  python  q-n-a  QTL  quantified-self  questions  quixotic  r-lang  random  ranking  rant  rationality  ratty  reading  realness  recommendations  recruiting  reddit  reference  reflection  reinforcement  repo  research  research-program  resources-effects  retention  review  rigor  roadmap  rust  scala  scaling-tech  scholar  sci-comp  search  securities  sentiment  sequential  SIGGRAPH  simplification-normalization  simulation  skunkworks  sleuthin  slides  social  software  spreading  stackex  stagnation  state  state-of-art  static-dynamic  stats  stream  strings  structure  study  summary  survey  syntax  synthesis  system-design  systems  talks  tech  technical-writing  techtariat  terminal  thinking  time  tip-of-tongue  todo  tools  top-n  traces  tradeoffs  transitions  trees  trivia  tutorial  types  ui  unit  unix  usa  usaco-ioi  ux  vcs  video  virginia-DC  virtualization  visualization  visuo  vr  water  web  wiki  wire-guided  workflow  working-stiff  workshop  worrydream  yak-shaving  🌞  🖥 

Copy this bookmark: