composition-decomposition   54

« earlier    

maintenance - Why do dynamic languages make it more difficult to maintain large codebases? - Software Engineering Stack Exchange
Now here is the key point I have been building up to: there is a strong correlation between a language being dynamically typed and a language also lacking all the other facilities that make lowering the cost of maintaining a large codebase easier, and that is the key reason why it is more difficult to maintain a large codebase in a dynamic language. And similarly there is a correlation between a language being statically typed and having facilities that make programming in the larger easier.
programming  worrydream  plt  hmm  comparison  pls  carmack  techtariat  types  engineering  productivity  pro-rata  input-output  formal-methods  correlation  best-practices  composition-decomposition  error  causation  confounding  devtools  jvm  scala  open-closed 
6 weeks ago by nhaliday
Teach debugging
A friend of mine and I couldn't understand why some people were having so much trouble; the material seemed like common sense. The Feynman Method was the only tool we needed.

1. Write down the problem
2. Think real hard
3. Write down the solution

The Feynman Method failed us on the last project: the design of a divider, a real-world-scale project an order of magnitude more complex than anything we'd been asked to tackle before. On the day he assigned the project, the professor exhorted us to begin early. Over the next few weeks, we heard rumors that some of our classmates worked day and night without making progress.


And then, just after midnight, a number of our newfound buddies from dinner reported successes. Half of those who started from scratch had working designs. Others were despondent, because their design was still broken in some subtle, non-obvious way. As I talked with one of those students, I began poring over his design. And after a few minutes, I realized that the Feynman method wasn't the only way forward: it should be possible to systematically apply a mechanical technique repeatedly to find the source of our problems. Beneath all the abstractions, our projects consisted purely of NAND gates (woe to those who dug around our toolbox enough to uncover dynamic logic), which outputs a 0 only when both inputs are 1. If the correct output is 0, both inputs should be 1. The input that isn't is in error, an error that is, itself, the output of a NAND gate where at least one input is 0 when it should be 1. We applied this method recursively, finding the source of all the problems in both our designs in under half an hour.
techtariat  dan-luu  engineering  programming  debugging  IEEE  reflection  stories  education  higher-ed  checklists  iteration-recursion  divide-and-conquer  thinking  ground-up  nitty-gritty  giants  feynman  error  input-output  structure  composition-decomposition  abstraction  systematic-ad-hoc  reduction  teaching  state 
6 weeks ago by nhaliday
[1804.04268] Incomplete Contracting and AI Alignment
We suggest that the analysis of incomplete contracting developed by law and economics researchers can provide a useful framework for understanding the AI alignment problem and help to generate a systematic approach to finding solutions. We first provide an overview of the incomplete contracting literature and explore parallels between this work and the problem of AI alignment. As we emphasize, misalignment between principal and agent is a core focus of economic analysis. We highlight some technical results from the economics literature on incomplete contracts that may provide insights for AI alignment researchers. Our core contribution, however, is to bring to bear an insight that economists have been urged to absorb from legal scholars and other behavioral scientists: the fact that human contracting is supported by substantial amounts of external structure, such as generally available institutions (culture, law) that can supply implied terms to fill the gaps in incomplete contracts. We propose a research agenda for AI alignment work that focuses on the problem of how to build AI that can replicate the human cognitive processes that connect individual incomplete contracts with this supporting external structure.
nibble  preprint  org:mat  papers  ai  ai-control  alignment  coordination  contracts  law  economics  interests  culture  institutions  number  context  behavioral-econ  composition-decomposition  rent-seeking  whole-partial-many 
april 2018 by nhaliday
Society of Mind - Wikipedia
A core tenet of Minsky's philosophy is that "minds are what brains do". The society of mind theory views the human mind and any other naturally evolved cognitive systems as a vast society of individually simple processes known as agents. These processes are the fundamental thinking entities from which minds are built, and together produce the many abilities we attribute to minds. The great power in viewing a mind as a society of agents, as opposed to the consequence of some basic principle or some simple formal system, is that different agents can be based on different types of processes with different purposes, ways of representing knowledge, and methods for producing results.

This idea is perhaps best summarized by the following quote:

What magical trick makes us intelligent? The trick is that there is no trick. The power of intelligence stems from our vast diversity, not from any single, perfect principle. —Marvin Minsky, The Society of Mind, p. 308

The modular organization of human anatomical
brain networks: Accounting for the cost of wiring:
Brain networks are expected to be modular. However, existing techniques for estimating a network’s modules make it difficult to assess the influence of organizational principles such as wiring cost reduction on the detected modules. Here we present a modification of an existing module detection algorithm that allowed us to focus on connections that are unexpected under a cost-reduction wiring rule and to identify modules from among these connections. We applied this technique to anatomical brain networks and showed that the modules we detected differ from those detected using the standard technique. We demonstrated that these novel modules are spatially distributed, exhibit unique functional fingerprints, and overlap considerably with rich clubs, giving rise to an alternative and complementary interpretation of the functional roles of specific brain regions. Finally, we demonstrated that, using the modified module detection approach, we can detect modules in a developmental dataset that track normative patterns of maturation. Collectively, these findings support the hypothesis that brain networks are composed of modules and provide additional insight into the function of those modules.
books  ideas  speculation  structure  composition-decomposition  complex-systems  neuro  ai  psychology  cog-psych  intelligence  reduction  wiki  giants  philosophy  number  cohesion  diversity  systematic-ad-hoc  detail-architecture  pdf  study  neuro-nitgrit  brain-scan  nitty-gritty  network-structure  graphs  graph-theory  models  whole-partial-many  evopsych  eden  reference  psych-architecture  article  coupling-cohesion 
april 2018 by nhaliday
What are the Laws of Biology?
The core finding of systems biology is that only a very small subset of possible network motifs is actually used and that these motifs recur in all kinds of different systems, from transcriptional to biochemical to neural networks. This is because only those arrangements of interactions effectively perform some useful operation, which underlies some necessary function at a cellular or organismal level. There are different arrangements for input summation, input comparison, integration over time, high-pass or low-pass filtering, negative auto-regulation, coincidence detection, periodic oscillation, bistability, rapid onset response, rapid offset response, turning a graded signal into a sharp pulse or boundary, and so on, and so on.

These are all familiar concepts and designs in engineering and computing, with well-known properties. In living organisms there is one other general property that the designs must satisfy: robustness. They have to work with noisy components, at a scale that’s highly susceptible to thermal noise and environmental perturbations. Of the subset of designs that perform some operation, only a much smaller subset will do it robustly enough to be useful in a living organism. That is, they can still perform their particular functions in the face of noisy or fluctuating inputs or variation in the number of components constituting the elements of the network itself.
scitariat  reflection  proposal  ideas  thinking  conceptual-vocab  lens  bio  complex-systems  selection  evolution  flux-stasis  network-structure  structure  composition-decomposition  IEEE  robust  signal-noise  perturbation  interdisciplinary  graphs  circuits  🌞  big-picture  hi-order-bits  nibble  synthesis 
november 2017 by nhaliday
multivariate analysis - Is it possible to have a pair of Gaussian random variables for which the joint distribution is not Gaussian? - Cross Validated
The bivariate normal distribution is the exception, not the rule!

It is important to recognize that "almost all" joint distributions with normal marginals are not the bivariate normal distribution. That is, the common viewpoint that joint distributions with normal marginals that are not the bivariate normal are somehow "pathological", is a bit misguided.

Certainly, the multivariate normal is extremely important due to its stability under linear transformations, and so receives the bulk of attention in applications.

note: there is a multivariate central limit theorem, so those such applications have no problem
nibble  q-n-a  overflow  stats  math  acm  probability  distribution  gotchas  intricacy  characterization  structure  composition-decomposition  counterexample  limits  concentration-of-measure 
october 2017 by nhaliday
Genetic influences on measures of the environment: a systematic review | Psychological Medicine | Cambridge Core
Background. Traditional models of psychiatric epidemiology often assume that the relationship between individuals and their environment is unidirectional, from environment to person. Accumulating evidence from developmental and genetic studies has made this perspective increasingly untenable.

Results. We identified 55 independent studies organized into seven categories: general and specific stressful life events (SLEs), parenting as reported by child, parenting reported by parent, family environment, social support, peer interactions, and marital quality. Thirty-five environmental measures in these categories were examined by at least two studies and produced weighted heritability estimates ranging from 7% to 39%, with most falling between 15% and 35%. The weighted heritability for all environmental measures in all studies was 27%. The weighted heritability for environmental measures by rating method was: self-report 29%, informant report 26%, and direct rater or videotape observation (typically examining 10 min of behavior) 14%.
study  meta-analysis  biodet  behavioral-gen  genetics  population-genetics  🌞  regularizer  environmental-effects  GxE  psychiatry  epidemiology  composition-decomposition 
october 2017 by nhaliday

« earlier    

related tags

:/  aaronson  abstraction  accuracy  acm  acmtariat  adversarial  africa  age-generation  aging  ai-control  ai  alesina  algebra  algebraic-complexity  algorithms  alignment  altruism  analogy  analysis  analytical-holistic  anarcho-tyranny  anthropology  aphorism  arrows  article  asia  atoms  attention  authoritarianism  autism  axelrod  backup  behavioral-econ  behavioral-gen  being-becoming  benchmarks  best-practices  better-explained  big-peeps  big-picture  bio  biodet  bioinformatics  bits  books  brain-scan  britain  broad-econ  build-packacing  calculation  cancer  capital  capitalism  cardio  career  carmack  causation  characterization  chart  cheatsheet  checking  checklists  china  christianity  circuits  civic  civil-liberty  cjones-like  clarity  class  classification  closure  cocktail  coding-theory  cog-psych  cohesion  cold-war  collaboration  commentary  communism  comparison  compensation  competition  complex-systems  complexity  computation  computer-vision  concentration-of-measure  concept  conceptual-vocab  confounding  conquest-empire  context  contracts  contradiction  contrarianism  convexity-curvature  cool  cooperate-defect  coordination  correlation  cost-benefit  counter-revolution  counterexample  coupling-cohesion  critique  cs  cultural-dynamics  culture  current-events  curvature  cybernetics  cycles  dan-luu  data-science  data-structures  data  database  dataviz  debate  debugging  decentralized  decision-making  decision-theory  deep-learning  deep-materialism  definition  degrees-of-freedom  demographics  dennett  density  dependence-independence  descriptive  desktop  detail-architecture  developing-world  developmental  devtools  dimensionality  direct-indirect  discipline  discussion  disease  distribution  divergence  diversity  divide-and-conquer  dropbox  early-modern  econ-metrics  econ-productivity  economics  econotariat  eden  education  effect-size  efficiency  egalitarianism-hierarchy  elegance  elite  embodied  emergent  emotion  empirical  ems  endo-exo  endogenous-exogenous  energy-resources  engineering  enlightenment-renaissance-restoration-reformation  ensembles  entropy-like  environmental-effects  envy  epidemiology  epigenetics  error  essay  ethics  ethnocentrism  eu  europe  evolution  evopsych  examples  exit-voice  exocortex  expanders  expert-experience  explanans  explanation  exploratory  exposition  extratricky  extrema  farmers-and-foragers  features  feynman  field-study  fields  fluid  flux-stasis  food  foreign-policy  formal-methods  formal-values  forms-instances  fourier  frequency  frontier  futurism  games  garett-jones  gavisti  gender-diff  gender  gene-drift  general-survey  generalization  genetic-correlation  genetics  genomics  geography  germanic  giants  gnon  gotchas  government  gradient-descent  graph-theory  graphs  gregory-clark  ground-up  group-selection  growth-econ  gt-101  guide  gwas  gwern  gxe  hanson  hardness  hardware  hari-seldon  harvard  hi-order-bits  higher-ed  history  hive-mind  hmm  hn  homo-hetero  honor  howto  hsu  human-capital  hypocrisy  ideas  identity-politics  identity  ideology  idk  ieee  immune  increase-decrease  india  industrial-revolution  inequality  info-dynamics  info-econ  information-theory  init  innovation  input-output  insight  institutions  integrity  intelligence  interdisciplinary  interests  interpretability  interpretation  intervention  intricacy  intuition  iq  iron-age  ising  iteration-recursion  japan  jargon  justice  jvm  labor  language  latin-america  law  lecture-notes  legacy  len:long  len:short  lens  lesswrong  let-me-see  levers  leviathan  libraries  lifts-projections  limits  linear-algebra  linguistics  links  list  local-global  long-short-run  long-term  longevity  lower-bounds  machine-learning  macro  madisonian  magnitude  male-variability  malthus  managerial-state  map-territory  maps  markets  markov  math.ds  math  matrix-factorization  measure  measurement  mechanics  medicine  mediterranean  mena  meta-analysis  metabuch  metameta  methodology  metrics  micro  microfoundations  migration  minimalism  missing-heritability  model-class  models  modernity  moments  morality  mostly-modern  motivation  multi  mutation  n-factor  nationalism-globalism  natural-experiment  network-structure  neuro-nitgrit  neuro  neurons  new-religion  news  nibble  nitty-gritty  no-go  nonlinearity  novelty  number  obesity  objective-measure  objektbuch  occam  off-convex  oly  open-closed  optimization  order-disorder  orders  org:bleg  org:edu  org:mag  org:mat  org:nat  org:ngo  org:popup  organizing  oscillation  overflow  p:someday  papers  parenting  parsimony  patience  pdf  peace-violence  percolation  performance  personality  perturbation  phalanges  philosophy  phys-energy  physics  pic  piracy  planning  plots  pls  plt  polisci  politics  poll  pop-structure  population-genetics  population  power-law  pragmatic  prediction  preprint  pro-rata  probability  problem-solving  productivity  programming  project  proofs  properties  proposal  prudence  pseudoe  psych-architecture  psychiatry  psychology  psychometrics  public-goodish  public-health  putnam-like  puzzles  python  q-n-a  qtl  quantitative-qualitative  questions  quixotic  race  random  rant  ratty  reading  realness  rec-math  reduction  reference  reflection  regularization  regularizer  religion  rent-seeking  research  review  rhetoric  robust  roots  russia  s-factor  s:*  sapiens  scala  scale  scaling-up  sci-comp  science  scitariat  search  selection  self-interest  self-report  sequential  series  sex  shift  sib-study  siggraph  signal-noise  slides  soccer  social-capital  social-norms  social-psych  social-science  social  society  sociology  software  space  spatial  spearhead  speculation  speedometer  sports  ssc  stackex  stagnation  stat-power  state-of-art  state  stats  status  stock-flow  stories  street-fighting  stress  structure  study  stylized-facts  success  summary  supply-demand  survey  symmetry  syntax  synthesis  systematic-ad-hoc  tcs  tcstariat  teaching  tech  technology  techtariat  temperature  terminal  the-classics  the-great-west-whale  the-self  the-trenches  thermo  things  thinking  tightness  time-complexity  time-preference  time-series  time  tip-of-tongue  todo  tools  top-n  trade  tradeoffs  trees  trends  tribalism  tricki  trivia  trust  turchin  tutorial  twin-study  twitter  types  unaffiliated  unintended-consequences  unit  universalism-particularism  unix  unsupervised  urban-rural  us-them  usa  values  vampire-squid  variance-components  visual-understanding  visualization  visuo  volo-avolo  walls  waves  wealth-of-nations  wealth  whiggish-hegelian  white-paper  whole-partial-many  wiki  within-without  workflow  working-stiff  world  worrydream  yak-shaving  yoga  yvain  zeitgeist  🌞  🎩  👳  🖥 

Copy this bookmark: