nhaliday + org:mat   91

[1804.04268] Incomplete Contracting and AI Alignment
We suggest that the analysis of incomplete contracting developed by law and economics researchers can provide a useful framework for understanding the AI alignment problem and help to generate a systematic approach to finding solutions. We first provide an overview of the incomplete contracting literature and explore parallels between this work and the problem of AI alignment. As we emphasize, misalignment between principal and agent is a core focus of economic analysis. We highlight some technical results from the economics literature on incomplete contracts that may provide insights for AI alignment researchers. Our core contribution, however, is to bring to bear an insight that economists have been urged to absorb from legal scholars and other behavioral scientists: the fact that human contracting is supported by substantial amounts of external structure, such as generally available institutions (culture, law) that can supply implied terms to fill the gaps in incomplete contracts. We propose a research agenda for AI alignment work that focuses on the problem of how to build AI that can replicate the human cognitive processes that connect individual incomplete contracts with this supporting external structure.
nibble  preprint  org:mat  papers  ai  ai-control  alignment  coordination  contracts  law  economics  interests  culture  institutions  number  context  behavioral-econ  composition-decomposition  rent-seeking  whole-partial-many 
april 2018 by nhaliday
[1410.0369] The Universe of Minds
kinda dumb, don't think this guy is anywhere close to legit (e.g., he claims set of mind designs is countable, but gives no actual reason to believe that)
papers  preprint  org:mat  ratty  miri-cfar  ai  intelligence  philosophy  logic  software  cs  computation  the-self 
march 2018 by nhaliday
[1509.02504] Electric charge in hyperbolic motion: The early history and other geometrical aspects
We revisit the early work of Minkowski and Sommerfeld concerning hyperbolic motion, and we describe some geometrical aspects of the electrodynamic interaction. We discuss the advantages of a time symmetric formulation in which the material points are replaced by infinitesimal length elements.

SPACE AND TIME: An annotated, illustrated edition of Hermann Minkowski's revolutionary essay: http://web.mit.edu/redingtn/www/netadv/SP20130311.html
nibble  preprint  papers  org:mat  physics  electromag  relativity  exposition  history  mostly-modern  pre-ww2  science  the-trenches  discovery  intricacy  classic  explanation  einstein  giants  plots  manifolds  article  multi  liner-notes  org:junk  org:edu  absolute-relative 
november 2017 by nhaliday
We find that supporters of the major parties (Labour, the Conservatives and the Liberal Democrats) have substantively different personality traits. Moreover, we show that those not identifying with any party, who are close to holding the majority, are similar to those identifying with the Conservatives. We show that these results are robust to controlling for cognitive skills and parental party preferences, and to estimation on a subsample of siblings. The relationship between personality traits and party identification is stable across birth cohorts.

Table 2: Big Five Personality Traits: Predictions.
Figure 3: Relationship between personality traits and stable party identification

Conservative core supporters are antagonistic towards others (low Agreeableness), they are closed to new experiences (low Openness), they are energetic and enthusiastic (high Extraversion), they are goal-orientated (high Conscientiousness), and they are even-tempered (low Neuroticism).

In contrast, the core supporters of the Labour Party have a pro-social and communal attitude (high Agreeableness), they are open to new experiences and ideas (high Openness), but they are more anxious, tense and discontented (high Neuroticism) and less prone to goal-directed behavior (low Conscientiousness). The core supporters of the Liberal Democrats have similar traits to the typical Labour supporters with two exceptions. First, they do not show any particular tendency towards pro-social and communal attitudes (insignificant Agreeableness). Second, they are more reserved and introverted than the more extraverted supporters of either the Conservatives or Labour (low Extraversion).

Psychological and Personality Profiles of Political Extremists: https://arxiv.org/pdf/1704.00119.pdf
We revisit the debate over the appeal of extremism in the U.S. context by comparing publicly available Twitter messages written by over 355,000 political extremist followers with messages written by non-extremist U.S. users. Analysis of text-based psychological indicators supports the moral foundation theory which identifies emotion as a critical factor in determining political orientation of individuals. Extremist followers also differ from others in four of the Big Five personality traits.

Fig. 2. Comparing psychological profiles of the followers of moderate and extremist single-issue groups, compared to random users.

Overall, the differences in psychological profile between followers of extremist and moderate groups is much larger for left-wing extremists (environmentalists) than right-wing (anti-abortion and anti-immigrant).

Fig. 3. Big Five Personality Profiles.

Results show that extremist followers (whether left or right) are less agreeable, less neurotic, and more open than nonextremists.

Ideology as Motivated Cultural Cognition: How Culture Translates Personality into Policy Preferences: https://www.psa.ac.uk/sites/default/files/conference/papers/2017/Ideology%20as%20Motivated%20Cultural%20Cognition.pdf
This paper summarises the results of a quantitative analysis testing the theory that culture acts as an intermediary in the relationship between individual perceptual tendencies and political orientation. Political psychologists have long observed that more “left-wing” individuals tend to be more comfortable than “right-wing” individuals with ambiguity, disorder, and uncertainty, to equivocate more readily between conflicting viewpoints, and to be more willing to change their opinions. These traits are often summarised under the blanket term of “open-mindedness”. A recent increase in cross-cultural studies, however, has indicated that these relationships are far less robust, and even reversed, in social contexts outside of North America and Western Europe. The sociological concept of culture may provide an answer to this inconsistency: emergent idea-networks, irreducible to individuals, which nonetheless condition psychological motivations, so that perceptual factors resulting in left-wing preferences in one culture may result in opposing preferences in another. The key is that open-mindedness leads individuals to attack the dominant ideas which they encounter: if prevailing orthodoxies happen to be left-wing, then open minded individuals may become right-wing in protest. Using conditional process analysis of the British Election Study, I find evidence for three specific mechanisms whereby culture interferes with perceptual influences on politics. Conformity to the locally dominant culture mediates these influences, in the sense that open-minded people in Britain are only more left-wing because they are less culturally conformal. This relationship is itself moderated both by cultural group membership and by Philip Converse’s notion of “constraint”, individual-level connectivity between ideas, such that the strength of perceptual influence differs significantly between cultural groups and between levels of constraint to the idea of the political spectrum. Overall, I find compelling evidence for the importance of culture in shaping perceptions of policy choices.
pdf  study  polisci  sociology  politics  ideology  personality  psych-architecture  correlation  britain  coalitions  phalanges  data  things  multi  preprint  psychology  social-psych  cog-psych  culture-war  gnon  🐸  subculture  objective-measure  demographics  org:mat  creative  culture  society  cultural-dynamics  anthropology  hari-seldon  discipline  extra-introversion  stress  individualism-collectivism  expression-survival  values  poll  chart  curiosity 
november 2017 by nhaliday
Stability of the Solar System - Wikipedia
The stability of the Solar System is a subject of much inquiry in astronomy. Though the planets have been stable when historically observed, and will be in the short term, their weak gravitational effects on one another can add up in unpredictable ways. For this reason (among others) the Solar System is chaotic,[1] and even the most precise long-term models for the orbital motion of the Solar System are not valid over more than a few tens of millions of years.[2]

The Solar System is stable in human terms, and far beyond, given that it is unlikely any of the planets will collide with each other or be ejected from the system in the next few billion years,[3] and the Earth's orbit will be relatively stable.[4]

Since Newton's law of gravitation (1687), mathematicians and astronomers (such as Laplace, Lagrange, Gauss, Poincaré, Kolmogorov, Vladimir Arnold and Jürgen Moser) have searched for evidence for the stability of the planetary motions, and this quest led to many mathematical developments, and several successive 'proofs' of stability of the Solar System.[5]


The planets' orbits are chaotic over longer timescales, such that the whole Solar System possesses a Lyapunov time in the range of 2–230 million years.[3] In all cases this means that the position of a planet along its orbit ultimately becomes impossible to predict with any certainty (so, for example, the timing of winter and summer become uncertain), but in some cases the orbits themselves may change dramatically. Such chaos manifests most strongly as changes in eccentricity, with some planets' orbits becoming significantly more—or less—elliptical.[7]

Is the Solar System Stable?: https://www.ias.edu/ideas/2011/tremaine-solar-system

Is the Solar System Stable?: https://arxiv.org/abs/1209.5996
nibble  wiki  reference  article  physics  mechanics  space  gravity  flux-stasis  uncertainty  robust  perturbation  math  dynamical  math.DS  volo-avolo  multi  org:edu  org:inst  papers  preprint  time  data  org:mat 
november 2017 by nhaliday
[1709.01149] Biotechnology and the lifetime of technical civilizations
The number of people able to end Earth's technical civilization has heretofore been small. Emerging dual-use technologies, such as biotechnology, may give similar power to thousands or millions of individuals. To quantitatively investigate the ramifications of such a marked shift on the survival of both terrestrial and extraterrestrial technical civilizations, this paper presents a two-parameter model for civilizational lifespans, i.e. the quantity L in Drake's equation for the number of communicating extraterrestrial civilizations. One parameter characterizes the population lethality of a civilization's biotechnology and the other characterizes the civilization's psychosociology. L is demonstrated to be less than the inverse of the product of these two parameters. Using empiric data from Pubmed to inform the biotechnology parameter, the model predicts human civilization's median survival time as decades to centuries, even with optimistic psychosociological parameter values, thereby positioning biotechnology as a proximate threat to human civilization. For an ensemble of civilizations having some median calculated survival time, the model predicts that, after 80 times that duration, only one in 1024 civilizations will survive -- a tempo and degree of winnowing compatible with Hanson's "Great Filter." Thus, assuming that civilizations universally develop advanced biotechnology, before they become vigorous interstellar colonizers, the model provides a resolution to the Fermi paradox.
preprint  article  gedanken  threat-modeling  risk  biotech  anthropic  fermi  ratty  hanson  models  xenobio  space  civilization  frontier  hmm  speedometer  society  psychology  social-psych  anthropology  cultural-dynamics  disease  parasites-microbiome  maxim-gun  prepping  science-anxiety  technology  magnitude  scale  data  prediction  speculation  ideas  🌞  org:mat  study  offense-defense  arms  unintended-consequences  spreading  explanans  sociality  cybernetics 
october 2017 by nhaliday
[1709.06560] Deep Reinforcement Learning that Matters
I’ve been experimenting w/ various kinds of value function approaches to RL lately, and its striking how primitive and bad things seem to be
At first I thought it was just that my code sucks, but then I played with the OpenAI baselines and nope, it’s the children that are wrong.
And now, what comes across my desk but this fantastic paper: (link: https://arxiv.org/abs/1709.06560) arxiv.org/abs/1709.06560 How long until the replication crisis hits AI?

Seriously I’m not blown away by the PhDs’ records over the last 30 years. I bet you’d get better payoff funding eccentrics and amateurs.
There are essentially zero fundamentally new ideas in AI, the papers are all grotesquely hyperparameter tuned, nobody knows why it works.

Deep Reinforcement Learning Doesn't Work Yet: https://www.alexirpan.com/2018/02/14/rl-hard.html
Once, on Facebook, I made the following claim.

Whenever someone asks me if reinforcement learning can solve their problem, I tell them it can’t. I think this is right at least 70% of the time.
papers  preprint  machine-learning  acm  frontier  speedometer  deep-learning  realness  replication  state-of-art  survey  reinforcement  multi  twitter  social  discussion  techtariat  ai  nibble  org:mat  unaffiliated  ratty  acmtariat  liner-notes  critique  sample-complexity  cost-benefit  todo 
september 2017 by nhaliday
Fermat's Library | Cassini, Rømer and the velocity of light annotated/explained version.
Abstract: The discovery of the finite nature of the velocity of light is usually attributed to Rømer. However, a text at the Paris Observatory confirms the minority opinion according to which Cassini was first to propose the ‘successive motion’ of light, while giving a rather correct order of magnitude for the duration of its propagation from the Sun to the Earth. We examine this question, and discuss why, in spite of the criticisms of Halley, Cassini abandoned this hypothesis while leaving Rømer free to publish it.
liner-notes  papers  essay  history  early-modern  europe  the-great-west-whale  giants  the-trenches  mediterranean  nordic  science  innovation  discovery  physics  electromag  space  speed  nibble  org:sci  org:mat 
september 2017 by nhaliday
Genomic analysis of family data reveals additional genetic effects on intelligence and personality | bioRxiv
Using Extended Genealogy to Estimate Components of Heritability for 23 Quantitative and Dichotomous Traits: http://journals.plos.org/plosgenetics/article?id=10.1371/journal.pgen.1003520
Pedigree- and SNP-Associated Genetics and Recent Environment are the Major Contributors to Anthropometric and Cardiometabolic Trait Variation: http://journals.plos.org/plosgenetics/article?id=10.1371/journal.pgen.1005804

Missing Heritability – found?: https://westhunt.wordpress.com/2017/02/09/missing-heritability-found/
There is an interesting new paper out on genetics and IQ. The claim is that they have found the missing heritability – in rare variants, generally different in each family.

Some of the variants, the ones we find with GWAS, are fairly common and fitness-neutral: the variant that slightly increases IQ confers the same fitness (or very close to the same) as the one that slightly decreases IQ – presumably because of other effects it has. If this weren’t the case, it would be impossible for both of the variants to remain common.

The rare variants that affect IQ will generally decrease IQ – and since pleiotropy is the norm, usually they’ll be deleterious in other ways as well. Genetic load.

Happy families are all alike; every unhappy family is unhappy in its own way.: https://westhunt.wordpress.com/2017/06/06/happy-families-are-all-alike-every-unhappy-family-is-unhappy-in-its-own-way/
It now looks as if the majority of the genetic variance in IQ is the product of mutational load, and the same may be true for many psychological traits. To the extent this is the case, a lot of human psychological variation must be non-adaptive. Maybe some personality variation fulfills an evolutionary function, but a lot does not. Being a dumb asshole may be a bug, rather than a feature. More generally, this kind of analysis could show us whether particular low-fitness syndromes, like autism, were ever strategies – I suspect not.

It’s bad new news for medicine and psychiatry, though. It would suggest that what we call a given type of mental illness, like schizophrenia, is really a grab-bag of many different syndromes. The ultimate causes are extremely varied: at best, there may be shared intermediate causal factors. Not good news for drug development: individualized medicine is a threat, not a promise.

see also comment at: https://pinboard.in/u:nhaliday/b:a6ab4034b0d0

So the big implication here is that it's better than I had dared hope - like Yang/Visscher/Hsu have argued, the old GCTA estimate of ~0.3 is indeed a rather loose lower bound on additive genetic variants, and the rest of the missing heritability is just the relatively uncommon additive variants (ie <1% frequency), and so, like Yang demonstrated with height, using much more comprehensive imputation of SNP scores or using whole-genomes will be able to explain almost all of the genetic contribution. In other words, with better imputation panels, we can go back and squeeze out better polygenic scores from old GWASes, new GWASes will be able to reach and break the 0.3 upper bound, and eventually we can feasibly predict 0.5-0.8. Between the expanding sample sizes from biobanks, the still-falling price of whole genomes, the gradual development of better regression methods (informative priors, biological annotation information, networks, genetic correlations), and better imputation, the future of GWAS polygenic scores is bright. Which obviously will be extremely helpful for embryo selection/genome synthesis.

The argument that this supports mutation-selection balance is weaker but plausible. I hope that it's true, because if that's why there is so much genetic variation in intelligence, then that strongly encourages genetic engineering - there is no good reason or Chesterton fence for intelligence variants being non-fixed, it's just that evolution is too slow to purge the constantly-accumulating bad variants. And we can do better.

The surprising implications of familial association in disease risk: https://arxiv.org/abs/1707.00014
As Greg Cochran has pointed out, this probably isn’t going to work. There are a few genes like BRCA1 (which makes you more likely to get breast and ovarian cancer) that we can detect and might affect treatment, but an awful lot of disease turns out to be just the result of random chance and deleterious mutation. This means that you can’t easily tailor disease treatment to people’s genes, because everybody is fucked up in their own special way. If Johnny is schizophrenic because of 100 random errors in the genes that code for his neurons, and Jack is schizophrenic because of 100 other random errors, there’s very little way to test a drug to work for either of them- they’re the only one in the world, most likely, with that specific pattern of errors. This is, presumably why the incidence of schizophrenia and autism rises in populations when dads get older- more random errors in sperm formation mean more random errors in the baby’s genes, and more things that go wrong down the line.

The looming crisis in human genetics: http://www.economist.com/node/14742737
Some awkward news ahead
- Geoffrey Miller

Human geneticists have reached a private crisis of conscience, and it will become public knowledge in 2010. The crisis has depressing health implications and alarming political ones. In a nutshell: the new genetics will reveal much less than hoped about how to cure disease, and much more than feared about human evolution and inequality, including genetic differences between classes, ethnicities and races.

study  preprint  bio  biodet  behavioral-gen  GWAS  missing-heritability  QTL  🌞  scaling-up  replication  iq  education  spearhead  sib-study  multi  west-hunter  scitariat  genetic-load  mutation  medicine  meta:medicine  stylized-facts  ratty  unaffiliated  commentary  rhetoric  wonkish  genetics  genomics  race  pop-structure  poast  population-genetics  psychiatry  aphorism  homo-hetero  generalization  scale  state-of-art  ssc  reddit  social  summary  gwern  methodology  personality  britain  anglo  enhancement  roots  s:*  2017  data  visualization  database  let-me-see  bioinformatics  news  org:rec  org:anglo  org:biz  track-record  prediction  identity-politics  pop-diff  recent-selection  westminster  inequality  egalitarianism-hierarchy  high-dimension  applications  dimensionality  ideas  no-go  volo-avolo  magnitude  variance-components  GCTA  tradeoffs  counter-revolution  org:mat  dysgenics  paternal-age  distribution  chart 
june 2017 by nhaliday
[1705.08807] When Will AI Exceed Human Performance? Evidence from AI Experts
Researchers predict AI will outperform humans in many activities in the next ten years, such as translating languages (by 2024), writing high-school essays (by 2026), driving a truck (by 2027), working in retail (by 2031), writing a bestselling book (by 2049), and working as a surgeon (by 2053). Researchers believe there is a 50% chance of AI outperforming humans in all tasks in 45 years and of automating all human jobs in 120 years, with Asian respondents expecting these dates much sooner than North Americans.

study  preprint  science  meta:science  technology  ai  automation  labor  ai-control  risk  futurism  poll  expert  usa  asia  trends  hmm  idk  definite-planning  frontier  ideas  prediction  innovation  china  sinosphere  multi  reddit  social  commentary  ssc  speedometer  flux-stasis  ratty  expert-experience  org:mat  singularity  optimism  pessimism 
may 2017 by nhaliday
[1705.03394] That is not dead which can eternal lie: the aestivation hypothesis for resolving Fermi's paradox
If a civilization wants to maximize computation it appears rational to aestivate until the far future in order to exploit the low temperature environment: this can produce a 10^30 multiplier of achievable computation. We hence suggest the "aestivation hypothesis": the reason we are not observing manifestations of alien civilizations is that they are currently (mostly) inactive, patiently waiting for future cosmic eras. This paper analyzes the assumptions going into the hypothesis and how physical law and observational evidence constrain the motivations of aliens compatible with the hypothesis.


simpler explanation (just different math for Drake equation):
Dissolving the Fermi Paradox: http://www.jodrellbank.manchester.ac.uk/media/eps/jodrell-bank-centre-for-astrophysics/news-and-events/2017/uksrn-slides/Anders-Sandberg---Dissolving-Fermi-Paradox-UKSRN.pdf
Overall the argument is that point estimates should not be shoved into a Drake equation and then multiplied by each, as that requires excess certainty and masks much of the ambiguity of our knowledge about the distributions. Instead, a Bayesian approach should be used, after which the fate of humanity looks much better. Here is one part of the presentation:

Life Versus Dark Energy: How An Advanced Civilization Could Resist the Accelerating Expansion of the Universe: https://arxiv.org/abs/1806.05203
The presence of dark energy in our universe is causing space to expand at an accelerating rate. As a result, over the next approximately 100 billion years, all stars residing beyond the Local Group will fall beyond the cosmic horizon and become not only unobservable, but entirely inaccessible, thus limiting how much energy could one day be extracted from them. Here, we consider the likely response of a highly advanced civilization to this situation. In particular, we argue that in order to maximize its access to useable energy, a sufficiently advanced civilization would chose to expand rapidly outward, build Dyson Spheres or similar structures around encountered stars, and use the energy that is harnessed to accelerate those stars away from the approaching horizon and toward the center of the civilization. We find that such efforts will be most effective for stars with masses in the range of M∼(0.2−1)M⊙, and could lead to the harvesting of stars within a region extending out to several tens of Mpc in radius, potentially increasing the total amount of energy that is available to a future civilization by a factor of several thousand. We also discuss the observable signatures of a civilization elsewhere in the universe that is currently in this state of stellar harvesting.
preprint  study  essay  article  bostrom  ratty  anthropic  philosophy  space  xenobio  computation  physics  interdisciplinary  ideas  hmm  cocktail  temperature  thermo  information-theory  bits  🔬  threat-modeling  time  scale  insight  multi  commentary  liner-notes  pdf  slides  error  probability  ML-MAP-E  composition-decomposition  econotariat  marginal-rev  fermi  risk  org:mat  questions  paradox  intricacy  multiplicative  calculation  street-fighting  methodology  distribution  expectancy  moments  bayesian  priors-posteriors  nibble  measurement  existence  technology  geoengineering  magnitude  spatial  density  spreading  civilization  energy-resources  phys-energy  measure  direction  speculation  structure 
may 2017 by nhaliday
Lucio Russo - Wikipedia
In The Forgotten Revolution: How Science Was Born in 300 BC and Why It Had to Be Reborn (Italian: La rivoluzione dimenticata), Russo promotes the belief that Hellenistic science in the period 320-144 BC reached heights not achieved by Classical age science, and proposes that it went further than ordinarily thought, in multiple fields not normally associated with ancient science.

La Rivoluzione Dimenticata (The Forgotten Revolution), Reviewed by Sandro Graffi: http://www.ams.org/notices/199805/review-graffi.pdf

Before turning to the question of the decline of Hellenistic science, I come back to the new light shed by the book on Euclid’s Elements and on pre-Ptolemaic astronomy. Euclid’s definitions of the elementary geometric entities—point, straight line, plane—at the beginning of the Elements have long presented a problem.7 Their nature is in sharp contrast with the approach taken in the rest of the book, and continued by mathematicians ever since, of refraining from defining the fundamental entities explicitly but limiting themselves to postulating the properties which they enjoy. Why should Euclid be so hopelessly obscure right at the beginning and so smooth just after? The answer is: the definitions are not Euclid’s. Toward the beginning of the second century A.D. Heron of Alexandria found it convenient to introduce definitions of the elementary objects (a sign of decadence!) in his commentary on Euclid’s Elements, which had been written at least 400 years before. All manuscripts of the Elements copied ever since included Heron’s definitions without mention, whence their attribution to Euclid himself. The philological evidence leading to this conclusion is quite convincing.8


What about the general and steady (on the average) impoverishment of Hellenistic science under the Roman empire? This is a major historical problem, strongly tied to the even bigger one of the decline and fall of the antique civilization itself. I would summarize the author’s argument by saying that it basically represents an application to science of a widely accepted general theory on decadence of antique civilization going back to Max Weber. Roman society, mainly based on slave labor, underwent an ultimately unrecoverable crisis as the traditional sources of that labor force, essentially wars, progressively dried up. To save basic farming, the remaining slaves were promoted to be serfs, and poor free peasants reduced to serfdom, but this made trade disappear. A society in which production is almost entirely based on serfdom and with no trade clearly has very little need of culture, including science and technology. As Max Weber pointed out, when trade vanished, so did the marble splendor of the ancient towns, as well as the spiritual assets that went with it: art, literature, science, and sophisticated commercial laws. The recovery of Hellenistic science then had to wait until the disappearance of serfdom at the end of the Middle Ages. To quote Max Weber: “Only then with renewed vigor did the old giant rise up again.”


The epilogue contains the (rather pessimistic) views of the author on the future of science, threatened by the apparent triumph of today’s vogue of irrationality even in leading institutions (e.g., an astrology professorship at the Sorbonne). He looks at today’s ever-increasing tendency to teach science more on a fideistic than on a deductive or experimental basis as the first sign of a decline which could be analogous to the post-Hellenistic one.

Praising Alexandrians to excess: https://sci-hub.tw/10.1088/2058-7058/17/4/35
The Economic Record review: https://sci-hub.tw/10.1111/j.1475-4932.2004.00203.x

listed here: https://pinboard.in/u:nhaliday/b:c5c09f2687c1

Was Roman Science in Decline? (Excerpt from My New Book): https://www.richardcarrier.info/archives/13477
people  trivia  cocktail  history  iron-age  mediterranean  the-classics  speculation  west-hunter  scitariat  knowledge  wiki  ideas  wild-ideas  technology  innovation  contrarianism  multi  pdf  org:mat  books  review  critique  regularizer  todo  piracy  physics  canon  science  the-trenches  the-great-west-whale  broad-econ  the-world-is-just-atoms  frontier  speedometer  🔬  conquest-empire  giants  economics  article  growth-econ  cjones-like  industrial-revolution  empirical  absolute-relative  truth  rot  zeitgeist  gibbon  big-peeps  civilization  malthus  roots  old-anglo  britain  early-modern  medieval  social-structure  limits  quantitative-qualitative  rigor  lens  systematic-ad-hoc  analytical-holistic  cycles  space  mechanics  math  geometry  gravity  revolution  novelty  meta:science  is-ought  flexibility  trends  reason  applicability-prereqs  theory-practice 
may 2017 by nhaliday
[1502.05274] How predictable is technological progress?
Recently it has become clear that many technologies follow a generalized version of Moore's law, i.e. costs tend to drop exponentially, at different rates that depend on the technology. Here we formulate Moore's law as a correlated geometric random walk with drift, and apply it to historical data on 53 technologies. We derive a closed form expression approximating the distribution of forecast errors as a function of time. Based on hind-casting experiments we show that this works well, making it possible to collapse the forecast errors for many different technologies at different time horizons onto the same universal distribution. This is valuable because it allows us to make forecasts for any given technology with a clear understanding of the quality of the forecasts. As a practical demonstration we make distributional forecasts at different time horizons for solar photovoltaic modules, and show how our method can be used to estimate the probability that a given technology will outperform another technology at a given point in the future.

- p_t = unit price of tech
- log(p_t) = y_0 - μt + ∑_{i <= t} n_i
- n_t iid noise process
preprint  study  economics  growth-econ  innovation  discovery  technology  frontier  tetlock  meta:prediction  models  time  definite-planning  stylized-facts  regression  econometrics  magnitude  energy-resources  phys-energy  money  cost-benefit  stats  data-science  🔬  ideas  speedometer  multiplicative  methodology  stochastic-processes  time-series  stock-flow  iteration-recursion  org:mat 
april 2017 by nhaliday
[0809.5250] The decline in the concentration of citations, 1900-2007
These measures are used for four broad disciplines: natural sciences and engineering, medical fields, social sciences, and the humanities. All these measures converge and show that, contrary to what was reported by Evans, the dispersion of citations is actually increasing.

- natural sciences around 60-70% cited in 2-5 year window
- humanities stands out w/ 10-20% cited (maybe because of focus on books)
study  preprint  science  meta:science  distribution  network-structure  len:short  publishing  density  🔬  info-dynamics  org:mat 
february 2017 by nhaliday
[1604.03640] Bridging the Gaps Between Residual Learning, Recurrent Neural Networks and Visual Cortex
We discuss relations between Residual Networks (ResNet), Recurrent Neural Networks (RNNs) and the primate visual cortex. We begin with the observation that a shallow RNN is exactly equivalent to a very deep ResNet with weight sharing among the layers. A direct implementation of such a RNN, although having orders of magnitude fewer parameters, leads to a performance similar to the corresponding ResNet. We propose 1) a generalization of both RNN and ResNet architectures and 2) the conjecture that a class of moderately deep RNNs is a biologically-plausible model of the ventral stream in visual cortex. We demonstrate the effectiveness of the architectures by testing them on the CIFAR-10 dataset.
papers  preprint  neuro  biodet  interdisciplinary  deep-learning  model-class  identity  machine-learning  nibble  org:mat  computer-vision 
february 2017 by nhaliday
ShortScience.org - Making Science Accessible!
crowdsourced liner notes
heavy machine learning bias (altho I don't know if TCS papers warrant liner notes all that frequently)
init  aggregator  papers  research  summary  explanation  machine-learning  thinking  skunkworks  liner-notes  academia  hmm  org:mat  organization 
june 2016 by nhaliday
« earlier      
per page:    204080120160

bundles : mathpub

related tags

:/  absolute-relative  abstraction  academia  accretion  accuracy  acm  acmtariat  additive-combo  adversarial  aesthetics  aggregator  ai  ai-control  algebraic-complexity  algorithms  alignment  AMT  analytical-holistic  anglo  announcement  anthropic  anthropology  antiquity  aphorism  applicability-prereqs  applications  archaeology  arms  article  asia  atmosphere  atoms  authoritarianism  auto-learning  automation  average-case  bandits  bayesian  beauty  behavioral-econ  behavioral-gen  benchmarks  best-practices  better-explained  biases  big-peeps  big-picture  big-surf  binomial  bio  biodet  bioinformatics  biotech  bits  books  boolean-analysis  bostrom  brain-scan  brexit  britain  broad-econ  business  calculation  canon  career  cartoons  causation  characterization  chart  checklists  china  civilization  cjones-like  clarity  classic  classification  clever-rats  cmu  coalitions  cocktail  coding-theory  cog-psych  comedy  comics  commentary  community  comparison  competition  complex-systems  complexity  composition-decomposition  computation  computational-geometry  computer-vision  concentration-of-measure  concept  conceptual-vocab  concurrency  confounding  conquest-empire  context  contracts  contrarianism  convexity-curvature  cool  cooperate-defect  coordination  correlation  cost-benefit  counter-revolution  counterexample  course  creative  critique  crooked  crosstab  crypto  cs  cultural-dynamics  culture  culture-war  curiosity  curvature  cybernetics  cycles  data  data-science  data-structures  database  dataset  decision-theory  deep-learning  deep-materialism  deepgoog  definite-planning  definition  degrees-of-freedom  demographics  dennett  density  descriptive  detail-architecture  dimensionality  direction  dirty-hands  discipline  discovery  discrete  discussion  disease  distribution  draft  duplication  dynamical  dysgenics  early-modern  earth  econometrics  economics  econotariat  eden-heaven  education  EEA  egalitarianism-hierarchy  einstein  elections  electromag  embodied  empirical  encyclopedic  energy-resources  engineering  enhancement  ensembles  entropy-like  environment  epistemic  equilibrium  eric-kaufmann  error  essay  estimate  ethics  europe  evolution  evopsych  examples  existence  expectancy  expert  expert-experience  explanans  explanation  exposition  expression-survival  extra-introversion  extrema  facebook  features  fermi  feynman  fiction  flexibility  fluid  flux-stasis  foreign-lang  fourier  frequency  frontier  futurism  GCTA  gedanken  gender  gender-diff  generalization  generative  genetic-load  genetics  genomics  geoengineering  geography  geometry  giants  gibbon  gnon  google  government  gowers  gradient-descent  graphical-models  graphs  gravity  ground-up  growth-econ  GT-101  GWAS  gwern  h2o  hacker  hanson  hari-seldon  heuristic  hi-order-bits  high-dimension  high-variance  history  hmm  hn  homepage  homo-hetero  human-ml  humanity  ideas  identity  identity-politics  ideology  idk  impetus  individualism-collectivism  industrial-revolution  inequality  info-dynamics  info-foraging  information-theory  infrastructure  init  inner-product  innovation  insight  institutions  integral  intel  intelligence  interdisciplinary  interests  internet  interpretability  intersection  intersection-connectedness  intricacy  intuition  iq  iron-age  is-ought  iteration-recursion  jargon  kernels  knowledge  labor  language  large-factor  latent-variables  law  learning  learning-theory  lecture-notes  len:short  lens  let-me-see  levers  leviathan  libraries  limits  linear-algebra  liner-notes  links  list  literature  logic  lol  lower-bounds  machine-learning  magnitude  male-variability  malthus  manifolds  marginal-rev  markov  math  math.CA  math.CO  math.CV  math.DS  math.FA  math.MG  math.NT  mathtariat  matrix-factorization  maxim-gun  measure  measurement  mechanics  media  medicine  medieval  mediterranean  memetics  MENA  meta:math  meta:medicine  meta:prediction  meta:science  metabuch  metameta  methodology  metrics  miri-cfar  missing-heritability  ML-MAP-E  model-class  models  moments  money  monte-carlo  mostly-modern  multi  multiplicative  mutation  network-structure  neuro  neurons  news  nibble  nietzschean  nitty-gritty  nlp  no-go  nonlinearity  nordic  novelty  nuclear  number  numerics  objective-measure  objektbuch  occam  off-convex  offense-defense  old-anglo  oly  online-learning  openai  operational  optimate  optimism  optimization  order-disorder  org:anglo  org:biz  org:bleg  org:edu  org:inst  org:junk  org:mag  org:mat  org:rec  org:sci  organization  oscillation  oss  p:*  p:**  p:***  p:someday  p:whenever  papers  paradox  parasites-microbiome  parsimony  paternal-age  pdf  people  percolation  personality  perturbation  pessimism  phalanges  phase-transition  philosophy  phys-energy  physics  piracy  planning  plots  poast  polisci  politics  poll  polynomials  pop-diff  pop-structure  popsci  population-genetics  postrat  power-law  pragmatic  pre-ww2  prediction  prepping  preprint  princeton  priors-posteriors  probability  problem-solving  profile  programming  proofs  propaganda  properties  psych-architecture  psychiatry  psychology  psychometrics  publishing  python  QTL  quantifiers-sums  quantitative-qualitative  quantum  quantum-info  questions  quotes  race  rand-approx  random-networks  ranking  ratty  realness  reason  rec-math  recent-selection  reddit  reduction  reference  reflection  regression  regularizer  reinforcement  relativity  religion  rent-seeking  replication  research  research-program  review  revolution  rhetoric  rigor  risk  robust  roots  rot  ryan-odonnell  s:*  s:***  sample-complexity  sapiens  scale  scaling-up  scholar  scholar-pack  science  science-anxiety  scifi-fantasy  scitariat  search  security  selection  sensitivity  sequential  series  sex  sexuality  shalizi  sib-study  simulation  singularity  sinosphere  skeleton  skunkworks  sleuthin  slides  social  social-psych  social-science  social-structure  sociality  society  sociology  software  space  spatial  spearhead  speculation  speed  speedometer  spock  spreading  ssc  stanford  stat-mech  state  state-of-art  stats  stirling  stochastic-processes  stock-flow  stories  stream  street-fighting  stress  structure  study  stylized-facts  subculture  sum-of-squares  summary  survey  synthesis  systematic-ad-hoc  tails  tcs  tcstariat  teaching  tech  technology  techtariat  telos-atelos  temperature  tensors  tetlock  the-classics  the-great-west-whale  the-self  the-trenches  the-world-is-just-atoms  theory-of-mind  theory-practice  thermo  thick-thin  things  thinking  threat-modeling  tidbits  tightness  time  time-series  todo  toolkit  tools  top-n  track-record  tradeoffs  trends  tricki  tricks  trivia  troll  truth  turing  tutorial  twitter  ui  unaffiliated  uncertainty  unintended-consequences  unit  universalism-particularism  usa  utopia-dystopia  values  variance-components  vc-dimension  virtu  visualization  volo-avolo  waves  west-hunter  westminster  whole-partial-many  wigderson  wiki  wild-ideas  wire-guided  wisdom  within-without  wonkish  working-stiff  world  world-war  wormholes  worrydream  xenobio  yoga  zeitgeist  🌞  🐸  👳  🔬  🖥 

Copy this bookmark: