divergence   268

« earlier    

"Une organisation a besoin de ET de " comme le souligne .
Au point qu'il recomm…
convergence  divergence  from twitter_favs
may 2019 by sfermigier
Entropy | Free Full-Text | On Accuracy of PDF Divergence Estimators and Their Applicability to Representative Data Sampling
Generalisation error estimation is an important issue in machine learning. Cross-validation traditionally used for this purpose requires building multiple models and repeating the whole procedure many times in order to produce reliable error estimates. It is however possible to accurately estimate the error using only a single model, if the training and test data are chosen appropriately. This paper investigates the possibility of using various probability density function divergence measures for the purpose of representative data sampling. As it turned out, the first difficulty one needs to deal with is estimation of the divergence itself. In contrast to other publications on this subject, the experimental results provided in this study show that in many cases it is not possible unless samples consisting of thousands of instances are used. Exhaustive experiments on the divergence guided representative data sampling have been performed using 26 publicly available benchmark datasets and 70 PDF divergence estimators, and their results have been analysed and discussed.
entropy  divergence  estimation 
august 2018 by arsyed
The Brexit walls are closing in on Theresa May from two sides | Rafael Behr | Opinion | The Guardian
May’s legacy as prime minister will be recorded as the collision of those two dramatic electoral events: the one that put her in charge of Brexit and the one that robbed her of the means to do it her way. The Eurosceptic ultras brandish the 2016 result – the single word “leave” – as licence to demand whatever they want. But parliament, elected a year later, has the authority to define Brexit in other, more moderate ways. In popular cultural terms, the referendum was the bigger deal. In constitutional terms, parliament is paramount. The contest between them is nearing its endgame and May looks more like a bystander than a player.
UK  EU  Brexit  politics  ToryParty  MayTheresa  hardBrexit  customsUnion  divergence  borders  Ireland  NorthernIreland  ERG  DUP  Parliament  democracy  dctagged  dc:creator=BehrRafael 
february 2018 by petej
Many Paths to Equilibrium: GANs Do Not Need to Decrease a Divergence At Every Step | OpenReview
Abstract: Generative adversarial networks (GANs) are a family of generative models that do not minimize a single training criterion. Unlike other generative models, the data distribution is learned via a game between a generator (the generative model) and a discriminator (a teacher providing training signal) that each minimize their own cost. GANs are designed to reach a Nash equilibrium at which each player cannot reduce their cost without changing the other players’ parameters. One useful approach for the theory of GANs is to show that a divergence between the training distribution and the model distribution obtains its minimum value at equilibrium. Several recent research directions have been motivated by the idea that this divergence is the primary guide for the learning process and that every step of learning should decrease the divergence. We show that this view is overly restrictive. During GAN training, the discriminator provides learning signal in situations where the gradients of the divergences between distributions would not be useful. We provide empirical counterexamples to the view of GAN training as divergence minimization. Specifically, we demonstrate that GANs are able to learn distributions in situations where the divergence minimization point of view predicts they would fail. We also show that gradient penalties motivated from the divergence minimization perspective are equally helpful when applied in other contexts in which the divergence minimization perspective does not predict they would be helpful. This contributes to a growing body of evidence that GAN training may be more usefully viewed as approaching Nash equilibria via trajectories that do not necessarily minimize a specific divergence at each step.
papers  gan  divergence 
january 2018 by arsyed
Books 2017 | West Hunter
Arabian Sands
The Aryans
The Big Show
The Camel and the Wheel
Civil War on Western Waters
Company Commander
Double-edged Secrets
The Forgotten Soldier
Genes in Conflict
Hive Mind
The horse, the wheel, and language
The Penguin Atlas of Medieval History
Habitable Planets for Man
The genetical theory of natural selection
The Rise of the Greeks
To Lose a Battle
The Jewish War
Tropical Gangsters
The Forgotten Revolution
Egil’s Saga
Time Patrol

Russo: https://westhunt.wordpress.com/2017/12/14/books-2017/#comment-98568
west-hunter  scitariat  books  recommendations  list  top-n  confluence  2017  info-foraging  canon  🔬  ideas  s:*  history  mostly-modern  world-war  britain  old-anglo  travel  MENA  frontier  reflection  europe  gallic  war  sapiens  antiquity  archaeology  technology  divergence  the-great-west-whale  transportation  nature  long-short-run  intel  tradecraft  japan  asia  usa  spearhead  garett-jones  hive-mind  economics  broad-econ  giants  fisher  space  iron-age  medieval  the-classics  civilization  judaism  conquest-empire  africa  developing-world  institutions  science  industrial-revolution  the-trenches  wild-ideas  innovation  speedometer  nordic  mediterranean  speculation  fiction  scifi-fantasy  time  encyclopedic  multi  poast  critique  cost-benefit  tradeoffs  quixotic 
december 2017 by nhaliday
King Kong and Cold Fusion: Counterfactual analysis and the History of Technology
How “contingent” is technological history? Relying on models from evolutionary epistemology, I argue for an analogy with Darwinian Biology and thus a much greater degree of contingency than is normally supposed. There are three levels of contingency in technological development. The crucial driving force behind technology is what I call S-knowledge, that is, an understanding of the exploitable regularities of nature (which includes “science” as a subset). The development of techniques depend on the existence of epistemic bases in S. The “inevitability” of technology thus depends crucially on whether we condition it on the existence of the appropriate S-knowledge. Secondly, even if this knowledge emerges, there is nothing automatic about it being transformed into a technique that is, a set of instructions that transforms knowledge into production. Third, even if the techniques are proposed, there is selection which reflects the preferences and biases of an economy and injects another level of indeterminacy and contingency into the technological history of nations.

Moslem conquest of Europe, or a Mongol conquest, or a post-1492 epidemic, or a victory of the counter-reformation would have prevented the Industrial Revolution (Joel Mokyr)
pdf  study  essay  economics  growth-econ  broad-econ  microfoundations  history  medieval  early-modern  industrial-revolution  divergence  volo-avolo  random  mokyr-allen-mccloskey  wealth-of-nations  europe  the-great-west-whale  occident  path-dependence  roots  knowledge  technology  society  multi  twitter  social  commentary  backup  conquest-empire  war  islam  MENA  disease  parasites-microbiome  counterfactual  age-of-discovery  enlightenment-renaissance-restoration-reformation  usa  scitariat  gnon  degrees-of-freedom 
november 2017 by nhaliday
“Editor’s Introduction to The New Economic History and the Industrial Revolution,” J. Mokyr (1998) | A Fine Theorem
I taught a fun three hours on the Industrial Revolution in my innovation PhD course this week. The absolutely incredible change in the condition of mankind that began in a tiny corner of Europe in an otherwise unremarkable 70-or-so years is totally fascinating. Indeed, the Industrial Revolution and its aftermath are so important to human history that I find it strange that we give people PhDs in social science without requiring at least some study of what happened.

My post today draws heavily on Joel Mokyr’s lovely, if lengthy, summary of what we know about the period. You really should read the whole thing, but if you know nothing about the IR, there are really five facts of great importance which you should be aware of.

1) The world was absurdly poor from the dawn of mankind until the late 1800s, everywhere.
2) The average person did not become richer, nor was overall economic growth particularly spectacular, during the Industrial Revolution; indeed, wages may have fallen between 1760 and 1830.
3) Major macro inventions, and growth, of the type seen in England in the late 1700s and early 1800s happened many times in human history.
4) It is hard for us today to understand how revolutionary ideas like “experimentation” or “probability” were.
5) The best explanations for “why England? why in the late 1700s? why did growth continue?” do not involve colonialism, slavery, or famous inventions.
econotariat  broad-econ  economics  growth-econ  cjones-like  summary  divergence  industrial-revolution  list  top-n  mokyr-allen-mccloskey  hi-order-bits  aphorism  wealth  wealth-of-nations  malthus  revolution  innovation  the-trenches  science  europe  the-great-west-whale  britain  conceptual-vocab  history  early-modern  technology  long-short-run  econ-metrics  data  time-series  conquest-empire  india  asia  scale  attaq  enlightenment-renaissance-restoration-reformation  roots  cycles  flux-stasis  whiggish-hegelian 
october 2017 by nhaliday

« earlier    

related tags

2017  absolute-relative  acemoglu  adamsgerry  adna  adversarial  africa  age-generation  age-of-discovery  agri-mindset  agriculture  ai  albion  alien-character  alt-inst  ambiguity  analogy  analysis  anarcho-tyranny  anglo  anglosphere  anthropology  antidemos  antiquity  aphorism  applications  archaeology  archaics  architecture  aristos  arms  article  asia  assimilation  attaq  audio  authoritarianism  automation  backup  bayes  bayesian  bear  behavioral-econ  behavioral-gen  being-right  big-peeps  big-picture  biodet  biophysical-econ  blog  books  borders  bounded-cognition  branches  brexit  britain  broad-econ  bull  business  c:***  canon  capital  capitalism  career  causation  chart  china  christianity  civilization  cjones-like  class-warfare  class  cliometrics  cocktail  cog-psych  cohesion  cold-war  coming-apart  commentary  communication  communism  comparison  compensation  competition  concept  conceptual-vocab  confluence  confucian  conquest-empire  context  contracts  contrarianism  convergence  convexity-curvature  coordination  corbynjeremy  corporation  correlation  corruption  cost-benefit  counter-revolution  counterfactual  courage  course  creative  crime  criminology  critique  cultural-dynamics  culture-war  culture  curiosity  curvature  customsunion  cycles  darwinian  data  database  datascience  dataset  dc:creator=behrrafael  dc:creator=freedlandjonathan  dctagged  death  debate  decentralized  deep-materialism  defense  definite-planning  degrees-of-freedom  delta  democracy  demographic-transition  demographics  dennett  density  developing-world  developmental  diet  dignity  dimensionality  dirty-hands  discipline  discovery  discussion  disease  distribution  div  diversity  domestication  dominant-minority  dup  dynamical  dysgenics  early-modern  easterly  eastern-europe  econ-metrics  econ-productivity  econometrics  economics  econotariat  eden-heaven  education  efficiency  egalitarianism-hierarchy  electromag  elite  embedded-cognition  embodied  empirical  encyclopedic  endo-exo  endogenous-exogenous  energy-resources  enlightenment-renaissance-restoration-reformation  entrepreneurialism  entropy  environment  erg  error  essay  estimation  ethnography  eu  europe  events  evidence  evolution  examples  exegesis-hermeneutics  expansionism  experiment  expert-experience  expert  explanans  exploratory  expression-survival  extra-introversion  farmers-and-foragers  fertility  feudal  fiction  film  finance  fisher  flexibility  fluid  flux-stasis  food  frontier  futurism  gallic  galor-like  gan  garett-jones  gavisti  gedanken  gender-diff  gender  gene-flow  general-survey  genetics  genomics  geography  geometry  geopolitics  germanic  giants  gibbon  gildedage  gnon  gnosis-logos  gnxp  government  gravity  great-powers  gregory-clark  group-level  group-selection  growth-econ  gwern  h2o  hanson  hanushek  hardbrexit  hari-seldon  health  heavy-industry  heuristic  hi-order-bits  higher-ed  history  hive-mind  hmm  homo-hetero  housing  hsu  human-capital  huntjeremy  hypocrisy  ideas  identity-politics  ideology  impact  incentives  india  individualism-collectivism  industrial-revolution  inequality  info-dynamics  info-foraging  information  infrastructure  innovation  input-output  insight  instinct  institutions  insurance  intel  intellectual-property  intelligence  internet  intervention  interview  iq  iran  ireland  iron-age  islam  japan  journos-pundits  judaism  justice  kinship  knowledge  korea  krugman  kullback  kumbaya-kult  labor  labourparty  larry-summers  latin-america  law  learning  legacy  leibler  lens  letters  leviathan  life-history  links  list  literature  lived-experience  lmao  logos  lol  long-short-run  long-term  low-hanging  machine-learning  macro  madisonian  magnitude  malaise  male-variability  malthus  management  managerial-state  maps  marginal-rev  marginal  markets  martial  matching  math.ds  math  matrix-factorization  maytheresa  measurement  mechanics  media  medieval  mediterranean  memes(ew)  mena  meta:reading  meta:war  methodology  metrics  microfoundations  migration  military  mobility  models  modernity  mokyr-allen-mccloskey  moments  monetary-fiscal  money  mostly-modern  multi  murray  n-factor  nationalism-globalism  natural-experiment  nature  navigation  negotiations  network-structure  neurons  new-religion  news  nibble  nietzschean  nihil  nl-and-so-can-you  noahpinion  nonlinearity  nordic  north-weingast-like  northeast  northernireland  novelty  null-result  obligations  occident  oceans  old-anglo  open-closed  optimate  order-disorder  org:anglo  org:biz  org:data  org:edu  org:foreign  org:lite  org:mag  org:med  org:nat  org:ngo  org:popup  org:rec  organizing  orient  oscillation  outcome-risk  papers  parasites-microbiome  parenting  parliament  path-dependence  patho-altruism  pdf  peace-violence  personality  pessimism  phalanges  philosophy  physics  pic  piketty  piracy  planning  poast  podcast  polanyi-marx  polisci  political-econ  politics  pop-diff  pop-structure  popsci  population-genetics  population  poverty  power  pre-ww2  prediction  prepping  primitivism  privacy  pro-rata  property-rights  protestant-catholic  protocol-metadata  pseudoe  psychology  psychometrics  public-goodish  q-n-a  qra  questions  quixotic  quotes  race  random  randy-ayndy  ranking  rant  ratty  reading  realness  reason  recent-selection  recommendations  reddit  redistribution  reference  reflection  regional-scatter-plots  regression  regularizer  regulation  religion  rent-seeking  responsibility  retention  review  revolution  rhetoric  right-wing  rindermann-thompson  roots  rot  russia  s-factor  s:***  s:*  sapiens  scale  science  scifi-fantasy  scitariat  selection  sequential  sex  sexuality  shift  sinosphere  smoothness  social-norms  social-science  social-structure  social  society  sociology  solid-study  soubryanna  space  spearhead  speculation  speed  speedometer  spreading  ssc  stagnation  statistics  status  stereotypes  straussian  stream  street-fighting  structure  study  studying  stylized-facts  success  summary  supply-demand  survey  sv  szabo  tactics  tails  taxes  teaching  tech  technocracy  technology  telos-atelos  temperance  texas  the-bones  the-classics  the-great-west-whale  the-south  the-trenches  the-world-is-just-atoms  theory  theos  things  thinking  time-preference  time-series  time  top-n  toryparty  track-record  trade  tradecraft  tradeoffs  trading  tradition  transportation  travel  trends  tribalism  trivia  troll  trust  truth  tumblr  turchin  tuskdonald  tutoring  twitter  uk  umunnachuka  unaffiliated  uncertainty  unintended-consequences  universalism-particularism  urban-rural  urban  us-them  us  usa  values  vampire-squid  variance-components  video  virtu  visualization  vitality  volo-avolo  wages  walls  walter-scheidel  war  water  wealth-of-nations  wealth  welfare-state  west-hunter  westminster  whiggish-hegelian  wiki  wild-ideas  winner-take-all  wire-guided  within-group  wonkish  world-war  world  writing  zeitgeist  zero-positive-sum  🌞  🎩  🐸  🔬 

Copy this bookmark: