nhaliday + series   14

Hoeffding’s Inequality
basic idea of standard pf: bound e^{tX} by line segment (convexity) then use Taylor expansion (in p = b/(b-a), the fraction of range to right of 0) of logarithm
pdf  lecture-notes  exposition  nibble  concentration-of-measure  estimate  proofs  ground-up  acm  probability  series  s:null 
february 2017 by nhaliday
Existence of the moment generating function and variance - Cross Validated
This question provides a nice opportunity to collect some facts on moment-generating functions (mgf).

In the answer below, we do the following:
1. Show that if the mgf is finite for at least one (strictly) positive value and one negative value, then all positive moments of X are finite (including nonintegral moments).
2. Prove that the condition in the first item above is equivalent to the distribution of X having exponentially bounded tails. In other words, the tails of X fall off at least as fast as those of an exponential random variable Z (up to a constant).
3. Provide a quick note on the characterization of the distribution by its mgf provided it satisfies the condition in item 1.
4. Explore some examples and counterexamples to aid our intuition and, particularly, to show that we should not read undue importance into the lack of finiteness of the mgf.
q-n-a  overflow  math  stats  acm  probability  characterization  concept  moments  distribution  examples  counterexample  tails  rigidity  nibble  existence  s:null  convergence  series 
january 2017 by nhaliday
pr.probability - When are probability distributions completely determined by their moments? - MathOverflow
Roughly speaking, if the sequence of moments doesn't grow too quickly, then the distribution is determined by its moments. One sufficient condition is that if the moment generating function of a random variable has positive radius of convergence, then that random variable is determined by its moments.
q-n-a  overflow  math  acm  probability  characterization  tidbits  moments  rigidity  nibble  existence  convergence  series 
january 2017 by nhaliday

bundles : abstractmath

related tags

absolute-relative  academia  acm  acmtariat  algorithms  apollonian-dionysian  applications  approximation  arrows  article  atoms  axioms  baez  big-picture  calculation  characterization  chart  checklists  clarity  clever-rats  complexity  composition-decomposition  concentration-of-measure  concept  conceptual-vocab  concrete  confluence  convergence  convexity-curvature  cool  counterexample  curiosity  curvature  cycles  deep-learning  differential  dimensionality  distribution  early-modern  electromag  ends-means  entropy-like  estimate  examples  existence  experiment  explanation  exposition  extrema  fedja  finiteness  fourier  frequency  giants  gowers  graph-theory  graphical-models  graphs  ground-up  hardware  hi-order-bits  history  homogeneity  ideas  identity  IEEE  impact  innovation  integral  interdisciplinary  invariance  iron-age  knowledge  lecture-notes  levers  linear-algebra  linearity  list  machine-learning  manifolds  martingale  math  math.CA  math.DS  math.GN  mathtariat  measure  mechanics  mediterranean  meta:math  metabuch  metameta  methodology  minimum-viable  model-class  moments  nibble  novelty  numerics  objektbuch  oly  optimization  org:bleg  org:edu  org:junk  org:mat  oscillation  overflow  p:***  papers  pdf  physics  pigeonhole-markov  positivity  pragmatic  pre-2013  preprint  prioritizing  probability  problem-solving  proofs  puzzles  q-n-a  quixotic  ratty  reference  regularity  relativity  rigidity  roadmap  ryan-odonnell  s:***  s:null  scholar-pack  science  sequential  series  signum  skeleton  smoothness  space  spectral  speed  stats  stochastic-processes  street-fighting  studying  synthesis  tails  tcs  telos-atelos  the-classics  the-great-west-whale  the-trenches  the-world-is-just-atoms  tidbits  time  toolkit  top-n  topology  track-record  tricki  water  waves  wiki  yoga  🎓  👳  🔬 

Copy this bookmark: