org:bleg   359

« earlier    

Sequence Modeling with CTC
A visual guide to Connectionist Temporal Classification, an algorithm used to train deep neural networks in speech recognition, handwriting recognition and other sequence problems.
acmtariat  techtariat  org:bleg  nibble  better-explained  machine-learning  deep-learning  visual-understanding  visualization  analysis  let-me-see  research  sequential  audio  classification  model-class  exposition  language  acm  approximation  comparison  markov  iteration-recursion  concept  atoms  distribution  orders  DP  heuristic  optimization  trees  greedy  matching  gradient-descent 
december 2017 by nhaliday
Is the speed of light really constant?
So what if the speed of light isn’t the same when moving toward or away from us? Are there any observable consequences? Not to the limits of observation so far. We know, for example, that any one-way speed of light is independent of the motion of the light source to 2 parts in a billion. We know it has no effect on the color of the light emitted to a few parts in 1020. Aspects such as polarization and interference are also indistinguishable from standard relativity. But that’s not surprising, because you don’t need to assume isotropy for relativity to work. In the 1970s, John Winnie and others showed that all the results of relativity could be modeled with anisotropic light so long as the two-way speed was a constant. The “extra” assumption that the speed of light is a uniform constant doesn’t change the physics, but it does make the mathematics much simpler. Since Einstein’s relativity is the simpler of two equivalent models, it’s the model we use. You could argue that it’s the right one citing Occam’s razor, or you could take Newton’s position that anything untestable isn’t worth arguing over.

nibble  scitariat  org:bleg  physics  relativity  electromag  speed  invariance  absolute-relative  curiosity  philosophy  direction  gedanken  axioms  definition  models  experiment  space  science  measurement  volo-avolo  synchrony  uniqueness  multi  pdf  piracy  study  article 
november 2017 by nhaliday
If Quantum Computers are not Possible Why are Classical Computers Possible? | Combinatorics and more
As most of my readers know, I regard quantum computing as unrealistic. You can read more about it in my Notices AMS paper and its extended version (see also this post) and in the discussion of Puzzle 4 from my recent puzzles paper (see also this post). The amazing progress and huge investment in quantum computing (that I presented and update  routinely in this post) will put my analysis to test in the next few years.
tcstariat  mathtariat  org:bleg  nibble  tcs  cs  computation  quantum  volo-avolo  no-go  contrarianism  frontier  links  quantum-info  analogy  comparison  synthesis  hi-order-bits  speedometer  questions  signal-noise 
november 2017 by nhaliday
Introduction to Scaling Laws

Galileo’s Discovery of Scaling Laws:
Days 1 and 2 of Two New Sciences

An example of such an insight is “the surface of a small solid is comparatively greater than that of a large one” because the surface goes like the square of a linear dimension, but the volume goes like the cube.5 Thus as one scales down macroscopic objects, forces on their surfaces like viscous drag become relatively more important, and bulk forces like weight become relatively less important. Galileo uses this idea on the First Day in the context of resistance in free fall, as an explanation for why similar objects of different size do not fall exactly together, but the smaller one lags behind.
nibble  org:junk  exposition  lecture-notes  physics  mechanics  street-fighting  problem-solving  scale  magnitude  estimate  fermi  mental-math  calculation  nitty-gritty  multi  scitariat  org:bleg  lens  tutorial  guide  ground-up  tricki  skeleton  list  cheatsheet  identity  levers  hi-order-bits  yoga  metabuch  pdf  article  essay  history  early-modern  europe  the-great-west-whale  science  the-trenches  discovery  fluid  architecture  oceans  giants  tidbits  elegance 
august 2017 by nhaliday

« earlier    

related tags

:/  aaronson  absolute-relative  abstraction  academia  accretion  accuracy  acm  acmtariat  additive-combo  additive  adversarial  advice  aesthetics  ai-control  ai  akrasia  algebraic-complexity  algorithmic-econ  algorithms  alignment  analogy  analysis  anglosphere  anthropology  aphorism  applications  approximation  architecture  arms  arrows  article  asia  atoms  attention  audio  auto-learning  automata  automation  average-case  axioms  backup  baez  bandits  bare-hands  bayesian  beauty  ben-recht  benchmarks  best-practices  better-explained  biases  big-picture  big-surf  bio  biophysical-econ  bitcoin  bits  blockchain  boaz-barak  boltzmann  bonferroni  books  boolean-analysis  borel-cantelli  brain-scan  bret-victor  brunn-minkowski  c:**  caching  calculation  caltech  career  cartoons  characterization  charity  chart  cheatsheet  checking  checklists  china  circuits  clarity  classic  classification  clever-rats  climate-change  coarse-fine  coding-theory  cog-psych  combo-optimization  commentary  communication-complexity  communication  comparison  complex-systems  complexity  composition-decomposition  compressed-sensing  compression  computation  computer-vision  concentration-of-measure  concept  conceptual-vocab  concurrency  conference  context  contrarianism  convergence  convexity-curvature  coordination  core-rats  counterexample  critique  crypto  cryptocurrency  cs  culture-war  curiosity  current-events  curvature  cynicism-idealism  dan-luu  data-science  data  dataset  dataviz  debate  debt  debugging  decision-making  decision-theory  deep-learning  deep-materialism  deepgoog  definite-planning  definition  demographics  dependence-independence  descriptive  detail-architecture  dimensionality  direction  discovery  discrete  discussion  distribution  dp  duality  dumb-ml  dynamic  dynamical  dysgenics  early-modern  econ-metrics  economics  education  effective-altruism  efficiency  egt  eh  electromag  elegance  embeddings  empirical  ems  energy-resources  engineering  enhancement  enlightenment-renaissance-restoration-reformation  ensembles  entropy-like  environment  epistemic  equilibrium  ergodic  error  essay  estimate  europe  evolution  examples  expansionism  expectancy  experiment  expert-experience  expert  explanans  explanation  exploratory  exposition  extratricky  extrema  faq  features  fermi  fiction  finiteness  fisher  fixed-point  fluid  foreign-lang  fourier  frontier  futurism  game-theory  games  gedanken  generalization  generative  genetic-load  genetics  geoengineering  geometry  giants  gnon  google  gotchas  gowers  grad-school  gradient-descent  gravity  greedy  ground-up  growth-econ  gt-101  guide  hamming  hanson  heuristic  hi-order-bits  high-dimension  higher-ed  history  hmm  hn  homogeneity  howto  hsu  human-ml  icml  ideas  identity-politics  identity  ideology  ieee  iidness  impact  info-dynamics  information-theory  init  inner-product  interdisciplinary  internet  interpretability  intersection-connectedness  intersection  intricacy  intuition  invariance  iq  isotropy  iteration-recursion  iterative-methods  kernels  language  latent-variables  learning-theory  learning  lecture-notes  lectures  legibility  lens  let-me-see  levers  libraries  limits  linear-algebra  linear-models  linearity  liner-notes  links  list  local-global  logic  long-short-run  lower-bounds  luca-trevisan  machine-learning  macro  magnitude  malthus  map-territory  markov  matching  math.ds  math.nt  math  mathtariat  matrix-factorization  measure  measurement  mechanics  media  memory-management  mena  mena4  mental-math  meta:math  meta:reading  meta:research  meta:rhetoric  meta:science  metabuch  metameta  methodology  metrics  michael-jordan  michael-nielsen  microsoft  migration  minimum-viable  miri-cfar  mixing  ml-map-e  model-class  models  moments  mrtz  multi  multiplicative  naturality  network-structure  networking  neuro-nitgrit  neuro  neurons  new-religion  news  nibble  nihil  nitty-gritty  nlp  no-go  norms  nuclear  numerics  objektbuch  oceans  off-convex  oly  online-learning  open-closed  open-problems  openai  optimism  optimization  orders  org:edu  org:inst  org:junk  org:mag  org:med  org:nat  org:sci  os  oscillation  overflow  p:someday  p:whenever  pac  papers  parable  pareto  parsimony  pdf  performance  perturbation  pessimism  phase-transition  philosophy  photography  phys-energy  physics  pic  pinker  piracy  planning  plots  poast  policy  polisci  politics  poll  polynomials  popsci  population-genetics  positivity  potential  power-law  pragmatic  prediction  preprint  presentation  primitivism  priors-posteriors  probabilistic-method  probability  problem-solving  programming  progression  project  proofs  proposal  protocol  pseudorandomness  psychology  publishing  puzzles  quantum-info  quantum  questions  quixotic  quotes  rand-approx  random  ranking  rationality  ratty  reading  realness  recommendations  reddit  reduction  reflection  regression  regularity  regularization  regularizer  reinforcement  relativity  replication  research-program  research  retention  review  rhetoric  rigidity  rigor  risk  roadmap  robust  rounding  s:**  s:*  sample-complexity  sampling  sanjeev-arora  scale  scaling-tech  sci-comp  science-anxiety  science  scifi-fantasy  scitariat  search  sebastien-bubeck  security  sequential  shalizi  shift  siggraph  signal-noise  signaling  signum  similarity  simplex  skeleton  sleuthin  smoothness  social  space  sparsity  spatial  speaking  speculation  speed  speedometer  spock  ssc  stat-mech  state-of-art  stats  stochastic-processes  stories  strategy  straussian  street-fighting  structure  study  submodular  success  summary  survey  symmetry  synchrony  synthesis  systematic-ad-hoc  systems  tails  talks  tcs  tcstariat  teaching  tech  technical-writing  technology  techtariat  tensors  tetlock  the-bones  the-great-west-whale  the-trenches  the-world-is-just-atoms  thermo  things  thinking  thurston  tidbits  tightness  time-complexity  time-series  time  toolkit  tools  top-n  tradeoffs  transitions  transportation  trees  trends  tricki  tricks  trump  tutorial  twitter  uniqueness  unit  unsupervised  usa  values  vc-dimension  video  visual-understanding  visualization  volo-avolo  von-neumann  web  west-hunter  whiggish-hegelian  wiki  wild-ideas  wire-guided  within-without  workflow  world  worrydream  writing  yarvin  yoga  yvain  🎓  🐸  🔬  🖥  🤖 

Copy this bookmark: