tsuomela + significance   14

Scientific method: Statistical errors : Nature News & Comment
"P values, the 'gold standard' of statistical validity, are not as reliable as many scientists assume."
statistics  research  replication  methods  significance 
february 2014 by tsuomela
PLOS Medicine: Why Most Published Research Findings Are False
"There is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance. Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true. Moreover, for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias. In this essay, I discuss the implications of these problems for the conduct and interpretation of research."
research  methodology  methods  statistics  validation  truth  significance 
january 2014 by tsuomela
Behavioral research may overstate results | Science & Society | Science News
"Here’s a hard pill to swallow for practitioners of “soft” sciences: Behavioral studies statistically exaggerate findings more often than investigations of biological processes do, especially if U.S. scientists are involved, a new report finds."
science  psychology  social-science  effects  statistics  meta-analysis  research  significance 
august 2013 by tsuomela
Statistical Significance Is an Arbitrary Convention : Uncertain Principles
"As a result, arguments about whether a given result is just above or just below an arbitrary and conventional threshold seems foolish. Doing the calculations wrong is still a major mistake, but whether they're done correctly or not, we should stop pretending that "statistically significant" is some kind of magic guarantee of quality."
science  statistics  significance  meaning  research  results  positivism  methodology 
september 2011 by tsuomela
What's stats got to do with it? - Expression Patterns Blog | Nature Publishing Group
"I realized I wasn't scared of stats: just bored and annoyed and wondering, indeed, what they had to do with various things. Keeping track of lots of data makes for pretty graphs and useful trends. Those kinds of stats are cool. But statistical analysis of data doesn't always make sense to the people using it. Not just because it's complicated, but because it's not always informative of what they're looking at. It has to make sense in context. You have to be able to actually answer the question "what's stats go to do with it?", and not just use it rhetorically like I did in most of this post. "
statistics  mathematics  graphs  data  understanding  significance 
january 2011 by tsuomela
Easily Distracted » Blog Archive » Big Pharma, Big Wonkery
small study populations that conceal the potential magnitude and frequency of dangerous or fatal side effects, benefits that are marginal or at the edge of statistical significance which are implied to be far greater in size, reviews of existing research
science  social-science  methodology  statistics  significance  philosophy  professional-standards  medicine 
june 2008 by tsuomela

Copy this bookmark: