**tsuomela + significance**
14

Scientific method: Statistical errors : Nature News & Comment

february 2014 by tsuomela

"P values, the 'gold standard' of statistical validity, are not as reliable as many scientists assume."

statistics
research
replication
methods
significance
february 2014 by tsuomela

PLOS Medicine: Why Most Published Research Findings Are False

january 2014 by tsuomela

"There is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance. Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true. Moreover, for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias. In this essay, I discuss the implications of these problems for the conduct and interpretation of research."

research
methodology
methods
statistics
validation
truth
significance
january 2014 by tsuomela

Behavioral research may overstate results | Science & Society | Science News

august 2013 by tsuomela

"Here’s a hard pill to swallow for practitioners of “soft” sciences: Behavioral studies statistically exaggerate findings more often than investigations of biological processes do, especially if U.S. scientists are involved, a new report finds."

science
psychology
social-science
effects
statistics
meta-analysis
research
significance
august 2013 by tsuomela

Statistical Significance Is an Arbitrary Convention : Uncertain Principles

september 2011 by tsuomela

"As a result, arguments about whether a given result is just above or just below an arbitrary and conventional threshold seems foolish. Doing the calculations wrong is still a major mistake, but whether they're done correctly or not, we should stop pretending that "statistically significant" is some kind of magic guarantee of quality."

science
statistics
significance
meaning
research
results
positivism
methodology
september 2011 by tsuomela

What's stats got to do with it? - Expression Patterns Blog | Nature Publishing Group

january 2011 by tsuomela

"I realized I wasn't scared of stats: just bored and annoyed and wondering, indeed, what they had to do with various things. Keeping track of lots of data makes for pretty graphs and useful trends. Those kinds of stats are cool. But statistical analysis of data doesn't always make sense to the people using it. Not just because it's complicated, but because it's not always informative of what they're looking at. It has to make sense in context. You have to be able to actually answer the question "what's stats go to do with it?", and not just use it rhetorically like I did in most of this post. "

statistics
mathematics
graphs
data
understanding
significance
january 2011 by tsuomela

Easily Distracted » Blog Archive » Big Pharma, Big Wonkery

june 2008 by tsuomela

small study populations that conceal the potential magnitude and frequency of dangerous or fatal side effects, benefits that are marginal or at the edge of statistical significance which are implied to be far greater in size, reviews of existing research

science
social-science
methodology
statistics
significance
philosophy
professional-standards
medicine
june 2008 by tsuomela

**related tags**

Copy this bookmark: