“Our study was not published in a peer-review journal because I had intended to do a follow-up study that would serve to replicate and extend these findings. In the meantime, the birth center was sold and the director who had been amenable to our research left her position; the graduate student transferred to another program; and my own career interests took me in other directions.”
]]>Makes me a bit more skeptical there isn’t anything else to the study design.
]]>The biological mechanism is only one item in the Bradford Hill Criteria (http://en.wikipedia.org/wiki/Bradford_Hill_criteria). I know there are plenty of treatments we don’t entirely understand the mechanics of but are strongly recommended. And I’m not even a doctor! Take tuberculosis treatment for example. Why does WHO recommend 6 months? Why don’t the drugs kill off everything in 6 weeks? Why not 10 months? We don’t know how those little bugs hide and elude the drugs, but we do know relapse rates climb quickly for less than 6 months treatment. We’ll figure out why someday, but we’re confident to act accordingly in the meantime.
@Victor Shamas, you can have 4 more datapoints for your hypothesis generation. 🙂 My wife and I predicted the sex on all 4 of our children (2 boys, 2 girls) before even the first ultrasound. It’s actually quite easy. She vomits about 100x as frequently with a girl as with a boy.
]]>When Amanda and I presented our initial findings in a departmental colloquium here at the University of Arizona, a visiting neuropsychologist objected, arguing that our findings could have been due to chance. I found it pretty amusing given that he had made his career on the study of a phenomenon called blindsight, which is based on the observation of an occurrence 59% of the time (compared to chance, which is 50%). Our effect size was over 70%, and there was no question about statistical significance.
As you point out, there are ALWAYS methodological issues that can be raised with any study. We researchers try to do the best we can in designing our studies, but as far as I know, the perfect research study has yet to be designed. There is always more to know and questions to be answered. The most beautiful thing in science is the power of replicability. If you doubt what we did, you can run your own experiment. In this case, I have the original survey and would more than welcome someone to replicate our now 16-year-old findings.
Then there is the question of mechanism to be addressed. If in fact these women did have accurate intuitions concerning the sex of their unborn children, what was the basis of those intuitions? I don’t have a definitive answer to that question but am more than happy to offer my speculation, which is perfectly legitimate with respect to the scientific process. After all, this type of speculation is how new hypotheses are generated.
]]>The biggest danger is in comparing p-values. If you had a regression model with 10 variables and examined p-values, why not just turn it into a linear regression with the single highest p-value?
]]>