You assume that I am interested in long-term average properties of procedures, even though I have so often argued that they are at most necessary (as consequences of good procedures), but scarcely sufficient for a severity assessment. The error statistical account I have developed is a statistical philosophy. It is not one to be found in Neyman and Pearson, jointly or separately, except in occasional glimpses here and there (unfortunately). It is certainly not about well-defined accept-reject rules. If N-P had only been clearer, and Fisher better behaved, we would not have had decades of wrangling. However, I have argued, the error statistical philosophy explicates, and directs the interpretation of, frequentist sampling theory methods in scientific, as opposed to behavioural, contexts. It is not a complete philosophy…but I think Gelmanian Bayesians could find in it a source of “standard setting”.
You say “the prior is both a probabilistic object, standard from this perspective, and a subjective construct, translating qualitative personal assessments into a probability distribution. The extension of this dual nature to the so-called “conventional” priors (a very good semantic finding!) is to set a reference … against which to test the impact of one’s prior choices and the variability of the resulting inference. …they simply set a standard against which to gauge our answers.”
I think there are standards for even an approximate meaning of “standard-setting” in science, and I still do not see how an object whose meaning and rationale may fluctuate wildly, even in a given example, can serve as a standard or reference. For what?
Perhaps the idea is that one can gauge how different priors change the posteriors, because, after all, the likelihood is well-defined. That is why the prior and not the likelihood is the camel. But it isn’t obvious why I should want the camel. (camel/gnat references in the paper and response).
Archive for Error and Inference
Another focussed spam in the mail:
Dear Dr. Christian P. Robert,
How are you?
I read your interesting article of “Error and inference: an outsider stand on a frequentist philosophy“, and I know you are an active professional in this field.
Now, I am writing you to call for new papers, on behalf of Review of Economics & Finance, which is an English quarterly journal in Canada.
This journal is currently indexed by EconLit of American Economic Association (AEA), EBSCO, RePEc, National Bibliography of Canada, Library and Archives Canada, DOAJ, Ulrich, and so on.
The publication fee is CAD$450, if your paper is qualified for publication after refereeing. The submission fee of $50 is NOT applied to you by March 6th, 2013.
Thank you for your consideration. Have a rewarding month!
At least, they are quite honest about the cost of publishing there. But they should check on which paper they pick rather than using a robot that takes a paper not talking about economics or finance… (And why on Earth this line about the rewarding month?!)
As in previous years, let me warn unwary readers that the links to Amazon.com and Amazon.fr found on this blog are actually susceptible to earn me a monetary gain [from 4% to 7%] if a purchase is made in the 24 hours following the entry on Amazon through this link, thanks to the “Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to amazon.com/fr“. As with last year, most of the items purchased through the links and contributing to my bookoholic addiction are rather unrelated with the purpose of the ‘Og, but, as already mentioned , anything can happen within 24 hours! Here are the weirdest ones:
- Toy Vault 12″ Cthulhu Plush Toy and Pokemon Pillow
- Stewart’s Pro-Treat 21 ounce Tub Freeze Dried Dog Treats, Beef Liver
- ten copies of Hp Compaq Evo N610v Ac Adapter 0mAh
- Philosophy Purity Made Simple One-Step Facial Cleanser
- Nile Spice Lentil Soup
- ten copies of Donald in Mathmagic Land
plus of course the books I actually reviewed along the past months, positively or negatively… Like seven copies of Error and Inference. And a dozen of R for dummies. And many other books on Bayesian statistics and R programming. Thanks!
This CRC Press book was sent to me for review in CHANCE: Paradoxes in Scientific Inference is written by Mark Chang, vice-president of AMAG Pharmaceuticals. The topic of scientific paradoxes is one of my primary interests and I have learned a lot by looking at Lindley-Jeffreys and Savage-Dickey paradoxes. However, I did not find a renewed sense of excitement when reading the book. The very first (and maybe the best!) paradox with Paradoxes in Scientific Inference is that it is a book from the future! Indeed, its copyright year is 2013 (!), although I got it a few months ago. (Not mentioning here the cover mimicking Escher’s “paradoxical” pictures with dices. A sculpture due to Shigeo Fukuda and apparently not quoted in the book. As I do not want to get into another dice cover polemic, I will abstain from further comments!)
Now, getting into a deeper level of criticism (!), I find the book very uneven and overall quite disappointing. (Even missing in its statistical foundations.) Esp. given my initial level of excitement about the topic!
First, there is a tendency to turn everything into a paradox: obviously, when writing a book about paradoxes, everything looks like a paradox! This means bringing into the picture every paradox known to man and then some, i.e., things that are either un-paradoxical (e.g., Gödel’s incompleteness result) or uninteresting in a scientific book (e.g., the birthday paradox, which may be surprising but is far from a paradox!). Fermat’s theorem is also quoted as a paradox, even though there is nothing in the text indicating in which sense it is a paradox. (Or is it because it is simple to express, hard to prove?!) Similarly, Brownian motion is considered a paradox, as “reconcil[ing] the paradox between two of the greatest theories of physics (…): thermodynamics and the kinetic theory of gases” (p.51) For instance, the author considers the MLE being biased to be a paradox (p.117), while omitting the much more substantial “paradox” of the non-existence of unbiased estimators of most parameters—which simply means unbiasedness is irrelevant. Or the other even more puzzling “paradox” that the secondary MLE derived from the likelihood associated with the distribution of a primary MLE may differ from the primary. (My favourite!)
“When the null hypothesis is rejected, the p-value is the probability of the type I error.” Paradoxes in Scientific Inference (p.105)
“The p-value is the conditional probability given H0.” Paradoxes in Scientific Inference (p.106)
Second, the depth of the statistical analysis in the book is often found missing. For instance, Simpson’s paradox is not analysed from a statistical perspective, only reported as a fact. Sticking to statistics, take for instance the discussion of Lindley’s paradox. The author seems to think that the problem is with the different conclusions produced by the frequentist, likelihood, and Bayesian analyses (p.122). This is completely wrong: Lindley’s (or Lindley-Jeffreys‘s) paradox is about the lack of significance of Bayes factors based on improper priors. Similarly, when the likelihood ratio test is introduced, the reference threshold is given as equal to 1 and no mention is later made of compensating for different degrees of freedom/against over-fitting. The discussion about p-values is equally garbled, witness the above quote which (a) conditions upon the rejection and (b) ignores the dependence of the p-value on a realized random variable. Continue reading
A few days ago, while in Roma, I got the good news that my review of Error and Inference had been accepted by Theory and Decision. Great! Then today I got a second email asking me to connect to a Springer site entitled “Services for Authors” with the following message:
Dear Christian Robert!
Thank you for publishing your paper in one of Springer’s journals.
Article Title: Error and Inference: an outsider stand on a frequentist philosophy
Journal: Theory and Decision
Make your Choice
In order to facilitate the production and publication of your article we need further information from you relating to:
- Please indicate if you would like to publish your article as open access with Springer’s Open Choice option (by paying a publication fee or as a result of an agreement between your funder/institution and Springer). I acknowledge that publishing my article with open access costs € 2000 / US $3000 and that this choice is final and cannot be cancelled later.
- Please transfer the copyright, if you do not publish your articles as open access.
- Please indicate if you would like to have your figures printed in color.
- Please indicate if you would like to order offprints. You have the opportunity to order a poster of your article against a fee of €50 per poster. The poster features the cover page of the issue your article is published in together with the article title and the names of all contributing authors.
Now I feel rather uncomfortable with the above options since I do not see why I should pay a huge amount
€ 2000 € for having my work/review made again available. Since it is already freely accessible on arXiv. And it is only a book-review, for Gutenberg’s sake! Last year, we made our PNAS paper available as Open Access, but this was (a) cheaper and (b) an important result, or so we thought! The nice part of the message was that for once I did not have to sign and send back a paper copy of the copyright agreement as with so many journals and as if we still were in the 19th Century… (I do not see the point in the poster, though!)