tag:blogger.com,1999:blog-987850932434001559.post5705153803217776818..comments2024-03-28T05:57:40.089+01:00Comments on The 20% Statistician: The perfect t-testDaniel Lakenshttp://www.blogger.com/profile/18143834258497875354noreply@blogger.comBlogger19125tag:blogger.com,1999:blog-987850932434001559.post-55058686878789761172019-08-20T09:14:14.095+02:002019-08-20T09:14:14.095+02:00Hi Daniel, many thanks for this resource. Would th...Hi Daniel, many thanks for this resource. Would there be any chance of converting them to a Shiny app, to really drop the barriers to use? A really nice example of similar resources that have been implemented in a Web interface is https://www.estimationstats.com/#/ Anonymoushttps://www.blogger.com/profile/06522283751759510506noreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-64868200392757921452016-10-31T21:53:23.511+01:002016-10-31T21:53:23.511+01:00So far only for the independent t-test. If I have ...So far only for the independent t-test. If I have more time, will fix it for the dependent t-test as well.Daniel Lakenshttps://www.blogger.com/profile/18143834258497875354noreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-10097688917648766152016-10-31T21:52:44.815+01:002016-10-31T21:52:44.815+01:00I've fixed the yuenbt error (I think - the scr...I've fixed the yuenbt error (I think - the script now runs on my computer).Daniel Lakenshttps://www.blogger.com/profile/18143834258497875354noreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-17071614723307009382016-10-17T12:49:09.442+02:002016-10-17T12:49:09.442+02:00As an R newbie just discovering this script, I am ...As an R newbie just discovering this script, I am getting the 'yuenbt' error— any easy workarounds? <br /><br />Thanks for all your work Daniel! Anonhttps://www.blogger.com/profile/09399074731642625781noreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-87726090309154179172016-10-03T13:02:10.466+02:002016-10-03T13:02:10.466+02:00I'm sure it took you a lot of time to prepare ...I'm sure it took you a lot of time to prepare this and I'm sure it would be very useful for a number of people. However, I think you might be running the risk of creating something, you'd have to keep on updating constantly (library/R updates; not to mention answering numerous questions and requests), so perhaps a tutorial for doing all those things you script aims to achieve would be less time consuming and serve an educational purpose at the same time. After all, those who would be able to work around potential bugs, won't really use it; R newbies will be unable to use a broken version, so I guess R's life-cycle renders the task of maintaining the perfect t-test script almost impossible without crowd sourcing its maintenance.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-60869416277691582772016-10-02T19:32:27.724+02:002016-10-02T19:32:27.724+02:00Thanks for informing me - I'm still thinking a...Thanks for informing me - I'm still thinking about how this script will be shared, finally, and whether I will maintain it, and if so, how. Daniel Lakenshttps://www.blogger.com/profile/18143834258497875354noreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-7971362567611347692016-10-02T19:30:55.133+02:002016-10-02T19:30:55.133+02:00FYI: package ‘yuenbt’ is not available (for R vers...FYI: package ‘yuenbt’ is not available (for R version 3.2.3), this breaks the script.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-45573427742121781832016-03-09T16:32:59.030+01:002016-03-09T16:32:59.030+01:00You forgot the Keselman article in the references....You forgot the Keselman article in the references. Nice work though!Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-26904812705909524002016-02-05T11:03:28.278+01:002016-02-05T11:03:28.278+01:00Still playing with script, now on my own data - so...Still playing with script, now on my own data - so a bit more feedback. The statement "This script uses the reshape2 package to convert data from wide to long format" seems to be wrong - user need to use melt() by their own. The "ppnr" column (for stable tab-delimited input?) may be omitted. The color highlighting of user variables and main results in the output text is much desired.Nikolaynoreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-14292642214576948622016-02-05T09:54:41.146+01:002016-02-05T09:54:41.146+01:00Thanks for the script - such kind of tools made by...Thanks for the script - such kind of tools made by professional statistician can really motivate us (backwoods-biologists) to learning R. Special thanks for clear and comprehensive text accompanying results - i think script really earn this "perfect" in the title. Any plans/possibility to write similar script and supplementary text for few groups comparison (OW-ANOVA, K-W, some modern randomization/permutations stuff)?<br /><br />PS. I tried independent t-test version. There is typo "whih" in the text. In Robust statistics section "Figure 1. Means and 95% CI, and violin plot" only first part of fig. is plotted (no violin plot - and no warning message in R output). Just a feedback to let your improve the code/text - thank you very much for you work!Nikolaynoreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-23225259071372309172015-10-23T02:29:06.039+02:002015-10-23T02:29:06.039+02:00Professor Lakens,
Excellent post! I will study it...Professor Lakens,<br /><br />Excellent post! I will study it meticulously.<br />I have some questions, though:<br />1) Why you, EJ Wagenmakers and others seem to prefer Bayes Factor as the representant of Bayesian inference, if there is some advocacy against it (e.g., http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2606016)?<br />2) The Markdown has exact the same look of Kruschke's Doing Bayesian Data Analysis. Is it the default or are you sharing scripts? :)<br />3) I also believe that we (psychologists) should be more well-informed of new statistical methods that surpass the traditional ones (I use only Welch's test since I read an older post of yours). But, being our field slow in updating, do you think that a paper reporting your "perfect t test" would have the same publication's probability than the same paper reporting a common t test? If not, how to overcome this barrier?<br /><br />VithorAnonymoushttps://www.blogger.com/profile/09898146442777039507noreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-34097357568335594182015-05-23T14:12:43.824+02:002015-05-23T14:12:43.824+02:00Oops... I didn't click 'reply', sorry....Oops... I didn't click 'reply', sorry.<br />I thought it would have been better all together, but it's just my opinion ;-)<br />EpifunkyUnknownhttps://www.blogger.com/profile/11636984948893839529noreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-89704284665024429042015-05-23T14:10:18.257+02:002015-05-23T14:10:18.257+02:00Yes, but it seems more useful to integrate that in...Yes, but it seems more useful to integrate that into the p-checker app: http://shinyapps.org/apps/p-checker/Daniel Lakenshttps://www.blogger.com/profile/18143834258497875354noreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-22664007406228213942015-05-23T14:08:36.775+02:002015-05-23T14:08:36.775+02:00Isn't it possible to add a functionality to ca...Isn't it possible to add a functionality to calculate power based on the assumed true effect size à la pwr.t.test?Unknownhttps://www.blogger.com/profile/11636984948893839529noreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-18297641861189143522015-05-23T13:53:54.064+02:002015-05-23T13:53:54.064+02:00Thanks! The power of a study is not a statistical ...Thanks! The power of a study is not a statistical inference - it requires knowledge about the true effect size, which requires a theoretical model. So I don't see how my script could do that. Instead, after you get the p-value, a human needs to take power into account. Pos-hoc power is not useful for that, as I explained on this blog.Daniel Lakenshttps://www.blogger.com/profile/18143834258497875354noreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-86456306749320604102015-05-23T13:51:41.859+02:002015-05-23T13:51:41.859+02:00Hi Daniel,
In a previous post, you wrote "It...Hi Daniel,<br /><br />In a previous post, you wrote "It shows that when interpreting p-values, it is important to take the power of the study into consideration.". I completely agree, that's why I regret the absence of power calculation.<br /><br />In any case your perfect t-test is terrific!<br /><br />EpifunkyUnknownhttps://www.blogger.com/profile/11636984948893839529noreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-35990111401313292922015-05-21T16:12:26.862+02:002015-05-21T16:12:26.862+02:00> I was affraid no one would be critical about ...> I was affraid no one would be critical about this!<br />Haha, you can always count on me in this regard. <br /><br />PR: You could go into a (sarcastic) clickbait-overdrive with something like: "BLAST your way to SUPER-$$$ignificant results with the Lakens TVRBO-T!!!" :Dmatushttp://simkovic.github.io/noreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-50213264069651134152015-05-21T14:58:12.937+02:002015-05-21T14:58:12.937+02:00Hi Matus,
thanks for your comment - I was affraid...Hi Matus,<br /><br />thanks for your comment - I was affraid no one would be critical about this! The 'perfect t-test' name is pure PR. It draws attention. Remember I'm trying to convince people to use it, because I think it will improve the way they report statistics, so everything is allowed to draw them away from SPSS to R (surely, you must agree?). <br /><br />If it leads to more data dredging - I don't know. It's not something this is meant to solve - there is pre-registration for that, and I invested some time in a special issue on pre-registered replications to combat results due to data dredging. One thing at a time!<br /><br />DanielDaniel Lakenshttps://www.blogger.com/profile/18143834258497875354noreply@blogger.comtag:blogger.com,1999:blog-987850932434001559.post-37795216384487846762015-05-21T14:40:12.837+02:002015-05-21T14:40:12.837+02:00significant p-value
confidence interval
credible i...significant p-value<br />confidence interval<br />credible interval<br />normal distribution<br />and now <br />perfect t-test<br /><br />Why is it so important to make up names that include judgemental qualifiers? Are all other t-tests (including every future proposal) "imperfect"? You write that there is no "perfect" test. So whats the point of calling it that way? <br /><br />I think "a bank of two-sample difference tests" describes much better what you do. The qualifier "difference" is crucial. If the relevant ES is a quotient or some more complex model is needed then your perfect test will provide misleading results.<br /><br />As you probably know by now, I'm opposed to one-click solutions. One-click solutions usually don't mean less time spent with data analysis = more free time for other stuff. Rather the time for data analysis is held constant and the number of one-click analyses of the same dataset increases = data dredging. <br />matushttp://simkovic.github.io/noreply@blogger.com