https://xitter.cf/t.co/YfcrnyV3jJ #unjournal (https://xitter.cf/t.co/UX8Sn5SYGZ): see more on Bluesky. Research tools. #openscience, #econtwitter, effective philanthropy

Massachusetts, USA
Joined August 2017
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
This interested me! and GiveWell (blog.givewell.org/2024/06/26…)! But I was also skeptical. Thankfully I'm an evaluation manager at The Unjournal (unjournal.pubpub.org), where we do open evaluations of impactful research, so we evaluated it.
1
2
27
1,517
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
I've noticed when submitting peer reviews that some journals now have a box you have to check that pledges that you didn't use AI when doing the review. This seems dumb to me. I do use AI when I do peer reviews. I do the following: 1. Write my review as I always have, 2. Upload the paper to a frontier model and ask it to do a review as well. (I have settings set up so this data is not retained e.g. for training), 3. I compare the LLM review against mine, and I add to mine things that the LLM caught that I did not if such things exist. I think this produces a strictly better peer review.
31
11
8
303
38,681
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
GiveWell literally funded research by a Nobel prize winning development economist on a question GW cared about. They then flagged it for an open peer review process (unjournal.pubpub.org/pub/eva…). And yet Leif writes this πŸ‘‡
9
20
244
31,810
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
Two takes on the same paper. Different messages (one sounds a lot more positive than the other) but both are technically correct summaries.
3
14
1
67
10,816
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
We are launching the "Allegedly Does Not Replicate" Podcast to discuss these questions (and many more)! First episode is now live in Spotify and YouTube podcasters.spotify.com/pod/s…
1
8
1
40
3,502
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
If I ever stop being a professor it will probably be because I can no longer withstand how many people doing research do not deeply care about trying to get the right answer.
30
52
11
971
185,559
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
A thread about how science should work, ways to cheaply save lives, peer review, and diarrhea πŸ‘‡
5
48
3
119
27,127
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
Nice thread about an open review of a v important paper (Kremer et al's meta analysis on water chlorination and child mortality). Great to see the Unjournal (unjournal.org) reviewing this type of important work and publicly sharing reviews - kudos @GivingTools!
A thread about how science should work, ways to cheaply save lives, peer review, and diarrhea πŸ‘‡
3
12
1,814
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
Researchers: Submit your papers if you'd like to be considered for evaluation at the Unjournal! This is the best way to get your research out, and we're constantly innovating to ensure Unjournal is making a meaningful contribution. @leightjessica @Prof_Nishith_P @KaranBabbar19
1
1
2
116
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
I've been part of a novel and open peer-review initiative aptly called the #Unjournal (unjournal.org/), founded by the super David Reinstein (@GivingTools). Posting a thread on some of the evaluations I've (co)managed, and encourage researchers to submit work to us 1/n
1
1
1
155
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
Ridiculously high-impact applied research job! #altac
LEEP is hiring a Director of Research and Strategy! Take a look to find out more and to apply. leadelimination.org/jobs/
1
1
446
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
β€œReplicability & Generalisability”: Applying a discount factor to cost-effectiveness estimates. statmodeling.stat.columbia.e…
3
3
16
16,884
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
An Oxford-led paper exploring impacts of #wildlife #trade bans has won first place in The #Unjournal’s 'Impactful Research Prizes'. The study provides evidence that trade bans on some threatened species may increase demand for other non-banned species. See bit.ly/4bcUGC9
8
1
25
1,824
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
As a reviewer, I do not recommend acceptance until I have access to the data and materials. I put this statement in all my reviews (copied from another reviewer). If more reviewers do this, maybe journals will eventually change their policies (or stop asking us to review...)
Props to Marketing Letters... But for the rest... this is still not good enough...
1
2
28
5,294
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
In my experience, reproducible manuscripts have probably saved me time. After learning how (lakens.github.io/statistical…) I have benefitted immensely from recompiling a manuscript after correcting an inclusion error - all tests and figures just update! Would recommend it to anyone.
Let’s talk about reproducible analyses! Before I left academia, I started making reproducible R notebooks for every study. Walks user through every step, explains logic & matches paper. Folksβ€”it’s as much work as the actual paper and the only way i see to make this work 1/n
1
16
2
82
23,370
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
This take is the most important take on Gino's defamation lawsuit. I hope the academic community supports the datacolada group.
I’m repeating myself but I think such a lawsuit is an incredibly bad omen for free speech in science. Exposing bad research is already under-incentivised. I read the blog post: there weren’t personal attacks. If the blog post was mistaken, Gino should clarify how.
4
27
4,001
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
This is a tragedy. I am less proud of the UK as a result of this.
4
6
55
5,360
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
#1 Two candidates, with same number of publications (~10) from the same journals and very similar qualifications. A: PhD from Ivy-league University B: PhD from non Ivy-league Would: Ivy > Non Ivy. Should: Non Ivy > Ivy.
1
1
1,019
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
Replying to @GivingTools
There are ai citation tools that extract the paragraph in which the citation occurs. What you suggest could be automated by then applying classification tools to fhe mentioning paragraph. Scale it up and create an alternative or add-on to Google scholar.
1
1
113
π™³πšŠπšŸπš’πš πšπšŽπš’πš—πšœπšπšŽπš’πš— retweeted
Replying to @Econ_4_Everyone
This is insane. Economics is trapped in a bad equilibrium regarding publication in top journals.
1
1
7
718