𝙳𝚊𝚟𝚒𝚍 𝚁𝚎𝚒𝚗𝚜𝚝𝚎𝚒𝚗

(Note, it has other features I do find useful, like helping you listen to a music track behind a spoken track or audiobook, and you can have both in both ears if you like. And there are more features in the works.)

Did you ever want to listen to different audio in each of your earbuds? No, me neither, but I bet a lot of unusual people do. My cousin Daniel Shuldman just launched an app for this: dicotic.com "Two streams. One mind."

uj-wellbeing-workshop.netlify.app Unjournal online workshop on using wellbeing measures for prioritizing LMIC interventions. March 16. Some slots still available. #econtwitter

Wondering how Unjournal.org actually works? Here's a two-minute walkthrough, thanks to one of our field specialists. youtube.com/watch?v=ZCSeAm…

@JohnHolbein1 Pushing forward on a better system at Unjournal.org. Happy to get your feedback and involvement.

Love the research process; hate the publication process

The Unjournal's 2024-25 Evaluator Prizes announced! Recognizing 8 of 80+ expert peer reviewers for outstanding public evaluation work. $6,500 in prizes. → info.unjournal.org/evaluator-priz…

This interested me! and GiveWell (blog.givewell.org/2024/06/26/res…)! But I was also skeptical. Thankfully I'm an evaluation manager at The Unjournal (unjournal.pubpub.org), where we do open evaluations of impactful research, so we evaluated it.

@ryancbriggs Unjournal.org proposed policy on AI use -- eager for feedback #heading=h.ri8bve8d64rk" target="_blank" rel="nofollow noopener">docs.google.com/document/d/14f… Sketching out AI use policy, tools and suggestions in a draft of our new evaluation form here: daaronr.github.io/unjournal_tool… Love any suggestions/feedback! Thanks

I've noticed when submitting peer reviews that some journals now have a box you have to check that pledges that you didn't use AI when doing the review. This seems dumb to me. I do use AI when I do peer reviews. I do the following: 1. Write my review as I always have, 2. Upload the paper to a frontier model and ask it to do a review as well. (I have settings set up so this data is not retained e.g. for training), 3. I compare the LLM review against mine, and I add to mine things that the LLM caught that I did not if such things exist. I think this produces a strictly better peer review.

GiveWell literally funded research by a Nobel prize winning development economist on a question GW cared about. They then flagged it for an open peer review process (unjournal.pubpub.org/pub/evalsumwat…). And yet Leif writes this 👇

@ahall_research Exactly. We’ve been encouraging living dynamic research formats like this at Unjournal.org. You can submit research — in any format— for expert public evaluation and rating. And improve the research in the same place and get it reevaluated.

I built a tool to imagine how AI can help us create better, more transparent research. Instead of only seeing the tiny number of analyses the author chooses to ossify in a static pdf, imagine being able to talk to the papers you read and ask for different analyses. That's what I built. This early prototype uses our vote-by-mail extension. You get to see the initial analyses we thought made sense, but you can ask the LLM to show you way more! e.g., "what would the results look like if we excluded Utah" or "what would the results look like if we excluded Washington and used linear trends" etc. With research agents like Claude code, researchers are going to be able to automatically search across millions of potential analyses. Our current paradigm is not equipped to transmit this complexity effectively or make sure we don't end up with all p-hacked results. My lab and I are thinking about how we can transform the way we do and disseminate research to adjust for this new world. This visualizer is the first of what will hopefully be a wide range of ideas. Big props to Janet Malzahn for suggesting this one. Check out the tool at the link below.

@ryancbriggs Have you tried using Claude code in the terminal? I've been using that one extensively but I'm wondering whether cowork offers any advantages over that (other than the more attractive interface/fonts, the ability to see visuals within a browser, etc. )

I can't imagine this is going to lead to a good result, but it feels silly not to explore what Opus can do. I just pointed it at a directory that has all of the documents that go into compiling a .pdf of a paper I wrote recently and I gave Cowork the simplest prompt...

#econtwitter #GlobalHealth #fundraising #effectivealtruism #academictwitter #environment #AnimalWelfare @EdoardoMasset @MatthewBJane

Unjournal pays "reviewers" for their work: tinyurl.com/UJpay Avg: $450/$350 per eval in base + bonuses + prizes. 2024-awards: they want your feedback – which evaluations merit the top award, and why? Total prize pool: $6600 unjournal.org/news/unjournal…

@KhoaVuUmn @Isa_DiFilippo With respect to the authors (Wooldridge is usually on the money), that one always seemed like "excuses not to do weighting" to me. It didn't seem fully fleshed out.

@Isa_DiFilippo Classic jstor.org/stable/24735988

#econtwitter Does anyone have good suggested readings on weighting in regressions and when it should be used? 🙏🏻

See details on how to join The Unjournal evaluator pool or get involved in other ways: globalimpact.gitbook.io/the-unjournal-… Thread continues on Bluesky: bsky.app/profile/unjour…

@YaleSOM You may want to consider Unjournal.org's commissioned evaluations of this paper: #metrics" target="_blank" rel="nofollow noopener">unjournal.pubpub.org/pub/evalsumbio…

Congratulations to Prof. Stefano Giglio and his co-authors for winning the inaugural Berkeley Haas Sustainable Business Research Prize for paper on biodiversity risk! Read more: yalesom.io/4869eB2

coda.io/form/Stakehold… Unjournal.pubpub.org: 100+ expert evaluations of global-priorities relevant research

Researchers, research-users, practitioners, funders, managers: Unjournal.org wants your feedback on our work & how we can improve & boost our impact. Survey with lottery incentive: See unjournal.org/news/stakehold… #econtwitter #policytwitter

Unjournal.org plans to work with: manifund.org/projects/metac… (Consider pledging?) Plans: - Integrate some Unjournal’s Pivotal Question content (cultured meat, plant-based alternatives) - Help operationalize & vet tournament questions --> thread continues on Bluesky