ManyClasses

The first ManyClasses study is released! Final registered report now in press at AMPPS and preprint posted at psyarxiv.com/4mvyh/ What's it all about? Hey, we're glad you asked… 1/19

No one from the ManyClasses team is active on X anymore (it took us a couple days just to find our login 🙃), but we’re interested in constructive feedback! Feel free to reach out to us via email with any reactions or comments.

We wish we had more time to recruit additional schools and teachers to participate, but the competition rules really constrained our timeline. We’re sincerely grateful for the collaboration from IU, Florida, UNL, and South Fayette School District.

ManyClasses 2 is now released as a preprint! 🥳 osf.io/preprints/psya…

This was published today in Behavior Research Methods🎉 link.springer.com/article/10.375…

@mikehobbiss @dodiscimus @Doug_Lemov @MrTSci409 Ooo that'd be cool!!! You should do it! "ManyClasses" is a model for doing research, and one that we'd love to see adopted more broadly. If we can help let us know! (and kudos @mikehobbiss for schooling folks on crossmodal attention in that thread!)

The generalizability crisis commentaries are out (including ours; doi.org/10.1017/S01405…). Eager to see what generalizes!

37 behavioral scientists designed a 23 condition megastudy testing different sets of 1-2 text messages to boost vaccinations among 689,693 @Walmart pharmacy customers 430 forecasters tried to predict what worked NOW our results are out in @PNASNews... 🧵 pnas.org/content/119/6/…

Throwback to two years ago, February 2020, hours each day manually coding moderators. Fun times!

PLEASE RT! We are recruiting volunteer analysts to estimate the analytical robustness of social science by re-analyzing findings from 100 papers. We need hundreds of analysts who can become co-authors and get paid. More info here: osf.io/7snkz/ @OSFramework

Shout out to our friend @cab938 for co-organizing a preconference workshop at @lak22online on fostering open research practices in learning analytics. Come join us! sites.google.com/view/building-…

Our first funding round of 2022 – expected to open in Feb - will focus on three key themes for teaching and learning, which our evidence reviews have identified as having gaps in the evidence base. 1/5

@karenraycosta @HeatherManessFL @AngelaStockman But whether students knew before the assessment is another question. We'd be interested to see the research you're mentioning! -- we hadn't seen that specifically in our feedback timing literature review.

@karenraycosta @HeatherManessFL @AngelaStockman Oooo good question! We tried to ensure that students knew that they'd receive feedback, and that we were manipulating feedback timing. We were pretty transparent in the consent form (osf.io/p6jxq/) and teachers were supposed to discuss in class (osf.io/96sxc/)

@HeatherManessFL @AngelaStockman @karenraycosta But one limitation: No instructors of writing classes applied to participate in ManyClasses, and thus no writing classes are included. Whether the effects observed generalize is exactly the sort of question that we think more researchers should be asking! Skepticism welcome!

@HeatherManessFL @AngelaStockman @karenraycosta Sixteen of the 38 participating classes included explanatory feedback. This moderator did not affect the relationship between feedback timing and student learning. Full list of moderators: osf.io/tjkyr/ ...

@jerodq @karenraycosta Our approach was to let each teacher report their own relevant outcome scores from each treatment period. Without teacher-assigned grades, could still use student's self-assessments. It'd be messy, but that's kinda the point of translating learning theory to authentic assessment.