Recent searches
Search options
#metascience
0 posts0 participants0 posts today
"From Hypothesis to Publication: A Comprehensive Survey of AI-Driven
Research Support Systems"
The table shown below from this paper
that shows AI tools for research paper assistance is the most informative one of this type that I have seen in looking at many, many AI and ML research papers.
https://arxiv.org/abs/2503.01424
The authors of this paper have a wonderful bibliography on this topic at the Github repo:
https://github.com/zkzhou126/AI-for-Research
New in our #digital #collection:
Science of science : understanding the foundations and limits of science from an interdisciplinary perspective
https://doi.org/10.1093/9780198937401.001.0001
'Science of Science' provides an integrated framework for the #science of science as an emerging field, and a comprehensive understanding of the foundations and limits of science.
#TIL about The Unjournal and it checks sooo many boxes! https://unjournal.pubpub.org/
If you're interested in #metascience and understanding the implications of #AI for the #science and #research ecosystem, this looks like a great postdoctoral opportunity: https://sloan.org/programs/digital-technology/aipostdoc-rfp
Call for abstracts at #ICSSI2025! #CFP
Submit here: www.icssi.org/guidelines
Deadline: March 14th
On any topic relevant to #SciSci #Innovation #ScienceofScience #Metascience #STS
UKRI Metascience AI early career fellowships
https://www.ukri.org/opportunity/ukri-metascience-ai-early-career-fellowships/
Call Open today, closes 10 April 2025 4:00pm UK time
If you have the AI/ML skills and want to bolster the scale and impact of your research by plugging into the most exciting metascience team in the world, please get in touch with @RoRInstitute about us supporting your fellowship application
Do the #humanities need a replication drive? #MetaScience
https://retractionwatch.com/2019/02/13/do-the-humanities-need-a-replication-drive-a-debate-rages-on/ This rejoinder is from 2019. Did anything follow from this? Are replications in humanities a thing?
Retraction Watch · Do the humanities need a replication drive? A debate rages onSince last year, a half-dozen researchers have been having a debate: Should the humanities focus on replication? No, said Sarah de Rijcke and Bart Penders in Nature last August: “Resist calls…
#statstab #276 Experiment Design Checklist
by @tomstafford
Thoughts: Useful list for PhD students and ECRs to check they have most things covered.
#metascience #integrity #guide #research #resources #experiments
Experiment Design ChecklistExperiment Design ChecklistA checklist to help catch errors in designing and implementing psychology experiments
Unjournal: Public journal-independent evaluation of impactful research https://www.unjournal.org/
The Unjournal (unjournal.org) is a nonprofit that commissions (and pays) experts to publicly evaluate and rate publicly-hosted research. It prioritizes globally-impactful work in economics and quantitative social science. It doesn’t charge for anything and it’s all open-access: you can see the evaluation output at https://unjournal.pubpub.org/
The UnjournalThe Unjournal
Join us at #ICSSI2025 in Copenhagen!
Our website is now updated, the call for abstracts is online:
www.icssi.org
June 16-18, 2025
Copenhagen Business School, Copenhagen, DK
Stay tuned for keynote speaker announcements! #ScienceofScience #Metascience #STS
International Conference on th...
Bluesky SocialBluesky
Researchers planning to do #SystematicReviews must now plan to filter out the #JunkScience. That's difficult, time-consuming, error-prone, and demoralizing. It causes some researchers to drop their plans and forces others to move more slowly.
https://www.science.org/content/article/systematic-reviews-aim-extract-broad-conclusions-many-studies-are-peril
(#paywalled)
#Academia #LiteratureReviews #MetaResearch #MetaScience #ScholComm
@academicchatter
Continued thread
"Psychology has been operating for too long on the basis of implicit paradigms that are taken for granted and no longer considered explicitly, thereby relying on too many (meanwhile) hidden assumptions that urgently need reappraisal, critical reflection and even radical change and renewal"
Operationalization Bias: A Suboptimal Research Practice in Psychology
Nagireddy Reddy, PsyArXiv Preprint (2022)
"This article discusses a suboptimal research practice, the operationalization bias, i.e., the practice of operationalizing a construct or phenomenon selectively, through the exclusive employment of one or very few variables and, in turn, neglecting to employ alternative operationalizations."
osf.ioOSF
Replied in thread
In line with the previous talk, Anne Gast's team identified a causal effect of recruitment (commercial provider > university recruitment)!
To conclude this #MetaRep2024 symposium, Marie-Ann Sengewald ends with some recommendations on how to realise conceptual replications that control for systematic bias and enable causal interpretations.
I was not familiar with the Causal Replication Framework (Steiner et al. 2019): https://econtent.hogrefe.com/doi/full/10.1027/2151-2604/a000385
Replied in thread
Mathias Twardawski is talking about "Conceptual Replications to Understand Context Sensitivity". In designing a study to examine context sensitivity, Mathias warns that "variation is easy, consistency is hard."
Very interesting conclusion that recruitment method (students and interested people vs. paid participants on Prolific) was the only significant driver of heterogeneity in the study outcomes (though I was personally not surprised). #MetaScience #MetaRep2024 #AcademicChatter
Replied in thread
On my way to the #MetaRep2024 conference venue this morning, I found a sourdough bakery in Munich that will set you back 1,30€ for a single white breadroll, but it was totally worth it because I am now in an excellent mood and ready for a jam-packed day of insights into #MetaScience, #OpenScience, #reproducibility, #replication and more. Which talks should I attend today? https://meta-rep.de/conference24/programme/
Replied in thread
Last presentation of the day for me: "Data Simulation for Everyone: An Interactive Tool for Data Simulation using DAGs" by Finn Luebber. The shiny app is still under development, but feedback is welcome. #MetaRep2024 #MetaScience #Shiny
Replied in thread
High on cake and earl grey after the break #MetaRep2024 and enjoying Julia Schnepf’s talk on “Fundamental misalignments of current research in #psychology”. Julia shared her experience of obtaining null-results in her #PhD and getting rejection after rejection while attempting to publish her pre-registered studied. Julia finally managed to graduate, but was clearly a victim of the “null-results penalty”. Another exciting paper for my #MetaScience reading list: https://www.sciencedirect.com/science/article/pii/S0732118X24000382. 
Replied in thread
Rachel Heyard is now presenting the results of a scoping review of #reproducibility metrics: they found 50 (!) different metrics (but one comes from a paper that was then retracted). Should be available as a #preprint in the next few weeks! #MetaScience #MetaRep2024
EDIT: I had dinner with Rachel and it was 50 application papers (of which one has since been retracted) not metrics. Best to wait for the #preprint to come out to find out how many metrics exactly!
