Recent searches
Search options
Administered by:
of oslo.town #icssi
I didn't manage to take slides of @mollymking's ICSSI talk as I was backlogged with slides from other lightning talks, but I liked her talk on 'mesearch' - research on yourself. Molly has done mesearch, so this was meta-mesearch. The finding that some demographics get a citation boost for certain kinds of mesearch, but others don't, was intriguing.
"Elite" peer review was studied by Daniel Larremore and colleagues using an anonymised dataset from AAAS of 112,000 papers submitted to Science and Science Advances. A few more desk rejects for women authors, but no difference in peer review. Clear preference for work from prestigious institutions: biased or just better? Big teams also do better.
#ICSSI #ScienceofScience #PeerReview #ScienceMagazine #ScienceAdvances #DanielLarremore #AAAS
How do different values affect peer review and how do these influence editorial decisions, asks Daniel Scott Smith? Very different reviews can make decisions uncertain.
Across STEM, they find accuracy and novelty are the most important values in peer review reports, social factors (biases) have little effect, and dissensus increases editorial gatekeeping. It doesn't matter if reviewers disagree.
Breakaway and Zombie journals: what happens after mass editorial board resignations. @KyleSiler looks into what happens when a journal and its community separate.
Glossa vs Lingua & QSS vs Journal of Informetrics. Lingua suffered, JoI didn't - but both 'Zombies' published more Chinese studies whereas the European and North American researchers moved to the OA breakaways.
Juan Mateos-Garcia of Google DeepMind wants equitable use of their tools like AlphaFold. They solved protein structure prediction in 2020 and this is helpful for drug discovery, but researchers in LMIC have barriers to adoption.
Used OpenAlex & PDB to study 20.6K papers citing AlphaFold. LMIC researchers are underrepresented, but study of diseases affecting LMICs is overrepresented - esp. work on natural products.
Corporate research is dominating AI science, says Nur Ahmed, but they're not engaging with responsible AI research. They're choosing speed over safety.
They used supervised machine learning on 6 million papers and found few firms were working on responsible AI. A handful attended responsible AI conferences vs hundreds at other AI conferences.
When they do engage, it's on explainability not societal impacts and human rights.
Sai Koneru says rapid growth of the literature makes it hard to keep up with relevant work. Can LLMs discern the hypotheses reported in abstracts? No - currently it's tough for natural language models to do this.
"Let's *delve* into this topic..."
Science of AI-mediated science - Shahan Ali Memon gave a very engaging talk on how AI is being used in science, how it changes how we do and think about science, and how these AI tools are different to those we've used before.
He was too modest to advise a representative of the UK government in the audience on how much of his metascience budget should pivot to AI.
Elle O'Brien at UMich says there are barriers to data science in academia. Does generative AI break this down?
Many researchers are using LLMs for tips on using software even when good documentation exists. They're not software literate.
They wrongly think chatbots do web search, can code, have databases, can calculate, and give faithful explanations. Does that make their use more risky?
The real reason I attend conferences is the swag. Here's a box of sprinkle-covered Oreos I received as thanks for being a panel speaker at ICSSI (icssi.org).
I really enjoyed speaking on the ICSSI conference panel (icssi.org) on junk, fraud, retractions, and paper mills; we got lots of great questions and could have kept going all morning! Thanks to Daniel Larremore for the invite and especially Daniel Acuna for organising and chairing.
Here's slides for my plenary talk "Imagining the space of knowledge" at #ICSSI
A study of "beauty bias" in scientific careers presented at #ICSSI made me uneasy. Scraping faces from Google Scholar, business school websites, and job applicants and using machine learning to rate attractiveness without their consent seems disrespectful, esp. as the names of the "beautiful" institutions (which correlates with school ranking) are released. A small business school might not appreciate being labelled as ugly!
#ScienceofScience #Attractiveness #CareerProgression #ScienceCareers
There's a class gap in career progression in US academia, find Anna Stansbury and Kyra Rodriguez of MIT. #ICSSI #ScienceofScience #ClassDisparities #ClassDivide
Here's an ICSSI talk close to my interests: @sjcporter of @digitalscience explains how to find networks of faking by authorship selling schemes.
They're sold on Telegram and Facebook etc. Shout out to @nickwizzo who keeps track of these adverts and the final published papers.
How does industry shape academic science? Hongyuan Xia used a natural experiment to compare scientists in places that narrowly miss getting big industrial plants (like Amazon) built vs those that get them. Used citation of patents by the companies to define relevant fields.
Industry presence increases impact, number of papers in the field, and commercialisation. Why? Funding, collaboration, and researchers shifting focus.
China's rising leadership in global science: Christopher Esposito and UCLA colleagues studied leadership using author contribution statements. Extracted items were clumped using K-means clustering. They then trained a neural net to predict leadership among international collaborations in a large sample of papers.
In US-China collaborations, comparing 2010-12 vs 2020-23 shows a drop in US leaders and a rise in Chinese leaders.
"Helicopter science" and datasets: Sarah Bratt and colleagues studied the use of Global South (GS) data by Global North researchers (in 3200 Scientific Data papers) , using OpenAlex and an LLM, ReFinEd, to identify entities in Geonames.
The % of GS authors on GS data papers has risen, but on papers using GS data only 35% have a GS researcher as 1st or last author.
p.s. Saying "ding" instead of "next slide" was new to me!