"These are important questions because scientists are increasingly overwhelmed with the volume of new work posted on preprint servers and published in journals. As a result, traditional quality signals used for triaging papers, such as journal, conference venue, and institution, are becoming less reliable."
The diagnosis is right but the treat is dead wrong. Instead of silly scoring systems, please improve recommender systems for papers. In this space, also opt-in and query-based personalization would be okay.
show comments
emil-lp
To save people the bother:
An LLM read a paper and concluded it was a top 1% paper.
"These are important questions because scientists are increasingly overwhelmed with the volume of new work posted on preprint servers and published in journals. As a result, traditional quality signals used for triaging papers, such as journal, conference venue, and institution, are becoming less reliable."
The diagnosis is right but the treat is dead wrong. Instead of silly scoring systems, please improve recommender systems for papers. In this space, also opt-in and query-based personalization would be okay.
To save people the bother:
An LLM read a paper and concluded it was a top 1% paper.
Everyone involved were happy.