Is Peer-Reviewing Worth the Effort? (2025.coling-main)

Copied to clipboard

Challenge: Using early returns and venue, we can predict which papers will be highly cited in the future.
Approach: They ask whether early returns are predictive of papers' citations .
Outcome: The authors show early returns are more predictive than venue . early returns also predicts which papers will be highly cited in the future .

Similar Papers

What Factors Should Paper-Reviewer Assignments Rely On? Community Perspectives on Issues and Ideals in Conference Peer-Review (2022.naacl-main)

Copied to clipboard

Challenge: a survey of the NLP community shows that paper-reviewer matching is a problem . authors lose valuable time and opportunities by writing reviews that are arbitrarily low .
Approach: They propose to use paper-reviewer matching to improve peer review . they identify common issues and perspectives on what factors should be considered .
Outcome: The proposed method improves the quality of peer review and improves interpretable peer review assignments.
What Can We Do to Improve Peer Review in NLP? (2020.findings-emnlp)

Copied to clipboard

Challenge: Traditionally, peer review is expected to act as a filter for high-quality, impactful work, but this does not hold in practice.
Approach: They argue that peer review is becoming increasingly spurious and that it is a problem for NLP . they propose a reproducibility checklist at EMNLP 2020 that could be used to ensure that papers are reproducible.
Outcome: The reproducibility checklist at EMNLP 2020 is the first step in that direction.
Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Industry Papers (2021.naacl-industry)

Copied to clipboard

Challenge: , . ; : () () . .
Approach: cnn.com/industrietrack/reviewers.html#reviews.html #reviewer_list.html .
Outcome: The Industry Track would not be possible without the reviewers .
Can AI Be a Good Peer Reviewer? A Survey of Peer Review Process, Evaluation, and the Future (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) motivated methods that assist or automate different stages of peer review pipeline.
Approach: They synthesize techniques to enhance peer review generation and after-review tasks aligned to reviews.
Outcome: The proposed methods improve the peer review process by fine-tuning strategies, agent-based systems, and emerging paradigms.
Retrieval of the Best Counterargument without Prior Topic Knowledge (P18-1)

Copied to clipboard

Challenge: ad-hominem attacks are the most common form of argumentation in real life .
Approach: They hypothesize that the best counterargument invokes the same aspects as the argument while having the opposite stance.
Outcome: The proposed model is independent from the topic at hand, i.e., it applies to arbitrary arguments.
Findings of the Association for Computational Linguistics: EMNLP 2021 (2021.findings-emnlp)

Copied to clipboard

Challenge: . - (EN)
Approach: . - (EN)
Outcome: . - (EN)
Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 (2021.findings-acl)

Copied to clipboard

Challenge: . - (EN)
Approach: . - (EN)
Outcome: . - (EN)
Findings of the Association for Computational Linguistics: EMNLP 2025 (2025.findings-emnlp)

Copied to clipboard

Challenge: null
Approach: null
Outcome: null
Findings of the Association for Computational Linguistics: EMNLP 2020 (2020.findings-emnlp)

Copied to clipboard

Challenge: . - (EN)
Approach: . - (EN)
Outcome: . - (EN)
Does My Rebuttal Matter? Insights from a Major NLP Conference (N19-1)

Copied to clipboard

Challenge: Peer review is a core element of the scientific process, but few studies have evaluated its properties empirically.
Approach: They propose to use peer review to assess the effectiveness of rebuttal phase in NLP conferences.
Outcome: The proposed task predicts after-rebuttal scores from initial reviews and author responses.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations