Topics, Authors, and Institutions in Large Language Model Research: Trends from 17K arXiv Papers (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in language modeling have caused disruptive shifts throughout AI research, spurring discussion about how the field is changing and how it should change. |
| Approach: | They analyze a dataset of 16,979 LLM-related arXiv papers and examine industry and academic publishing trends. |
| Outcome: | The authors examine the impact of large language models on AI research in 2023 and 2022. |
Similar Papers
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are impressive in solving tasks, but they can quickly be outdated after deployment. |
| Approach: | They provide a review of recent advances in aligning deployed large language models with the ever-changing world knowledge. |
| Outcome: | The proposed models can be used to perform various tasks directly through in-context learning or for further fine-tuning for domain-specific uses. |
Awes, Laws, and Flaws From Today’s LLM Research (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are a powerful technology that can follow instructions and output coherent, persuasive text. |
| Approach: | They examine the scientific methodology behind large language model (LLM) research and cross-validate it with arguments at the centre of controversy. |
| Outcome: | The authors cross-validate 2,000 research works released between 2020 and 2024 based on criteria typical of what is considered good research and find that conference checklists are effective at curtailing some of these issues, but balancing velocity and rigour in research cannot solely rely on these. |
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) (2026.acl-short)
Copied to clipboard
| Challenge: | ACL is 30+ times larger than two decades ago, and we face issues such as overwhelming participants, outdated papers, and low quality review. |
| Approach: | aaron carroll: ACL has become 30+ times larger than two decades ago . he says increasing research in LLM, AI accelerating research can help . carroll will share some of his recent work on AI review automation, paper recommendation, and AI arXiv . |
| Outcome: | aaron e. muller: ACL has become 30+ times larger than two decades ago . he says recent work on AI review automation, paper recommendation, and arXiv is promising . |
Large Language Models in Bioinformatics: A Survey (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are revolutionizing bioinformatics, enabling advanced analysis of DNA, RNA, proteins, and single-cell data. |
| Approach: | They examine the evolution of Large Language Models (LLMs) in bioinformatics and precision medicine by focusing on genomic sequence modeling, RNA structure prediction, protein function inference, and single-cell transcriptomics. |
| Outcome: | The proposed models are capable of predicting RNA structure and function and predicting single-cell transcriptomics. |
code-transformed: The Influence of Large Language Models on Code (2026.findings-eacl)
Copied to clipboard
| Challenge: | Using Large Language Models, code generation capabilities have transformed programming practices. |
| Approach: | They analyze 20,000 GitHub repositories linked to arXiv papers published between 2020 and 2025 . they identify measurable trends in the evolution of coding style that align with LLM-generated code . |
| Outcome: | The proposed study examines 20,000 GitHub repositories linked to arXiv papers . it finds that LLMs influence code style, and that they can be observed in real-world code . |
Can Large Language Models Unlock Novel Scientific Research Ideas? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) and ChatGPT have marked a turning point in the integration of Artificial Intelligence (AI) into people’s everyday lives. |
| Approach: | They conduct a human evaluation of the novelty, relevancy, and feasibility of the generated future research ideas. |
| Outcome: | The proposed models generate more diverse ideas than GPT-4, GPT-3.5, and Gemini 1.0. |
From Automation to Autonomy: A Survey on Large Language Models in Scientific Discovery (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are catalyzing a paradigm shift in scientific discovery, evolving from task-specific automation tools into increasingly autonomous agents. |
| Approach: | They introduce a foundational three-level taxonomy to delineate their escalating autonomy and evolving responsibilities within the research lifecycle. |
| Outcome: | The proposed frameworks provide a conceptual architecture and strategic foresight to navigate and shape the future of AI-driven scientific discovery. |
The Impact of Large Language Models in Academia: from Writing to Speaking (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are impacting human society, especially in textual information. |
| Approach: | They propose to build an automated monitoring platform to track the impact of large language models on human expression. |
| Outcome: | The results show that LLM-style words such as significant are used more frequently in abstracts and oral presentations. |
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing surveys on scientific LLMs focus on one or two fields or a single modality. |
| Approach: | They survey 260 scientific LLMs and examine their architectures and pre-training techniques . they also discuss commonalities and differences between LLM architectures . |
| Outcome: | The proposed model architectures and evaluation techniques are used to improve scientific discovery. |
Future of Work in the Age of LLMs (2026.acl-tutorials)
Copied to clipboard
| Challenge: | a tutorial examines the future of work shaped by the interplay of large language models and humans . a series of tutorials examines challenges, opportunities, and ethical considerations in this dynamic landscape . |
| Approach: | This tutorial examines the future of work shaped by the interplay of LLMs and humans . it examines how LLM-based systems can augment human labor and enhance real-world tasks . |
| Outcome: | This tutorial examines the future of work shaped by the interplay of LLMs and humans . it examines challenges, opportunities, and ethical considerations in this dynamic landscape . |