Papers by Matthew Riemer
Recursive Routing Networks: Learning to Compose Modules for Language Understanding (N19-1)
Copied to clipboard
Ignacio Cases, Clemens Rosenbaum, Matthew Riemer, Atticus Geiger, Tim Klinger, Alex Tamkin, Olivia Li, Sandhini Agarwal, Joshua D. Greene, Dan Jurafsky, Christopher Potts, Lauri Karttunen
| Challenge: | Recursive Routing Networks are modular, adaptable models that learn effectively in diverse environments. |
| Approach: | They propose to apply Recursive Routing Networks (RRNs) to natural language understanding by integrating them into existing architectures and recurrent network hidden layers. |
| Outcome: | The proposed model optimizes the parameters of the functions and the meta-learner decision-making component for routing inputs through those functions. |
Combining Domain and Alignment Vectors Provides Better Knowledge-Safety Trade-offs in LLMs (2025.acl-short)
Copied to clipboard
| Challenge: | Large language models (LLMs) excel in specific technical fields, but are not explicitly trained to be safe. |
| Approach: | They propose a model merging-based alignment method that allows for safer domain-specific models that preserve their utility. |
| Outcome: | The proposed method improves safety alignment on LLMs with minimal degradation on domain-specific benchmarks. |
EpMAN: Episodic Memory AttentioN for Generalizing to Longer Contexts (2025.acl-long)
Copied to clipboard
Subhajit Chaudhury, Payel Das, Sarathkrishna Swaminathan, Georgios Kollias, Elliot Nelson, Khushbu Pahwa, Tejaswini Pedapati, Igor Melnyk, Matthew Riemer
| Challenge: | Recent advances in Large Language Models (LLMs) have yielded impressive successes on many language tasks, but efficient processing of long contexts remains a significant challenge. |
| Approach: | They propose a method for processing long contexts in an episodic memory module while holistically attending to semantically-relevant context chunks. |
| Outcome: | The proposed method outperforms baseline decoders on multiple long-context recall and question-answering benchmarks on 16k to 256k tokens. |
A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models are pre-trained on trillions of tokens and instruction-tuned or aligned to specific preferences. |
| Approach: | They propose guidelines to help researchers perform more effective parameter-efficient LLM alignment. |
| Outcome: | The proposed methods outperform preference optimization and outperformed pre-trained models on three key axes. |
AI Steerability 360: A Toolkit for Steering Large Language Models (2026.acl-demo)
Copied to clipboard
Erik Miehling, Karthikeyan Natesan Ramamurthy, Praveen Venkateswaran, Ching-Yun Ko, Pierre Dognin, Moninder Singh, Tejaswini Pedapati, Avinash Balakrishnan, Matthew Riemer, Dennis Wei, Inge Vejsbjerg, Elizabeth M. Daly, Kush R. Varshney
| Challenge: | The AI Steerability 360 toolkit is an extensible, open-source Python library for steering LLMs. |
| Approach: | The AI Steerability 360 toolkit is an extensible, open-source Python library for steering LLMs. |
| Outcome: | The toolkit is available under an Apache 2.0 license and is available on https://github.com/IBM/AISteer360. |