Papers by Alexandros Papangelis

7 papers
Semi-Supervised Reward Modeling via Iterative Self-Training (2024.findings-emnlp)

Copied to clipboard

Challenge: Reward models capture values and preferences of humans and are used in Reinforcement Learning with Human Feedback (RLHF) Traditionally, training large language models relies on extensive human-annotated preference data, which poses significant challenges in terms of scalability and cost.
Approach: They propose a method that enhances RM training using unlabeled data.
Outcome: The proposed approach improves reward models without incurring additional labeling costs on unlabeled datasets.
What is wrong with you?: Leveraging User Sentiment for Automatic Dialog Evaluation (2022.findings-acl)

Copied to clipboard

Challenge: Existing metrics for dialog evaluation are trained on human annotations, which is cumbersome to collect.
Approach: They propose to use user sentiment and other information as proxy to measure the quality of previous dialogs.
Outcome: The proposed model is comparable to models trained on human annotated data.
FANTAstic SEquences and Where to Find Them: Faithful and Efficient API Call Generation through State-tracked Constrained Decoding and Reranking (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing supervised and in-context learning approaches suffer from high training costs, poor data efficiency, and generated API calls that can be unfaithful to the API documentation and the user’s request.
Approach: They propose an output-side optimization approach that uses state-tracked constrained decoding and a lightweight model as the discriminator to rerank the beam-searched candidate generations of the large language model.
Outcome: The proposed approach outperforms existing supervised and in-context learning approaches in the DSTC8 and API Bank datasets in terms of call generation accuracy, inference efficiency, and context efficiency.
Controllable Text Generation with Focused Variation (2020.findings-emnlp)

Copied to clipboard

Challenge: Focused-Variation Network (FVN) is a new model to control language generation.
Approach: They propose a model that learns discrete latent spaces for each attribute inside codebooks and uses them to generate fluent text.
Outcome: The proposed model can generate fluent and mostly coherent text on two text generation datasets with annotated content and style, and show state-of-the-art performance as assessed by automatic and human evaluations.
PLACES: Prompting Language Models for Social Conversation Synthesis (2023.findings-eacl)

Copied to clipboard

Challenge: Currently, collecting high quality conversational data is expensive and infeasible for many applications . a promising direction is to generate synthetic dialogues by prompting large language models .
Approach: They propose to use expert-written conversations as in-context examples to generate synthetic dialogues by prompting large language models.
Outcome: The proposed approach is generalizable to multi-party conversations, compared to human-collected conversations.
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code (2022.emnlp-demos)

Copied to clipboard

Challenge: Evaluations in machine learning rarely use the latest metrics, datasets, or human evaluation in favor of remaining compatible with prior work.
Approach: They propose to use the Generation, Evaluation, and Metrics Benchmark to integrate new evaluation methods into existing evaluations.
Outcome: The proposed evaluation infrastructure bridges the gap between the advantages of leaderboards and in-depth and evolving evaluations by allowing model developers to benefit from each other's work.
Selective In-Context Data Augmentation for Intent Detection using Pointwise V-Information (2023.eacl-main)

Copied to clipboard

Challenge: Intent detection is a fundamental element in task-oriented dialogue systems, usually occurring within the Natural Language Understanding component.
Approach: They propose an in-context data augmentation approach that fine-tunes a pre-trained language model and synthesizes new datapoints that correspond to given intents.
Outcome: The proposed method produces training data that achieves state-of-the-art on three challenging intent detection datasets and performs on par with the state- of-the art in full-shot settings.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations