Papers by Li Nguyen
Copied to clipboard
| Challenge: | Prior research on evaluating large language models focused on answer accuracy, neglecting the correctness of the generated CoT. |
| Approach: | They propose a discriminative and generative CoT evaluation paradigm to assess LLMs’ knowledge of reasoning and the accuracy of the generated CoT. |
| Outcome: | The proposed evaluation paradigm assesses LLMs’ knowledge of reasoning and the accuracy of the generated CoT. |
Copied to clipboard
| Challenge: | Existing grammar error correction systems have been trained on monolingual data and not developed for CSW text. |
| Approach: | They propose a method of generating synthetic CSW GEC datasets by translating different spans of text within existing GEC corpora and investigate different methods of selecting these spans based on CSW ratio, switch-point factor and linguistic constraints. |
| Outcome: | The proposed model achieves an average increase of 1.57 F0.5 across 3 CSW test sets (English-Chinese, English-Korean and English-Japanese) without affecting the model’s performance on a monolingual dataset. |
Copied to clipboard
| Challenge: | Existing graph autoencoders and its variants have been used for node embedding . a new method is proposed to model consistency across different views of networks . |
| Approach: | They propose a network embedding method which enforces latent representations to be consistent across different views of networks by incorporating a multiview adversarial regularization module. |
| Outcome: | The proposed method compares favorably with the state-of-the-art methods on benchmark datasets and on a real-world application. |
Copied to clipboard
| Challenge: | Semantic role labeling (SRL) is a shallow semantic parsing task that identifies "who did what to whom when, where etc." SRL is useful in a wide range of downstream NLP tasks and real-world applications. |
| Approach: | They propose a method to generate shallow semantic parsing tasks using monolingual SRL and multilingual parallel data. |
| Outcome: | The proposed method improves the quality of the generated propbanks. |
Copied to clipboard
| Challenge: | Existing models for attribute value extraction struggle for parameter efficiency and reliability due to data contamination and catastrophic forgetting. |
| Approach: | They propose to decouple product type and attribute to promote de-contamination and parameter efficiency while scaling up. |
| Outcome: | The proposed model achieves state-of-the-art performance with affordable parameter size, least historical knowledge forgetting, and greatest robustness against noises. |
Copied to clipboard
| Challenge: | Language identification (LID) is a fundamental step in curating multilingual corpora. |
| Approach: | They introduce CommonLID, a community-driven, human-annotated LID benchmark for the web domain, covering 109 languages. |
| Outcome: | The proposed benchmark covers 109 languages and shows that existing evaluations overestimate accuracy for many languages in the web domain. |
Copied to clipboard
| Challenge: | Using monolingual tools, code-switching is a problem in the natural language processing community. |
| Approach: | They introduce the Canberra Vietnamese-English Code-switching corpus (CanVEC) which is an original corpus of mixed speech annotated with language information, part of speech tags and Vietnamese translations. |
| Outcome: | The proposed corpus was annotated with language information, part of speech tags and Vietnamese translations using pipelining and monolingual toolkits. |
Copied to clipboard
| Challenge: | Documents contain various structures that hinder the ability of machines to comprehend . user information needs are often underspecified, and the nature of heterogeneous documents poses challenges. |
| Approach: | They propose a dataset for building machines that help users seek information via conversations . their dataset contains over 100,000 turns based on Chinese documents from five domains . |
| Outcome: | The proposed tasks are challenging and worthy of further research. |
Copied to clipboard
| Challenge: | Existing benchmarks for meme understanding only concern narrow aspects of meme semantics. |
| Approach: | They propose to use multiple-choice questions to evaluate meme comprehension . they use a dataset of over 9,000 multiple-question questions to assess meme comprehension. |
| Outcome: | The proposed model outperforms existing models on meme comprehension . the model makes many errors on memes where proper understanding requires going beyond sentiment . |
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have sparked growing interest in building fully autonomous agents. |
| Approach: | They propose to integrate human-provided information, feedback, or control into the agent system to enhance system performance, reliability, and safety. |
| Outcome: | The proposed systems improve system performance, reliability, and safety by integrating human-provided information, feedback, or control into the agent system. |
Copied to clipboard
| Challenge: | Existing methods to improve ICL performance are limited by the length of the input context. |
| Approach: | They propose a method that utilizes all demonstration examples without exceeding the manageable context length. |
| Outcome: | The proposed method can be scaled up to integrate with existing methods. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have been used for selection and training of data for active learning. |
| Approach: | They propose an intuitive taxonomy that categorizes LLM-based active learning techniques and discuss the transformative roles they can play in the active learning loop. |
| Outcome: | The proposed model can generate entirely new data instances and provide more cost-effective annotations with fewer labeled data instances. |
Copied to clipboard
| Challenge: | Existing video-language understanding systems with human-like senses can mimic both our linguistic medium and visual environment with temporal dynamics. |
| Approach: | They propose to develop video-language understanding systems with human-like senses . they summarize their methods and highlight challenges associated with them . |
| Outcome: | The proposed models perform well in a variety of tasks and domains. |
Copied to clipboard
| Challenge: | Existing studies suggest key phrase selection is essential for question generation, yet it is difficult to connect disjointed phrases into meaningful questions, especially for long context. |
| Approach: | They propose a QG framework that uses multi-level content planning to generate questions from a given context and an answer. |
| Outcome: | The proposed framework outperforms baselines on two popular QG datasets. |
Copied to clipboard
| Challenge: | Existing evaluations of Large Language Models for clinical numerical reasoning provide limited operation-level coverage and limited robustness of numerical understanding across clinical note formats. |
| Approach: | They propose a benchmarking tool that evaluates four main types of clinical numeracy . they present longitudinal MIMIC-IV vital-sign records in three semantically equivalent representations . |
| Outcome: | The proposed benchmark evaluates four main types of clinical numeracy: value retrieval, arithmetic computation, relational comparison, and aggregation. |
Copied to clipboard
| Challenge: | a framework to evaluate low-latency speech translations is currently only limited to specific aspects and is not able to compare different approaches. |
| Approach: | They propose a framework to perform and evaluate low-latency speech translation in realistic conditions. |
| Outcome: | The proposed framework evaluates various aspects of low-latency speech translation under realistic conditions. |
Copied to clipboard
| Challenge: | Complex news events require swift responses from government and society, authors say . relying on historical events to project the future is insufficient, they say - a simulator for complex news events is needed . |
| Approach: | They propose a controllable complex news event simulator guided by event schema and user-provided assumptions . they incorporate a geo-diverse commonsense and cultural norm-aware knowledge enhancement component . |
| Outcome: | The proposed simulator achieves higher coherence and appropriateness than existing models. |
Copied to clipboard
| Challenge: | Existing supervised fine-tuning datasets are composed of general instructions without userspecified constraints. |
| Approach: | They propose a data augmentation method incorporating multiple constraints into the original data samples according to predefined rules to create new training tasks. |
| Outcome: | The proposed method improves LLM controllability while maintaining general instruction-following capabilities. |
Copied to clipboard
| Challenge: | Existing medical report generation efforts focus on producing human-readable reports, yet the generated text may not be well aligned to the clinical facts. |
| Approach: | They propose to automate the generation of medical reports from chest X-ray image inputs . medical reports are the primary medium, which physicians communicate findings from scans - authors say . |
| Outcome: | The proposed method achieves fluency and clinical accuracy on common metrics. |
Copied to clipboard
| Challenge: | Existing IE tools for atomic events are limited when applied to such complex events. |
| Approach: | They propose to use event schemas to guide the organization of complex events and to edit hierarchical graphs. |
| Outcome: | The proposed tool outperforms existing IE visualization tools in both IE result analysis and general model improvements. |
Copied to clipboard
| Challenge: | Identifying human morals and values embedded in language is essential to empirical studies of communication. |
| Approach: | They propose a framework for generalizable classification of human morals and values . they recommend a classification strategy that scores all related concepts simultaneously . |
| Outcome: | The proposed method outperforms fine-tuned models across domains and frameworks. |
Copied to clipboard
| Challenge: | Existing general purpose components for learning differentiable windows are hard to optimize. |
| Approach: | They propose a new neural module and general purpose component for dynamic window selection that can enable more focused attentions over the input regions. |
| Outcome: | The proposed approach improves on a myriad of NLP tasks including machine translation, sentiment analysis, subject-verb agreement and language modeling. |
Copied to clipboard
| Challenge: | Recent advances in GUI agents have limited app-specific knowledge of complex mobile tasks. |
| Approach: | They propose a Knowledge Graph-driven Retrieval-Augmented Generation framework that transforms fragmented UTGs into structured vector databases for efficient real-time retrieval. |
| Outcome: | The proposed framework outperforms existing methods in a 75.8% success rate and 84.6% decision accuracy test across mobile apps. |
Copied to clipboard
| Challenge: | Southeast Asia is underrepresented in vision-language research . SEA-VL is an open-source initiative dedicated to developing culturally relevant datasets for SEA languages. |
| Approach: | They propose to use crowdsourced, automated image crawling and synthetic image generation to develop culturally relevant datasets for SEA languages. |
| Outcome: | The proposed datasets capture SEA cultural nuances and contexts better than existing datasets. |
Copied to clipboard
| Challenge: | Current methods map whole volumes to reports, ignoring the clinical workflow of analyzing localized Regions of Interest (RoIs) Current models exhibit suboptimal accuracy and are prone to significant hallucinations. |
| Approach: | They propose a framework that mimics the professional radiologist diagnostic workflow by employing graph-based relational modules to capture dependencies between RoI attributes. |
| Outcome: | The proposed framework surpasses existing models by 19.7% in BLEU and 4.7% in ROUGE-L while achieving a 45.8% improvement in clinical metrics. |
Copied to clipboard
| Challenge: | Retrieval-augmented generation improves Large Language Models (LLMs) by integrating external information into the response generation process. |
| Approach: | They investigate the impact of memory strength and evidence presentation on LLMs’ receptiveness to external evidence by measuring the divergence in LLM responses to different paraphrases of the same question. |
| Outcome: | The proposed method improves Large Language Models (LLMs) by integrating external information into the response generation process. |
Copied to clipboard
| Challenge: | Fig. 1 shows a document level discourse parser that performs top-down end-to-end parsing without requiring segmentation . |
| Approach: | They propose a top-down end-to-end formulation of document level discourse parsing in the Rhetorical Structure Theory framework. |
| Outcome: | The proposed model outperforms existing methods in end-to-end parsing and parse with gold segmentation without handcrafted features. |
Copied to clipboard
| Challenge: | Large Reasoning Models suffer from high inference latency due to autoregressive reasoning . SpecReason adopts a polling-based design that repeatedly invokes the LRM for verification at every step . |
| Approach: | They propose a trigger-based collaborative reasoning framework that delegates most reasoning to the SRM and activates LRM intervention only when necessary. |
| Outcome: | The proposed framework reduces latency and API cost by 73.3% under edge–cloud conditions. |
Copied to clipboard
| Challenge: | Existing question generation systems focus on the internal knowledge within the textual passage or the semantic word space for diverse content planning. Existing solutions focus on relying on the knowledge of the text and the semantic words, but have not considered the potential of external knowledge for expression diversity. |
| Approach: | They propose a framework for Retrieval-Augmented Style Transfer that utilizes the style of diverse templates for question generation. |
| Outcome: | The proposed framework outperforms baselines on diversity while being comparable in terms of consistency scores. |
Copied to clipboard
| Challenge: | Existing large language models (LLMs) are trained on bytes, except for tokenization, which groups bytes into a static set of tokens. |
| Approach: | They propose a new byte-level LLM architecture that encodes bytes into dynamically sized patches, which serve as the primary units of computation. |
| Outcome: | The proposed architecture matches tokenization-based models with improvements in inference efficiency and robustness. |
Copied to clipboard
| Challenge: | et al., 2023) proposes a method to improve instruction-tuning data . e.g., we generate synthetic instructions using the backtranslation approach . |
| Approach: | They propose a method to improve instruction-tuning data using web-based inputs . they generate synthetic instructions using the backtranslation approach and filter the generated data . |
| Outcome: | The proposed method improves the quality of instruction-tuning data based on preprocessed texts . it yields better AlpacaEval win rates than direct distillation . |
Copied to clipboard
| Challenge: | Existing UMR methods can be broadly divided into two categories: early-fusion approaches, such as Marvel, which projects visual features into the language model space for integrating with text modality, and late-fusion methods, such UniVL-DR, which encode visual and textual inputs using separate encoders and obtain fused embeddings through addition. |
| Approach: | They propose to map different modalities into a shared embedding space for multi-modal retrieval. |
| Outcome: | Experiments on the WebQA+ and EVQA+ datasets show that MiMIC outperforms both early- and late-fusion approaches. |
Copied to clipboard
| Challenge: | Specifically, we compare the performance of three MT systems in terms of their ability to translate monolingual Vietnamese, a low-resource language, and Vietnamese-English CSW respectively. |
| Approach: | They compare the performance of three machine translation systems in the context of machine translation (MT) they find that state-of-the-art neural translation systems achieve higher scores on automatic metrics when processing CSW input . |
| Outcome: | The proposed system can translate monolingual Vietnamese, a low-resource language, and Vietnamese-English CSW respectively. |
Copied to clipboard
| Challenge: | Large language models are promising for mental health, but their alignment with core counseling competencies remains underexplored. |
| Approach: | They propose a benchmark to evaluate 22 general-purpose and medical-finetuned LLMs across five key competencies. |
| Outcome: | The proposed model outperforms generalist models in Intake, Assessment & Diagnosis but struggles with core counseling attributes and professional practice & ethics. |
Copied to clipboard
| Challenge: | Existing large language models favor high-resource languages, such as English, at the expense of low-resourced and regional languages. |
| Approach: | They propose a series of language models that specifically focuses on Southeast Asian languages. |
| Outcome: | SeaLLM models outperform ChatGPT-3.5 in non-Latin languages by large margins . linguistic disparity impedes access to state-of-the-art AI technologies for non-English-speaking populations . |
Copied to clipboard
| Challenge: | Recent advances in the reasoning capabilities of large language models have enabled them to tackle complex tasks such as mathematics reasoning. |
| Approach: | They propose a method that modulates attention temperature dynamically to shift LLM's internal focus during reasoning, enabling a dynamic shift between exploratory and focused modes. |
| Outcome: | The proposed method improves Pass@10 by 6.78–14.20% and aggregation accuracy by 9.74% across 7 reasoning benchmarks. |
Copied to clipboard
| Challenge: | We build a dialogue system that can respond based on a given character setting (persona) this method is not suitable because the more persona information is added, the longer the input text becomes. |
| Approach: | They propose to use prompt-tuning to build a dialogue system that responds based on a persona . they conduct automatic and manual evaluations on English and Japanese . |
| Outcome: | The proposed method can build a dialogue system with more natural responses with less computational resources than fine-tuning. |
Copied to clipboard
| Challenge: | Developing efficient and effective parsing solutions has always been a key focus in NLP. |
| Approach: | They propose a generic seq2seq parsing framework that casts constituency parsers into a series of conditional splitting decisions. |
| Outcome: | The proposed framework outperforms state-of-the-art (SoTA) methods in discourse parsing . it is based on a syntactic and discourse parsed model and is linear in number of nodes . |
Copied to clipboard
| Challenge: | Large Foundation Models (LFMs) have transformed the landscape of AI research and day-to-day life. |
| Approach: | They propose a framework that delineates GUI agents' perception, reasoning, planning, and acting capabilities. |
| Outcome: | The proposed framework delineates their perception, reasoning, planning, and acting capabilities. |
Copied to clipboard
| Challenge: | Prior work creates evaluations with crowdwork or existing data sources, which are not always available. |
| Approach: | They generate evaluations automatically with language models (LMs) using crowdwork or existing data sources to find out how they behave . |
| Outcome: | The results show that large LMs repeat back a dialog user’s preferred answer and express greater desire to pursue concerning goals like resource acquisition and goal preservation. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown impressive performance in code understanding and generation. |
| Approach: | They propose a systematic review of large language models and their taxonomy and propose specialized LLMs for code-related tasks. |
| Outcome: | The proposed models have shown to be highly effective in coding tasks. |
Copied to clipboard
| Challenge: | Constituency parsing is a core task in natural language processing (NLP) Existing methods for constituency paring are greedy transition-based or globally optimized. |
| Approach: | They propose a constituency parsing model that casts the problem into a series of pointing tasks. |
| Outcome: | The proposed model achieves 92.78 F1 without pre-trained models, which is faster than existing models. |
Copied to clipboard
| Challenge: | Recent studies suggest that fixing the routers can achieve competitive performance by alleviating the collapsing problem, where all experts eventually learn similar representations. |
| Approach: | They propose a method that dynamically generates router parameters through a fixed hypernetwork and trainable embeddings to achieve a balance between training the routers and freezing them to learn an improved routing policy. |
| Outcome: | Experiments on a wide range of tasks show that the proposed method performs better than existing methods. |