Papers by Ling Zhang
Copied to clipboard
| Challenge: | Existing datasets often rely on synthetic data or figure-caption pairs, failing to capture the depth and complexity of geoscientific reasoning. |
| Approach: | They propose a multimodal scientific dataset and benchmark curated from open-access publications. |
| Outcome: | MSEarth features over 289K figures with captions enriched by contextual discussions and reasoning from original papers. |
Copied to clipboard
| Challenge: | Existing RS agents built on general-purpose LLMs are domain-agnostic, resulting in brittle and error-prone workflows. |
| Approach: | They propose a knowledge-enhanced memory evolution mechanism that bootstraps RS agents with pre-distilled domain knowledge and iteratively integrates online experience for robust multi-step tool execution. |
| Outcome: | Experiments show that the new model improves tool-use performance and accuracy . iteratively, iteration of the model integrates online experience for robust multi-step tool execution . |
Copied to clipboard
| Challenge: | Complex reasoning ability is one of the most important features of Large Language Models. |
| Approach: | They propose a new benchmark that measures the reasoning ability of Large Language Models . it contains 900 algorithmic questions belonging to the NP-Hard complexity class . |
| Outcome: | The proposed benchmark contains 900 questions belonging to the NP-Hard complexity class and is updated on a monthly basis. |
Copied to clipboard
| Challenge: | Current long-context large language models lack citations to support their responses, making verification difficult due to potential hallucinations. |
| Approach: | They propose to use off-the-shelf LLMs to automatically construct long-context QA instances with precise sentence-level citations and leverage this pipeline to construct a large-scale SFT dataset for LQAC. |
| Outcome: | The proposed pipeline can generate responses with fine-grained citations on the fly, surpassing existing models including GPT-4o. |
Copied to clipboard
| Challenge: | Modern software development demands code that is maintainable, testable, and scalable by organizing the implementation into modular components with iterative reuse of existing codes. |
| Approach: | They propose a benchmark to evaluate LLMs' ability to perform codeflow by reusing existing functions over multiple turns. |
| Outcome: | The proposed benchmarks show that LLMs perform significantly worse in multi-turn codeflow scenarios and that their performance inversely correlates with dependency complexity. |
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a fundamental task in Natural Language Processing (NLP) that aims to detect the entity spans of text and classify them into pre-defined set of entity types. |
| Approach: | They propose a boundary-aware contrastive learning strategy to enhance the LLM’s ability to perceive entity boundaries for generalized entity spans. |
| Outcome: | The proposed framework outperforms prior methods and validates its effectiveness across a range of LLM architectures. |
Copied to clipboard
| Challenge: | Reinforcement Learning (RL) based agents are promising for text-based games, but their generalization remains a challenge. |
| Approach: | They propose a hierarchical framework for reinforcement learning based on knowledge graphs . they propose to decompose the game into subtasks and execute a sub-policy in the low level to conduct goal-conditioned reinforcement learning. |
| Outcome: | The proposed framework enjoys favorable generalizability on a set of difficulty levels and is able to handle complex training tasks. |
Copied to clipboard
| Challenge: | Large language models (LLMs) exhibit hallucinations due to incorrect or outdated knowledge embedded in their parameters. |
| Approach: | They propose a framework to constrain the deviation of the parameter matrix during sequential editing by selecting editing anchors that are important in encoding new relations without deviating too much from the original matrix. |
| Outcome: | The proposed framework minimizes deviations caused by model editing while retaining over 70% of the general abilities. |
Copied to clipboard
| Challenge: | Empirical studies show that our approach outperforms the SOTA methods in improving the interpretability of text classification models. |
| Approach: | They propose an enhanced variational word masks approach that exploits the Variational Information Bottleneck to obtain task-specific words. |
| Outcome: | Empirical results show that the proposed method outperforms the SOTA methods in improving the interpretability of the model. |
Copied to clipboard
| Challenge: | Existing approaches to detect suicidal ideation on social media are limited to a small group of people. |
| Approach: | They propose to use tree holes to embed words into microblogs to strengthen the sensibility of suicide-related lexicons and to use a two-layered attention mechanism to grasp intermittently changing points from individual's open blog streams. |
| Outcome: | The proposed approach can achieve over 91% accuracy with the use of suicide-oriented word embeddings and attention on a large-scale well-labelled suicide data set. |
Copied to clipboard
| Challenge: | Spatial domain queries have unique properties making them more challenging for language understanding than common conversational queries. |
| Approach: | They propose a language understanding framework for spatial domain queries that jointly learns the intent detection and entity linking tasks on a voice assistant service. |
| Outcome: | The proposed framework outperforms baseline methods with a significant margin. |
Copied to clipboard
| Challenge: | Existing methods for achieving this alignment involve employing reinforcement learning from human feedback (RLHF) Existing approaches involve using RLHF to fine-tune LLMs based on human labels . however, RLRF is susceptible to instability during fine- tuning and presents challenges in implementation. |
| Approach: | They propose to use reinforcement learning from human feedback to fine-tune large language models with human preferences to achieve precise control of model behavior. |
| Outcome: | Experiments show that RAHF can be used to capture and manipulate representations to align with a broad spectrum of human preferences or values rather than being confined to a single concept or function. |
Copied to clipboard
| Challenge: | Recent advances in large reasoning models have demonstrated remarkable capabilities in tackling complex tasks. |
| Approach: | They propose an algorithm to teach reasoning models to choose the optimal thinking mode based on problem difficulty. |
| Outcome: | The proposed algorithm reduces the average response length and improves accuracy on three math datasets. |
Copied to clipboard
| Challenge: | a rapid development of Chinese large language models poses big challenges for efficient LLM evaluation. |
| Approach: | They propose an evaluation testbed that benchmarks Chinese LLMs across capability, alignment and safety. |
| Outcome: | The evaluation platform OpenEval benchmarks Chinese LLMs across capability, alignment and safety. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown potential in reasoning over structured environments, e.g., knowledge graphs and tables. |
| Approach: | They propose a framework that allows LLMs to efficiently and faithfully reason over structured environments. |
| Outcome: | The proposed framework surpasses state-of-the-art fine-tuned methods on three KGQA and two TableQA datasets and surpasse CWQ and WTQ methods. |
Copied to clipboard
| Challenge: | a new study examines the potential of retrieval-augmented generation (RAG) with foundation models to enhance expert-level reasoning. |
| Approach: | They introduce PhoPile, a high-quality multimodal dataset specifically designed for Olympiad-level physics. |
| Outcome: | The proposed model can be used to solve Olympiad-level physics problems. |
Copied to clipboard
| Challenge: | Program induction (PI) is a promising paradigm for using knowledge bases (KBs) to help large language models answer complex knowledge-intensive questions. |
| Approach: | They propose a plug-and-play framework that enables large language models to induce programs over any low-resourced KB. |
| Outcome: | Experiments show that KB-Plugin outperforms SoTA low-resourced PI methods with 25x smaller backbone LLM on large-scale and domain-specific KBs and even approaches the performance of supervised methods. |
Copied to clipboard
| Challenge: | Existing models for false information detection on social networks are too harsh for actual social networks that contain both seen and unseen topics simultaneously. |
| Approach: | They propose an open-topic scenario that assumes that all test data topics are seen or unseen by the model, but which is too harsh for actual social networks that contain both seen and unseened topics simultaneously. |
| Outcome: | The proposed model improves on two benchmark datasets and a variety of graph neural networks on two social networks and shows that it is more accurate than existing models. |
Copied to clipboard
| Challenge: | Efficient resume parsing is critical for global hiring, yet the lack of dedicated benchmarks for evaluating large language models (LLMs) on multilingual, structure-rich resumes hinders progress. |
| Approach: | They propose to use a human-in-the-loop pipeline to generate 2,500 synthetic resumes spanning 50 templates, 30 career fields, and 5 languages to evaluate large language models. |
| Outcome: | The proposed benchmarks show that the models perform poorly on multilingual resumes and lack of standardized templates. |
Copied to clipboard
| Challenge: | Recent work on scene generation focuses on generating 3D scenes from textual descriptions . however, the task of generating industrial scenes with LLMs is complex and requires precise measurements and positioning . |
| Approach: | They propose an LLM-based agent for generating industrial scenes through C# code. |
| Outcome: | Experiments show that LLMs powered by SceneGenAgent exceed their original performance . the agent achieves 81.0% success rate in real-world industrial scene generation tasks . |
Copied to clipboard
| Challenge: | Large language models (LLMs) are impressive in solving tasks, but they can quickly be outdated after deployment. |
| Approach: | They provide a review of recent advances in aligning deployed large language models with the ever-changing world knowledge. |
| Outcome: | The proposed models can be used to perform various tasks directly through in-context learning or for further fine-tuning for domain-specific uses. |
Copied to clipboard
| Challenge: | In recent years, significant advancements have been achieved in the development of long-context large language models (LLMs). |
| Approach: | They propose a method that utilizes an off-the-shelf LLM to provide rewards for long-context model responses from four human-valued dimensions: helpfulness, logicality, faithfulness, and completeness. |
| Outcome: | The proposed method improves models’ long-context performance and enhances their ability to follow short instructions. |
Copied to clipboard
| Challenge: | Efficient data selection is crucial to accelerate the pretraining of language models . limited research has addressed the inherent conflicts between data selection methods . |
| Approach: | They propose a multi-actor collaborative data selection mechanism that prioritizes data based on its specific criterion and updates prioritization rules using the current state of the model. |
| Outcome: | The proposed model accelerates convergence in LM pretraining and achieves an average relative performance gain of 10.5% across multiple language model benchmarks. |
Copied to clipboard
| Challenge: | Existing methods for assessing retrieval of relevant information are understudied . previous studies have neglected to evaluate ARAG methods . |
| Approach: | They propose a benchmark to evaluate existing ARAG methods that use threshold tuning to adjust retrieval for queries instead of indiscriminate retrieval. |
| Outcome: | The proposed method can be used to evaluate existing ARAG methods without calibration or training. |
Copied to clipboard
| Challenge: | Existing models for response selection do not perform well when there are many candidate responses. |
| Approach: | They propose a Spatio-Temporal Matching network (STM) for response selection . they use soft alignment to obtain local relevance between context and response . |
| Outcome: | The proposed model significantly outperforms the state-of-the-art model on two large-scale multi-turn response selection tasks. |
Copied to clipboard
| Challenge: | Existing evaluation metrics for radiology report generation focus on lexical overlap and entity matching. |
| Approach: | They propose a benchmark to evaluate the fine-grained factual consistency of CT reports . they use a question-answering process to query a machine-generated report . |
| Outcome: | The proposed benchmark evaluates the fine-grained factual consistency of CT reports . it correlates better with expert clinical assessment and is more sensitive to errors . |
Copied to clipboard
| Challenge: | Existing methods for generating static slides or text summaries are limited to producing narrated presentations. |
| Approach: | They propose a multimodal agent that transforms long-form documents into narrated presentations. |
| Outcome: | The present agent produces fully synchronized visual and spoken content that closely mimics human-style presentations. |
Copied to clipboard
| Challenge: | Large language models suffer from multiple-file coding scenarios with strong inter-file dependencies . experimental results show that large language models exhibit inadequate performance in multi-file scenarios . |
| Approach: | They propose a retrieval-augmented reasoning framework for repository-level code repair . they use a dataset to generate standardized patches based on the key snippets . |
| Outcome: | The proposed framework improves retrieval accuracy and repair success on SWE-bench Lite . it surpasses models with larger size in managing extensive code contexts and fixing bugs spanning across multiple files. |
Copied to clipboard
| Challenge: | Phonetic Cloaking Replacement (PCR) is a problem in content moderation in China. |
| Approach: | They organize PCR into a four-way surface-form taxonomy and compile PCR-ToxiCN, a dataset of 500 phonetically cloaked offensive posts gathered from the RedNote platform. |
| Outcome: | The proposed model achieves only an F1-score and zero-shot chain-of-thought prompting pushes performance even lower. |
Copied to clipboard
| Challenge: | Using large language models as chatbots can cause hallucinations and lack of empathy, authors report . a dimension-agnostic scoring method is proposed to improve the performance of chatbot performance . |
| Approach: | They propose a dimension-agnostic scoring method that leverages in-context learning . they propose to automatically generate prompts and then request the LLM multiple times . |
| Outcome: | The proposed method outperforms baselines on five datasets. |
Copied to clipboard
| Challenge: | Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages. |
| Approach: | They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English. |
| Outcome: | The proposed model outperforms open-source and Tibetan-focused models on diverse tasks. |
Copied to clipboard
| Challenge: | Experimental results show that our method significantly improves ELECTRA’s average performance by 2.8% and 3.2% absolute points respectively on GLUE and SQuAD 2.0 benchmarks. |
| Approach: | They propose a multi-perspective course learning method to fetch many degrees and visual angles for sample-efficient pre-training and to fully leverage the relationship between generator and discriminator. |
| Outcome: | The proposed method improves ELECTRA's performance on GLUE and SQuAD 2.0 benchmarks and overshadows recent advanced ELECL-style models under the same settings. |
Copied to clipboard
| Challenge: | Current methods for evaluating LLMs’ veracity are limited by the need for extensive human labor, test data contamination, or limited scope, hindering efficient and effective exposure of errors. |
| Approach: | They propose a framework that extracts fact triplets to generate diverse question types using rule-based natural language processing techniques. |
| Outcome: | The proposed framework can trigger factual errors in up to 55% of questions in large LLMs while maintaining coverage of questions. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are hindered by their memory inefficiency, computational demands, and the high costs of API inferences. |
| Approach: | They propose an Explanation-Guided LLMs Active Distillation framework that employs an active learning strategy to optimize the balance between annotation costs and model performance. |
| Outcome: | The proposed framework significantly improves the efficiency of LLMs knowledge distillation. |
Copied to clipboard
| Challenge: | a new framework for speaker generation is proposed to enable multimodal speaker generation . multimodal cues such as visual appearance, textual descriptions, and other biometric signals are still in its early stages. |
| Approach: | a new framework is proposed to enable multimodal speaker generation . the framework uses self-distillation to apply speaker disentanglement to speech generation a model is developed . |
| Outcome: | The proposed framework is the first to support unified voice generation from arbitrary modality combinations. |
Copied to clipboard
| Challenge: | Text-based games provide an interactive way to study natural language processing. |
| Approach: | They propose a two-phase training framework to decouple language learning from reinforcement learning and improve the sample efficiency. |
| Outcome: | The proposed method significantly improves performance and sample efficiency against compound error and limited pre-training data. |
Copied to clipboard
| Challenge: | Recent work incorporates pre-trained word embeddings into Neural Topic Models (NTMs), generating highly coherent topics. |
| Approach: | They conduct thorough experiments to investigate whether embeddings directly with an appropriate word selection method can generate more coherent and diverse topics than NTMs. |
| Outcome: | The proposed model generates more coherent and diverse topics than traditional NTMs, achieving higher efficiency and simplicity. |
Copied to clipboard
| Challenge: | MLLMs that use domain-specific data are limited in understanding cultural heritage artifacts such as ancient Greek pottery . supervised fine-tuning improves adaptation to domain knowledge, but it struggles with deeper reasoning tasks. |
| Approach: | They propose a visual question-answer tool that augments SFT with reinforcement learning using verifiable rewards. |
| Outcome: | The proposed model outperforms baseline models on reasoning-intensive questions on ancient Greek pottery. |
Copied to clipboard
| Challenge: | a new study examines the safety implications of large language models in diplomatic positions . it identifies potential risks and ideological biases that could arise from LLMs . |
| Approach: | They propose an LLM-based multi-agent system for diplomatic position analysis . they propose ethical constraint measures to enhance the safety of LLMs . |
| Outcome: | The proposed system assesses the safety implications of large language models in diplomacy . it reveals that LLMs could exhibit a strong bias towards interests, leading to unsafe decisions . |
Copied to clipboard
| Challenge: | Existing RL methods rely on unstructured self-sampling to fit scalar rewards, resulting in inefficient rollouts. |
| Approach: | They propose a structured template-guided RL framework that augments policy optimization with explicit template guidance. |
| Outcome: | Experiments show that TemplateRL outperforms GRPO and GRPI by 99% on AIME and 41% on AMC with superior stability on weak models and remarkable cross-domain generalization. |
Copied to clipboard
| Challenge: | Psychological defenses are strategies people use to manage distress. |
| Approach: | They propose a dialogue corpus with help seeker utterances labeled for defense level and a DMRS Co-Pilot pipeline that provides evidence-based pre-annotations. |
| Outcome: | The proposed framework reduces annotation time by 24.0% in a counterbalanced study. |
Copied to clipboard
| Challenge: | Existing vision-and-language pretraining methods face challenges in reconstructing pathological features due to limited data. |
| Approach: | They propose a method that uses masked modeling to enhance visual and linguistic learning. |
| Outcome: | MMCLIP integrates unpaired data through disease-kind prompts to achieve state-of-the-art performance in zero-shot and fine-tuning across five benchmarks. |
Copied to clipboard
| Challenge: | In-context learning (ICL) struggles with complex reasoning due to superficial, example-level implicit imitation. |
| Approach: | They propose an automated method that shifts from surface-level examples to more guidance-oriented thought patterns. |
| Outcome: | The proposed method achieves 80.6% accuracy on MATH and 62.5% on AMC, surpassing GPT-4o’s 77.2% and 57.5% accuracy. |
Copied to clipboard
| Challenge: | Existing evaluation models for instruction-following have many shortcomings, such as substantial costs and unreliable assessments. |
| Approach: | They propose an LLM critic for fine-grained instruction-following evaluation using a checklist generator and a constraint-level preference optimization method. |
| Outcome: | The proposed model beats strong LLM-as-a-Judge baselines in evaluations under lower computational overhead compared to baselines. |
Copied to clipboard
| Challenge: | Existing benchmarks for instruction-following lack data coverage and oversimplified pairwise evaluation paradigms that misalign with model optimization scenarios. |
| Approach: | They propose a meta-evaluation benchmark for instruction-following that covers diverse instruction and constraint types and a preference graph for each instruction. |
| Outcome: | Extensive experiments on IF-RewardBench show that the proposed benchmark achieves a stronger positive correlation with downstream task performance compared to existing benchmarks. |
Copied to clipboard
| Challenge: | Existing methods for instruction tuning do not leverage the rich natural language instructions. |
| Approach: | They propose to use a benchmark to study how instruction tuning works in CL tasks. |
| Outcome: | The proposed method can achieve similar or better results than existing CL methods. |
Copied to clipboard
| Challenge: | Existing household robots are inability to recognize potential problems or dangers in home environments. |
| Approach: | They propose a task of creating anomaly scenarios using generative models instead of manually labeled data to build simulated environments. |
| Outcome: | The proposed framework outperforms existing models in terms of task description and scene diversity. |
Copied to clipboard
| Challenge: | Current approaches to commonsense reasoning are limited due to limited answer scope. |
| Approach: | They propose to solve a commonsense question without a pre-defined answer scope . they leverage pre-trained language models to iteratively retrieve reasoning paths on the external knowledge base . |
| Outcome: | The proposed method achieves better performance on two commonsense benchmark datasets. |
Copied to clipboard
| Challenge: | Naive Retrieval-Augmented Generation (RAG) focuses on individual documents during retrieval and is not suitable for networked documents. |
| Approach: | They propose a novel divide-and-conquer strategy that retrieves optimal subgraph structure in linear time. |
| Outcome: | The proposed approach outperforms current state-of-the-art methods on graph reasoning benchmarks. |
Copied to clipboard
| Challenge: | Existing legal benchmarks evaluate isolated tasks or exam-style questions, failing to capture the procedural interdependencies and adjudicative rigor inherent in professional practice. |
| Approach: | They propose a vertical, depth-oriented, domain-specific benchmark to evaluate Large Language Models (LLMs) in Chinese civil litigation. |
| Outcome: | The proposed benchmarks show that large language models exhibit an "illusion of competence" the results highlight a critical gap between fluent linguistic output and judicial reliability . |
Copied to clipboard
| Challenge: | OpenAI's GPT-4 has demonstrated remarkable multimodal capabilities, but specific mechanics of GPT4 remain unknown. |
| Approach: | They propose a data collection methodology that synchronously synthesizes images and dialogues for visual instruction tuning. |
| Outcome: | The proposed method improves on ten commonly assessed models and provides greater flexibility compared to existing methods. |
Copied to clipboard
| Challenge: | Existing methods for knowledge infusion face knowledge mismatch and poor information compliance of LLMs with knowledge graphs. |
| Approach: | They propose a three-stage alignment strategy to enhance the LLM's capability to utilize information from knowledge graphs. |
| Outcome: | The proposed method outperforms baselines on biomedical question-answering datasets and outperformed existing methods. |
Copied to clipboard
| Challenge: | Parameter Efficient Fine-Tuning (PEFT) has gained significant attention for its ability to achieve competitive results while updating only a small subset of trainable parameters. |
| Approach: | They propose a new approach to fine-tuning neural models that scales and biases the representation produced at each layer. |
| Outcome: | The proposed approach reduces the number of trainable parameters by a factor of 25,700 compared to full parameter fine-tuning and by . 32 compared with LoRA. |
Copied to clipboard
| Challenge: | Long-horizon tasks that require sustained reasoning and multiple tool interactions remain challenging for LLM agents. |
| Approach: | They propose a framework that separates tactical execution, strategic oversight, and context organization into three specialized components. |
| Outcome: | The proposed framework improves accuracy by 20% relative to baselines on GAIA, BrowseComp, and Humanity’s Last Exam tasks. |
Copied to clipboard
| Challenge: | Existing studies on in-context learning have focused on quantifying the uncertainty associated with the model's response, but they neglect the complexity of the LLM and the uniqueness of in-constitut learning. |
| Approach: | They propose a method to quantify the uncertainty associated with in-context learning and propose corresponding estimation method to quantify both types of uncertainties. |
| Outcome: | The proposed method offers an unsupervised way to understand the prediction of in-context learning in a plug-and-play fashion. |
Copied to clipboard
| Challenge: | Existing benchmarks that rely on final-answer accuracy fail to capture the quality of the reasoning process. |
| Approach: | They propose a fine-grained evaluation framework that assesses logical reasoning across three dimensions: overall accuracy, stepwise soundness, and representation-level probing. |
| Outcome: | The proposed framework assesses logical reasoning across three dimensions: overall accuracy, stepwise soundness, and representation-level probing. |
Copied to clipboard
| Challenge: | Existing methods to explore semantics of knowledge graphs have been proposed to explore these semantics in distinct ways. |
| Approach: | They propose to leverage existing methods in relation-aware manner to learn an ensemble by leveraging existing methods. |
| Outcome: | The proposed method has the same computation cost as general ensemble methods but with much better performance on benchmark datasets. |
Copied to clipboard
| Challenge: | Knowledge graph question answering (KGQA) aims to answer natural language questions using knowledge graphs. |
| Approach: | They propose a framework that retrieves refined reasoning paths and evaluates their sufficiency. |
| Outcome: | The proposed framework outperforms existing baselines while enabling small open-source LLMs to achieve competitive results without fine-tuning LLM. |
Copied to clipboard
| Challenge: | Existing models for text-to-speech (TTS) synthesize speech with acoustic features . autoregressive models have problems with word skipping and repeated reading . non-autoregressive acustic models lack probabilistic modeling and unimodal characteristics of Gaussian distribution don't conform to true distribution of aural features, which restricts the diversity of generated prosodic features. |
| Approach: | They propose a multi-speaker acoustic model that hierarchically models speech prosodic features and controls different prosodic styles to guide prosody prediction. |
| Outcome: | The proposed method outperforms baseline models in naturalness and achieves superior synthesis speed compared to baseline models. |
Copied to clipboard
| Challenge: | Existing approaches to obtain high-quality instruction-following data rely heavily on existing documents and existing methods. |
| Approach: | They propose a data synthesis framework, DecIF, which automatically generates accurate and diverse instruction-following data from scratch for supervised fine-tuning and reinforcement learning. |
| Outcome: | Extensive experiments show that the proposed framework can synthesize accurate instruction-following data for both SFT and RL paradigms compared to baselines. |
Copied to clipboard
| Challenge: | Existing methods for reinforcement learning (RL) rely on binary outcome rewards that fail to capture the comprehensiveness and factuality of agents’ reasoning process. |
| Approach: | They propose a reward framework that emphasizes reasoning comprehensiveness, factual grounding, and evidence connectivity. |
| Outcome: | The proposed framework outperforms standard outcome-based RL baselines across multiple deep search benchmarks and shows that it discourages shortcut exploitation and promotes comprehensive, evidence-grounded reasoning. |
Copied to clipboard
| Challenge: | Medical data and tasks require extensive preprocessing and standardization for effective use in training LLMs. |
| Approach: | They propose to use MedINST as a meta-dataset to evaluate LLMs' generalization ability. |
| Outcome: | The meta-dataset of biomedical instruction measures the generalization ability of LLMs across multiple open-domain tasks. |
Copied to clipboard
| Challenge: | Existing approaches to annotate dialogues require supervised training, which requires human workers to manually annotates dialogues. |
| Approach: | They propose a turn-level active learning framework to actively select dialogue turns to annotate . their approach can achieve comparable performance to traditional training approaches . |
| Outcome: | The proposed model achieves comparable performance to existing training approaches with significantly less annotated data. |
Copied to clipboard
| Challenge: | Existing annotation tools lack support for Large Language Models (LLMs) or use LLMs as one-off preannotation engines, compromising data reliability. |
| Approach: | They propose a text annotation platform that embeds LLM-assisted labeling into a quality-aware collaborative workflow. |
| Outcome: | Experiments show that BNLP reduces annotation time by 74.3% and improves annotation quality by 11.6% over purely manual annotation in LLM-assisted settings. |
Copied to clipboard
| Challenge: | Existing federated learning frameworks require substantial data and computational resources to develop large language models. |
| Approach: | They propose a method that distributes a quantized version of the model’s parameters during training and combine it with a popular fine-tuning method to significantly reduce communication costs. |
| Outcome: | The proposed method enables accurate estimations for parameter updates while preventing clients from accessing a model whose performance is comparable to the centrally hosted one. |
Copied to clipboard
| Challenge: | Large Language Models excel at generalized reasoning, but lack the ability to accumulate experiences and maintain narrative coherence over long horizons. |
| Approach: | They propose a unified memory architecture that transcends static vector similarity. |
| Outcome: | The proposed model outperforms state-of-the-art methods in temporal and multihop reasoning tasks. |
Copied to clipboard
| Challenge: | Existing methods lack the capability for continuous learning and self-evolution from interactions, limiting the diversity and adaptability of attack strategies. |
| Approach: | They propose an automated framework capable of discovering, retrieving, and evolving attack strategies. |
| Outcome: | The proposed framework outperforms existing baselines in a black-box setting. |