Papers by Yun Xiong

9 papers
Encoding Spreadsheets for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Spreadsheets are characterized by their extensive two-dimensional grids, flexible layouts, and varied formatting options, which pose significant challenges for large language models (LLMs).
Approach: They propose a structural-anchor-based compression, inverse index translation, and data-format-aware aggregation module to compress spreadsheets effectively.
Outcome: The proposed method outperforms the existing model in GPT4 and achieves a state-of-the-art 78.9% F1 score.
Multi-Granularity Semantic Revision for Large Language Model Distillation (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for generating large language models rely on student-generated outputs, which introduce generation errors and misguide the distillation process.
Approach: They propose a multi-granularity semantic revision method for LLM distillation that corrects errors using teacher-generated tokens and re-generates the sequence to minimize errors.
Outcome: The proposed method reduces errors and misguides distillation on student models and improves consistency between teacher and student outputs.
KeFVP: Knowledge-enhanced Financial Volatility Prediction (2023.findings-emnlp)

Copied to clipboard

Challenge: Current studies ignore the role of financial metrics knowledge in earnings calls and little consideration is given to integrating text and price information.
Approach: They propose to integrate financial metrics knowledge into text comprehension by knowledge-enhanced adaptive pre-training and effectively incorporating text and price information by introducing a conditional time series prediction module.
Outcome: The proposed method outperforms state-of-the-art methods on three real-world datasets and is effective and reliable.
Composition-based Heterogeneous Graph Multi-channel Attention Network for Multi-aspect Multi-sentiment Classification (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for Aspect-based sentiment analysis (ABSA) focus on aspect terms with the same sentiment polarity . current methods focus on sentences with only one aspect term or multiple aspect terms .
Approach: They propose a novel method to model inter-aspect relationships and aspect-context relationships simultaneously using a heterogeneous graph.
Outcome: The proposed method can predict sentiments towards the given aspect term in a sentence . it can provide more detailed predictions compared with sentence-level sentiment analysis.
Adaptive Structure Induction for Aspect-based Sentiment Analysis with Spectral Perspective (2023.findings-emnlp)

Copied to clipboard

Challenge: incorporating structure information can enhance the performance of aspect-based sentiment analysis.
Approach: They propose to use pre-trained language models to induct latent structures from a spectrum perspective.
Outcome: The proposed model shortens Aspects-sentiment Distance and improves structure induction ability.
Linking Adaptive Structure Induction and Neuron Filtering: A Spectral Perspective for Aspect-based Sentiment Analysis (2024.lrec-main)

Copied to clipboard

Challenge: incorporating structure information can improve the performance of aspect-based sentiment analysis.
Approach: They propose a method to conduct neuron-level manipulations on word representations in the frequency domain.
Outcome: The proposed method can achieve or come close to state-of-the-art in ABSA.
StyleBART: Decorate Pretrained Model with Style Adapters for Unsupervised Stylistic Headline Generation (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on unsupervised headline generation focus on a standard dataset and mono-style corpora.
Approach: They propose an unsupervised approach for stylistic headline generation using a pretrained BART model decorated with adapters responsible for different styles.
Outcome: The proposed method separates the task of style learning and headline generation, allowing for the generation of diverse headlines with diverse styles.
AdvancedIF: Rubric-Based Benchmarking and Reinforcement Learning for Advancing LLM Instruction Following (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have shown impressive performance on a range of tasks, yet advanced instruction following (IF) remains a significant challenge.
Approach: They propose a benchmark that features over 1,600 prompts and expert-curated rubrics that assess LLMs’ ability to follow complex, multi-turn, and system-level instructions.
Outcome: The proposed framework improves instruction-following abilities of large language models, achieving a 6.7% gain on AdvancedIF and strong results on public benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations