Exploring Hybrid Sampling Inference for Aspect-based Sentiment Analysis (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for inference require multiple sampling with preset size . however, it is a high-cost method that requires multiple sampling . |
| Approach: | They propose a method that combines multiple and single sampling to greatly reduce the cost of multiple sampling without sacrificing performance. |
| Outcome: | The proposed method greatly reduces the cost of multiple sampling without sacrificing performance. |
Similar Papers
From Annotation to Adaptation: Metrics, Synthetic Data, and Aspect Extraction for Aspect-Based Sentiment Analysis with Large Language Models (2025.naacl-srw)
Copied to clipboard
| Challenge: | Using a synthetic sports feedback dataset, we evaluate open-weight LLMs’ ability to extract aspect-polarity pairs. |
| Approach: | They propose a metric to facilitate the evaluation of aspect extraction with generative models. |
| Outcome: | The proposed metric improves the performance of open-weight LLMs in the Aspect-Based Sentiment Analysis task. |
When Life Gives You Samples: The Benefits of Scaling up Inference Compute for Multilingual LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large language models have shifted focus toward scaling inference-time compute. |
| Approach: | They propose to scale inference-time compute in a multilingual, multi-task setting . they propose to use m-ArenaHard-v2.0 prompts to sample multiple outputs in parallel . |
| Outcome: | The proposed solutions achieve an average +6.8 jump in win-rates for 8B models on m-ArenaHard-v2.0 prompts in non-English languages against proprietary models like Gemini. |
Self-Para-Consistency: Improving Reasoning Tasks at Low Cost for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have shown that self-consistency decoding can improve performance for complex reasoning tasks with large language models. |
| Approach: | They propose a self-consistency decoding strategy that generates multiple paraphrases for each test question and then generates reasoning paths for the original and all the paraphrased questions based on greedy decoding. |
| Outcome: | The proposed strategy reduces the sampling number and improves performance on complex reasoning tasks. |
Speculative Decoding for Multi-Sample Inference (2025.findings-emnlp)
Copied to clipboard
Yiwei Li, Jiayi Shi, Shaoxiong Feng, Peiwen Yuan, Xinglin Wang, Yueqi Zhang, Ji Zhang, Chuyi Tan, Boyuan Pan, Yao Hu, Kan Li
| Challenge: | Speculative decoding method exploits consensus of parallel reasoning paths to synthesize high-quality draft tokens without auxiliary models or external databases. |
| Approach: | They propose a speculative decoding method that exploits the consensus of parallel reasoning paths to synthesize high-quality draft tokens without auxiliary models or external databases. |
| Outcome: | The proposed method exploits the intrinsic consensus of parallel reasoning paths to synthesize high-quality draft tokens without auxiliary models or databases. |
A Hybrid Approach to Aspect Based Sentiment Analysis Using Transfer Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Aspect-Based Sentiment Analysis (ABSA) aims to identify terms or multiword expressions (MWEs) on which sentiments are expressed and the sentiment polarities associated with them. |
| Approach: | They propose a hybrid approach to Aspect-Based Sentiment Analysis using transfer learning . they exploit the strengths of large language models and traditional syntactic dependencies . |
| Outcome: | The proposed method exploits the strengths of large language models and traditional syntactic dependencies. |
Efficient Hybrid Generation Framework for Aspect-Based Sentiment Analysis (2023.eacl-main)
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis (ABSA) has attracted broad commercial attention due to its commercial value. |
| Approach: | They propose a framework that generates location and semantic information in parallel and a global hybrid loss function in combination with bipartite matching to achieve end-to-end model training. |
| Outcome: | The proposed framework outperforms state-of-the-art methods in almost all cases and outperfies existing methods in terms of inference efficiency. |
EMS-SD: Efficient Multi-sample Speculative Decoding for Accelerating Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Speculative decoding is a key technique for enhancing the inference speed of Large Language Models. |
| Approach: | They propose a method that adds padding tokens to ensure that the number of new tokens remains consistent across samples. |
| Outcome: | The proposed method can handle the issue of inconsistent prediction tokens without adding padding tokens. |
A Challenge Dataset and Effective Models for Aspect-Based Sentiment Analysis (D19-1)
Copied to clipboard
| Challenge: | Existing ABSA methods only use one aspect or multiple aspects with the same sentiment polarity . recent studies show that neural network methods can be trained end-to-end and automatically learn important features. |
| Approach: | They propose a large-scale multi-aspect multi-sentiment dataset with two different aspects with different sentiment polarities. |
| Outcome: | The proposed model outperforms the state-of-the-art models on the large-scale dataset . it is based on a novel neural network approach that can be trained end-to-end . |
Improving Consistency in LLM Inference using Probabilistic Tokenization (2025.findings-naacl)
Copied to clipboard
| Challenge: | Prior work has shown that probabilistic tokenizations can generate multiple tokenization of the same input string. |
| Approach: | They propose a method to leverage the multiple tokenization capabilities of modern LLM tokenizers. |
| Outcome: | The proposed method improves the self-consistency of large language models by generating multiple tokenizations. |
LACA: Improving Cross-lingual Aspect-Based Sentiment Analysis with LLM Data Augmentation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual aspect-based sentiment analysis depend on translation tools. |
| Approach: | They propose a cross-lingual aspect-based sentiment analysis framework that leverages a large language model to generate pseudo-labelled data in target language. |
| Outcome: | The proposed approach outperforms translation-based approaches in six languages and five backbone models. |