Overcoming the Long Tail Problem: A Case Study on CO2-Footprint Estimation of Recipes using Information Retrieval (L18-1)
Copied to clipboard
| Challenge: | a particular challenge is the "long tail problem" that arises with the large diversity of possible ingredients. |
| Approach: | They propose methods that use information retrieval methods for automatic calculation of CO2-footprints of cooking recipes. |
| Outcome: | The proposed methods are generalizable to other use cases where a numerical value has to be calculated based on a list of textual elements. |
Similar Papers
Semantic-aware transformation of short texts using word embeddings: An application in the Food Computing domain (2021.eacl-srw)
Copied to clipboard
| Challenge: | Recent work in food computing focus on generating new recipes from scratch . however, there are a large number of new recipes generated daily with user reviews . |
| Approach: | They propose to use word embedding models to capture the semantic meaning of recipe ingredients and use them to enrich their data. |
| Outcome: | The proposed engine will use food data to modify a recipe to fit user preferences. |
In Search of the Long-Tail: Systematic Generation of Long-Tail Inferential Knowledge via Logical Rule Guided Search (2024.emnlp-main)
Copied to clipboard
Huihan Li, Yuting Ning, Zeyi Liao, Siyuan Wang, Xiang Li, Ximing Lu, Wenting Zhao, Faeze Brahman, Yejin Choi, Xiang Ren
| Challenge: | Logic-Induced-Knowledge-Search (LINK) is a framework for generating factually-correct yet long-tail inferential knowledge. |
| Approach: | They introduce a framework to obtain factually-correct yet long-tail inferential statements using variable-wise prompting grounded on symbolic rules. |
| Outcome: | The proposed framework is able to obtain factually-correct yet long-tail inferential statements while ensuring factual correctness. |
LongAlign: A Recipe for Long Context Alignment of Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies to build long context language models focus on context extension and continual training on long text. |
| Approach: | They propose a recipe for instruction fine-tuning on input sequences of similar length . they adopt packing and sorted batching strategies to speed up supervised fine-uning . |
| Outcome: | The proposed model outperforms existing recipes for LLMs in long context tasks by 30% while maintaining proficiency in handling short, generic tasks. |
Systematic Study of Long Tail Phenomena in Entity Linking (C18-1)
Copied to clipboard
| Challenge: | Existing systems for entity linking are based on frequent 'head' cases, while performance drops when moving towards rare 'long tail' entities. |
| Approach: | They propose to use a long tail to investigate the properties of entity linking datasets. |
| Outcome: | The proposed systems overfit to popular/frequent and non-ambiguous cases and find the most difficult cases among the infrequent candidates of ambiguous forms. |
Approximating Two-Layer Feedforward Networks for Efficient Transformers (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work uses sparse Mixtures of Experts (MoEs) to build resource-efficient large language models. |
| Approach: | They propose a general framework that unifies various methods to build two-layer NNs . they propose methods to improve both MoEs and PKMs based on their results . |
| Outcome: | The proposed framework improves both MoEs and product-key memories (PKMs) it shows that MoE's are competitive with dense Transformer-XL on two different scales while being much more resource efficient. |
Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in efficient attention mechanisms have led to the expansion of the context length of large language models. |
| Approach: | They propose a procedure to synthesize Haystacks of documents and generate a summary that identifies relevant insights and precisely cites the source documents. |
| Outcome: | The proposed evaluation can score summaries on Coverage and Citation . the proposed evaluation lags human performance estimates by 10+ points on SummHay . |
TAIL: A Toolkit for Automatic and Realistic Long-Context Large Language Model Evaluation (2024.emnlp-demo)
Copied to clipboard
| Challenge: | Existing evaluation methods for long-context large language models are overly simplistic and require extensive human annotations. |
| Approach: | They propose an automatic toolkit to create realistic evaluation benchmarks . they use a document-grounded benchmark to generate question-answer pairs . |
| Outcome: | The proposed toolkit provides a way to create realistic evaluation benchmarks and visualize performance metrics of evaluated models. |
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: Industry Track (2022.emnlp-industry)
Copied to clipboard
| Challenge: | . - (EN) |
| Approach: | . - (EN) |
| Outcome: | . - (EN) |
Culinary Crossroads: A RAG Framework for Enhancing Diversity in Cross-Cultural Recipe Adaptation (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is a promising approach for cross-cultural recipe adaptation, but it fails to generate diverse results even when provided with varied contextual inputs. |
| Approach: | They propose a plug-and-play RAG framework that enhances diversity in both retrieval and context organization to generate diverse outputs to accommodate multiple user preferences. |
| Outcome: | The proposed framework achieves Pareto efficiency in terms of diversity and quality of recipe adaptation compared to closed-book LLMs. |
Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs (2025.findings-acl)
Copied to clipboard
Runchu Tian, Yanghao Li, Yuepeng Fu, Siyang Deng, Qinyu Luo, Cheng Qian, Shuo Wang, Xin Cong, Zhong Zhang, Yesai Wu, Yankai Lin, Huadong Wang, Xiaojiang Liu
| Challenge: | Positional biases in large language models hinder their ability to process long inputs. |
| Approach: | They propose a benchmark to assess positional bias in large language models involving multiple pieces of relevant information. |
| Outcome: | The proposed benchmark assesses the performance of long-context language models by examining their models with different input lengths and tasks. |