| Challenge: | Existing methods for fine-grained corpus analysis are limited to small subsets and require manual labeling and statistical tools like topic modeling. |
| Approach: | They propose a pipeline that inductively generates labels from analysis data and then hierarchically clusters them to surface emergent themes. |
| Outcome: | The proposed pipeline validates the approach across three datasets and shows it is robust through automated and human evaluations. |
Similar Papers
Text Annotation via Inductive Coding: Comparing Human Experts to LLMs in Qualitative Data Analysis (2025.findings-naacl)
Copied to clipboard
| Challenge: | Qualitative data analysis (QDA) is an important research method across fields such as marketing, media studies, social science, psychology, medical research, and others. |
| Approach: | They evaluate the performance of open-source LLMs by comparing them to human experts. |
| Outcome: | The proposed method is based on inductive coding using large language models. |
Measuring What Matters: Evaluating Ensemble LLMs with Label Refinement in Inductive Coding (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are prone to inconsistencies and individual biases, limiting their reliability. |
| Approach: | They propose a framework that combines ensemble methods with code refinement methodology to address these challenges. |
| Outcome: | The proposed framework outperforms large language models and LLMs with a low-rank averaging and a moderator-based mechanism to simulate human consensus. |
Towards Better Hierarchical Text Classification with Data Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to improve hierarchical text classification are expensive and lack high-quality labeled data. |
| Approach: | They propose a hierarchical text classification framework that can achieve both label controllability and text diversity by extracting high-quality hierarchic label information. |
| Outcome: | The proposed method can achieve label controllability and text diversity by extracting high-quality hierarchical label information. |
A Computational Method for Measuring Open Codes in Qualitative Analysis (2026.findings-acl)
Copied to clipboard
John Chen, Alexandros Nikolaos Lotsos, Sihan Cheng, Lexie Zhao, Yanjia Zhang, Jessica Hullman, Bruce Sherin, Uri Wilensky, Michael Horn
| Challenge: | Qualitative analysis is widely adopted across many social science disciplines. |
| Approach: | They propose a theory-informed computational method for measuring inductive coding results from humans and GAI. |
| Outcome: | The proposed method captures breadth, consensus, unique contribution, and systematic deviation without assuming ground truth. |
HiGen: Hierarchy-Aware Sequence Generation for Hierarchical Text Classification (2024.eacl-long)
Copied to clipboard
| Challenge: | Hierarchical text classification is a complex subtask under multi-label text classification . the relevance of document sections can vary based on the hierarchy level, necessitating a dynamic document representation. |
| Approach: | They propose a text-generation-based framework that uses language models to encode dynamic text representations. |
| Outcome: | The proposed framework surpasses existing methods while handling data and mitigating class imbalance. |
Hierarchical Text Classification with LLM-Refined Taxonomies (2026.eacl-long)
Copied to clipboard
| Challenge: | Hierarchical text classification (HTC) relies on taxonomies that organize labels into structured hierarchies, but many real-world taxonomies introduce ambiguities, such as identical leaf names under similar parent nodes, which prevent language models from learning clear decision boundaries. |
| Approach: | They propose a framework that uses large language models to transform entire taxonomies through operations such as renaming, merging, splitting, and reordering to better match the semantics encoded by LMs. |
| Outcome: | The proposed framework outperforms human-curated taxonomies in three HTC benchmarks and shows that it aligns better with the model's actual confusion patterns. |
Toward Reliable Clinical Coding with Language Models: Verification and Lightweight Adaptation (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods for clinical code verification fail to account for hierarchical misalignments . standardized coding systems such as ICD-10-CM1 ensure consistency across medical records. |
| Approach: | They propose to use prompt engineering and small-scale fine-tuning to improve accuracy without the computational overhead of search-based methods. |
| Outcome: | The proposed task is a standalone task and a pipeline component to address hierarchical near-miss errors without the computational overhead of search-based methods. |
Automating Qualitative Data Analysis with Large Language Models (2024.acl-srw)
Copied to clipboard
| Challenge: | Existing methods for qualitative data analysis are far from resembling a human's analysis outcome. |
| Approach: | They propose a method based on Large Language Models to tackle automated coding and make it as close as possible to the results of human researchers. |
| Outcome: | The proposed method is based on large language models and can be as close as possible to the results of human researchers. |
OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models (2025.acl-long)
Copied to clipboard
Siming Huang, Tianhao Cheng, Jason Klein Liu, Weidi Xu, Jiaran Hao, Liuyihan Song, Yang Xu, Jian Yang, Jiaheng Liu, Chenchen Zhang, Linzheng Chai, Ruifeng Yuan, Xianzhen Luo, Qiufeng Wang, YuanTao Fan, Qingfu Zhu, Zhaoxiang Zhang, Yang Gao, Jie Fu, Qian Liu, Houyi Li, Ge Zhang, Yuan Qi, Xu Yinghui, Wei Chu, Zili Wang
| Challenge: | Code LLMs lack reproducible data pipelines and training protocols for reproducible advancements in code intelligence. |
| Approach: | They propose a top-tier code LLM that releases model weights and inference code . reproducible data pipelines, rigorous experimental ablation results and training protocols are included . |
| Outcome: | The proposed model achieves comparable performance to leading models and serves as an "open cookbook" reproducible training data, rigorous experimental ablation results, and detailed training protocols are also included in the model. |
DictLLM: Harnessing Key-Value Data Structures with Large Language Models for Enhanced Medical Diagnostics (2024.findings-acl)
Copied to clipboard
| Challenge: | Structured data processing is a complex and complex process. |
| Approach: | They propose a framework that captures heterogeneity of structured data using large language models . they propose group positional encoding, hierarchical attention bias and optimal transport alignment layer . |
| Outcome: | The proposed framework outperforms baseline methods and few-shot GPT-4 on a medical lab report dataset. |