Challenge: Existing structural analysis methods for hieroglyphic scripts are script-specific and labor-intensive.
Approach: They propose a hieroglyphic Stroke Analyzer framework that captures character-internal structures and semantics without handcrafted data.
Outcome: The proposed framework captures character-internal structures and semantics without priors . it can be used to generalize hieroglyphic scripts across languages .

Similar Papers

mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understanding (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing Multimodal Large Language Models lack general structure understanding abilities for text-rich document images.
Approach: They propose to use unified structure learning to boost the performance of MLLMs by encoding structure information into text-rich images.
Outcome: The proposed model achieves state-of-the-art on 10 visual document understanding benchmarks.
HICode: Hierarchical Inductive Coding with LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for fine-grained corpus analysis are limited to small subsets and require manual labeling and statistical tools like topic modeling.
Approach: They propose a pipeline that inductively generates labels from analysis data and then hierarchically clusters them to surface emergent themes.
Outcome: The proposed pipeline validates the approach across three datasets and shows it is robust through automated and human evaluations.
LLMSegm: Surface-level Morphological Segmentation Using Large Language Model (2024.lrec-main)

Copied to clipboard

Challenge: Existing approaches to morphological segmentation split word into its morphemes . LLMSegm is applicable in low-data settings and low-resourced languages .
Approach: They propose a novel approach to surface-level morphological segmentation leveraging large language models.
Outcome: The proposed method is applicable in low-data settings and low-resource languages.
LM2Protein: A Structure-to-Token Protein Large Language Model (2025.findings-emnlp)

Copied to clipboard

Challenge: RNA-binding proteins are critical for various molecular functions, relying on their precise tertiary structures.
Approach: They propose a method to integrate protein 3D structural data within a sequence processing framework.
Outcome: The proposed method achieves high sequence recovery in inverse folding and protein-conditioned RNA design.
Finding Structural Knowledge in Multimodal-BERT (2022.acl-long)

Copied to clipboard

Challenge: Several multimodal-BERT models learn contextualized embeddings through training on linguistic data and visual data.
Approach: They propose to make the structure of language and visuals explicit by a dependency parse . they also propose to encode the scene tree in the multimodal-BERT models .
Outcome: The proposed models do not encode the scene trees in the language description.
Towards Universal Segmentations: UniSegments 1.0 (2022.lrec-1)

Copied to clipboard

Challenge: Existing data resources for morphological segmentation are limited to 32 languages . a large number of word forms exist, with some sub-parts being "recycled" many times .
Approach: They propose a multilingual data resource for morphological segmentation in 32 languages . they analyze diversity of how individual linguistic phenomena are captured across them .
Outcome: The proposed scheme is based on 17 existing data resources relevant for segmentation in 32 languages.
Spelling-out is not Straightforward: LLMs’ Capability of Tokenization from Token to Characters (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) can spell out tokens character by character with high accuracy, yet struggle with more complex character-level tasks.
Approach: They examine how large language models internally represent character-level information during the spelling-out process.
Outcome: The embedding layer does not fully encode character-level information, especially beyond the first character.
GALLa: Graph Aligned Large Language Models for Improved Source Code Understanding (2025.acl-long)

Copied to clipboard

Challenge: Programming languages have rich semantics that are represented by graphs and not available from the surface form of source code.
Approach: They propose to use graph neural networks and cross-modal alignment technologies to inject structural information of code into LLMs as an auxiliary task during finetuning.
Outcome: The proposed framework improves on five code tasks with six different baseline LLMs, while incurring no cost at inference time.
DocStruct: A Multimodal Method to Extract Hierarchy Structure in Document for General Form Understanding (2020.findings-emnlp)

Copied to clipboard

Challenge: Form understanding is a complex task because of the textual contents and organizational structure of forms.
Approach: They propose to use multimodal methods to extract key-value pairs from forms . they validate their method on two benchmarks and demonstrate their effectiveness .
Outcome: The proposed method is validated on two benchmarks, MedForm and FUNSD.
NormXLogit: The Head-on-Top Never Lies (2025.emnlp-main)

Copied to clipboard

Challenge: NormXLogit is a novel approach for assessing the significance of input tokens based on word embeddings .
Approach: They propose a novel method for assessing the significance of input tokens based on the input and output representations associated with each token.
Outcome: The proposed method outperforms gradient-based methods in faithfulness and offers competitive performance compared to leading architecture-specific techniques.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations