Learning Cross-Architecture Instruction Embeddings for Binary Code Analysis in Low-Resource Architectures (2024.findings-naacl)
Copied to clipboard
| Challenge: | Applying deep learning to binary code analysis has drawn great attention because of its notable performance. |
| Approach: | They propose to learn cross-architecture instruction embeddings where semantically-similar instructions have close embeddements in a shared space. |
| Outcome: | The proposed approach generates high-quality CAIE with good transferability on four ISAs. |
Similar Papers
Unsupervised Binary Code Translation with Application to Code Clone Detection and Vulnerability Discovery (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that binary code analysis is a key problem in software security research. |
| Approach: | They propose to apply Neural Machine Translation to binary code analysis . they translate a binary in a low-resource ISA and train a model on the high-resourced ISA . |
| Outcome: | The proposed model can be used to analyze binary code across ISAs using a high-resource ISA. |
Guaranteed Guess: A Language Modeling Approach for CISC-to-RISC Transpilation with Testing Guarantees (2025.findings-emnlp)
Copied to clipboard
| Challenge: | ISA-centric transpilation pipelines are used to translate low-level programs between ISAs . GG provides high code coverage across unit tests and better energy efficiency . |
| Approach: | They propose a ISA-centric transpilation pipeline that embeds large language models into software testing frameworks to ensure accuracy. |
| Outcome: | The proposed method achieves high code coverage across unit tests and functional/semantic correctness of 99% on HumanEval and 49% on BringupBench programs. |
X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructions (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models respond well in high-resource languages but struggle in low-resourced languages. |
| Approach: | They propose a method to construct cross-lingual instruction following samples with instruction in English and response in low-resource languages. |
| Outcome: | The proposed method builds a large-scale cross-lingual instruction tuning dataset on 10 languages. |
From Where Words Come: Efficient Regularization of Code Tokenizers Through Source Attribution (2026.acl-long)
Copied to clipboard
| Challenge: | Currently, subword tokenization is the most common approach for vocabulary building in large models. |
| Approach: | They propose to regularize training and minimize overfitting by using source-attributed BPE . they find that undertrained tokens are prone to producing unused, unusable tokens . |
| Outcome: | The proposed techniques reduce the number of under-trained tokens while maintaining the same inference procedure as with regular BPE. |
How Do Your Code LLMs perform? Empowering Code Instruction Tuning with Really Good Data (2024.emnlp-main)
Copied to clipboard
Yejie Wang, Keqing He, Dayuan Fu, Zhuoma GongQue, Heyang Xu, Yanxu Chen, Zhexu Wang, Yujia Fu, Guanting Dong, Muxi Diao, Jingang Wang, Mengdi Zhang, Xunliang Cai, Weiran Xu
| Challenge: | Recent research has shown that code pre-trained models improve coding capabilities. |
| Approach: | They propose a code data pruning strategy to identify which datasets are high-quality code instruction data. |
| Outcome: | The proposed model achieves state-of-the-art performance using fewer training data. |
VeriLocc: End-to-End Cross-Architecture Register Allocation via LLM (2025.emnlp-main)
Copied to clipboard
| Challenge: | Modern GPUs evolve rapidly, yet production compilers still rely on hand-crafted register allocation heuristics that require substantial re-tuning for each hardware generation. |
| Approach: | They propose a framework that combines large language models with compiler techniques to enable generalizable and verifiable register allocation across GPU architectures. |
| Outcome: | The framework outperforms expert-tuned libraries on matrix multiplication and multi-head attention and a verifier-guided regeneration loop to ensure correctness. |
Joint Geometrical and Statistical Domain Adaptation for Cross-domain Code Vulnerability Detection (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to detect code vulnerability are limited by labeled training data on target domains. |
| Approach: | They propose a cross-domain code vulnerability detection framework called MNCRI . they propose mutual nearest neighbor contrastive learning to align the source and target domains . |
| Outcome: | The proposed framework outperforms state-of-the-art methods in cross-domain code vulnerability detection tasks. |
FlowMalTrans: Unsupervised Binary Code Translation for Malware Detection Using Flow-Adapter Architecture (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Using deep learning to detect malware has attracted great attention due to its notable performance. |
| Approach: | a new approach uses Neural Machine Translation and Normalizing Flows to apply deep learning to malware detection. |
| Outcome: | The proposed approach reduces the burden of data collection by enabling malware detection across multiple ISAs. |
Distant Supervision from Disparate Sources for Low-Resource Part-of-Speech Tagging (D18-1)
Copied to clipboard
| Challenge: | Low-resource languages lack manual annotated data to learn basic models such as part-of-speech (POS) taggers. |
| Approach: | They propose a cross-lingual neural part-of-speech tagger that learns from disparate sources of distant supervision in a uniform framework. |
| Outcome: | The proposed model scales to hundreds of low-resource languages without access to gold annotated data. |
\mathsf{Con Instruction}: Universal Jailbreaking of Multimodal Large Language Models via Non-Textual Modalities (2025.acl-long)
Copied to clipboard
| Challenge: | Existing attacks communicate instruction through text, accompanied by a toxic image or audio . a novel gray-box attack method generates adversarial images or audio to convey harmful instructions to MLLMs . |
| Approach: | They propose a gray-box attack method that generates adversarial images or audio to convey specific harmful instructions to MLLMs by following non-textual instruction. |
| Outcome: | The proposed method achieves highest success rates on visual and audio-language models . larger models are more susceptible toCon Instruction, compared to their underlying models - the results will be released . |