Papers by Yuting Shi
Find-the-Common: A Benchmark for Explaining Visual Patterns from Images (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances in Instruction-fine-tuned Vision and Language Models (IVLMs) have prompted some studies to analyze the reasoning capabilities of IVLMs. |
| Approach: | They introduce a vision and language task for Inductive Visual Reasoning that uses common attributes across visual scenes to find common answers. |
| Outcome: | The proposed model can archive with 48% accuracy on the FTC, compared with state-of-the-art models. |
On the Additive Compositionality of Task Vectors in Vision–Language Models (2026.eacl-short)
Copied to clipboard
| Challenge: | In-context learning (ICL) in large language models (LLMs) has been shown to operate through task vectors, but its extension to vision-language models (VLMs) remains underexplored. |
| Approach: | They construct visual reasoning tasks with clearly defined subtasks and extract task vectors from few-shot demonstrations. |
| Outcome: | The proposed model can be extended to vision-language models (VLMs) by adding the vectors of its constituent subtasks. |
GlimpRouter: Efficient Collaborative Inference by Glimpsing One Token of Thoughts (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing routing strategies rely on local token probabilities or post-hoc verification, introducing significant inference overhead. |
| Approach: | They propose a step-wise collaboration framework that generates only the first token of each reasoning step and routes it to a larger model only when initial token entropy exceeds a threshold. |
| Outcome: | The proposed approach reduces inference latency while preserving accuracy. |