Papers by Shiguo Lian
Mixture of Heterogeneous Grouped Experts for Language Modeling (2026.acl-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) based on Mixture-of-Experts (MoE) enforce uniform expert sizes, creating a rigidity that fails to align computational costs with varying token-level complexity. |
| Approach: | They propose a mixture of heterogeneous grouped experts (MoHGE) that allows for flexible, resource-aware expert combinations. |
| Outcome: | The proposed model matches the performance of existing Mixture-of-Experts architectures while maintaining balanced GPU utilization. |
DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models (2025.emnlp-industry)
Copied to clipboard
Yi Shen, Jian Zhang, Jieyun Huang, Shuming Shi, Wenjing Zhang, Jiangze Yan, Ning Wang, Kai Wang, Zhaoxiang Liu, Shiguo Lian
| Challenge: | Recent advances in slow-thinking reasoning models have shown exceptional performance in complex reasoning tasks. |
| Approach: | They propose a framework that enables models to automatically adjust Chain-of-Thought (CoT) length based on problem difficulty. |
| Outcome: | The proposed framework penalizes inefficiency on simple problems while incentivizing deep reasoning for complex ones. |
Fuzzy Reasoning Chain (FRC): An Innovative Reasoning Framework from Fuzziness to Clarity (2025.findings-emnlp)
Copied to clipboard
Ping Chen, Xiang Liu, Zhaoxiang Liu, Zezhou Chen, Xingpeng Zhang, Huan Hu, Zipeng Wang, Kai Wang, Shuming Shi, Shiguo Lian
| Challenge: | ambiguity, polysemy, or uncertainty remain significant challenges in natural language processing. |
| Approach: | They introduce a framework that integrates LLM semantic priors with continuous fuzzy membership degrees to create an explicit interaction between probability-based reasoning and fuzzy membership reasoning. |
| Outcome: | The proposed framework integrates semantic priors with continuous fuzzy membership degrees . it allows ambiguous inputs to be gradually transformed into clear and interpretable decisions . |