Enhancing handwritten mathematical expression recognition with convolutional block attention refinement module and multi-task learning
Published in Journal of Information and Telecommunication, 2026 IF 2.1
Abstract (excerpt). Handwritten Mathematical Expression Recognition (HMER) is challenging due to complex structural relationships, implicit symbols, and variations in handwriting styles. Therefore, this paper presents a novel approach combining multi-task learning (MTL) with advanced attention mechanisms, including the Convolutional Block Attention Module (CBAM) integrated into the Attention Refinement Module (ARM), to optimize attention mechanisms, enable context-aware interpretation, and improve the generalization of the architecture. Integrating MTL enhances the model’s ability to work well on the main task. By sharing knowledge across tasks, the model reduces overfitting and leads to better generalization in the inference stage. Advanced attention mechanisms refine the attention weights to effectively capture highly complex structural expressions and implicit corrections. Our approach addresses the limitations of …
Recommended citation: Thanh Trung Nguyen, Nhut Minh Nguyen, Nam Van Hai Phan, Khoa Minh Nguyen, Trung Thanh Pham, Phuong-Nam Tran, Cuong Tuan Nguyen, Duc Ngoc Minh Dang. (2026). "Enhancing handwritten mathematical expression recognition with convolutional block attention refinement module and multi-task learning." Journal of Information and Telecommunication, 1-33.
Download Paper