Relative Position Encoding-Enhanced Vision Transformer for Image-Level Defect Classification in Manufacturing Textured-Surface Inspection
TL;DR
The ViT-RPE method provides a compact image-level pre-screening solution for automated product inspection in manufacturing lines, especially where repetitive texture, material appearance consistency, and rapid quality sorting are required.
Abstract
INTRODUCTION: In textile and textured-surface manufacturing, visual defects in woven fabrics, leather-like materials, tiles, and grid products directly influence product grading, downstream cutting, assembly reliability, after-sales repair, and supply-chain delivery stability. Weak defects embedded in repetitive textures are still difficult for manual inspection and conventional handcrafted vision methods.
Objectives
This study constructs an image-level defective/non-defective classification model for manufacturing quality inspection by enhancing Vision Transformer with relative spatial modeling, so that subtle texture disruption can be identified before products enter subsequent processing or distribution stages.
Methods
A ViT-Small backbone was combined with learnable relative position encoding. Input images were resized, normalized, divided into 16 × 16 patches, and transformed into token embeddings. Relative spatial bias was inserted into multi-head self-attention to encode patch-to-patch displacement while retaining absolute positional information. The model was evaluated with precision, accuracy, recall, F1-score, and AUROC on a supervised MVTec-derived texture subset.
Results
ViT-RPE outperformed ResNet-18, an activation-embedded CNN, EfficientFormer-L1, Swin-Tiny, and the baseline ViT under the same supervised image-level classification protocol. It achieved an accuracy of 0.954 ± 0.004 and an AUROC of 0.977 ± 0.003 on DAGM, and an accuracy of 0.939 ± 0.005 and an AUROC of 0.969 ± 0.004 on the MVTec-derived subset. Ablation results showed that combining absolute and relative positional information produced the best performance, with limited additional computational cost.
Conclusion
The method provides a compact image-level pre-screening solution for automated product inspection in manufacturing lines, especially where repetitive texture, material appearance consistency, and rapid quality sorting are required.