TPT: a compact CNN-transformer encoder for efficient microbial small protein modeling
TPT provides a compact and computationally efficient encoder with competitive performance for microbial peptide analysis and suggests that effective smORF representation may benefit from pretraining objectives and inductive biases tailored to short, rapidly evolving sequences, rather than from model scale alone.