A scalable bench-marking pipeline is introduced that generates large ensembles of scFv–Ag structure predictions by cofolding a curated subset of 3,800 Ab–Ag complexes from SAbDab using multiple state-of-the-art models under diverse inference-time settings and evaluating model performance in recovering correct scFv–Ag interfaces.
Abstract
Accurate modeling of antibody–antigen (Ab–Ag) complexes is central to biologic development, yet the reliability and failures of modern Ab–Ag folding pipelines remain poorly characterized. Single-chain variable fragments (scFvs) are thera-peutically important antibodies, but large-scale evaluations of structure prediction models on scFv–Ag complexes are largely lacking. We introduce a scalable bench-marking pipeline that generates large ensembles of scFv–Ag structure predictions by cofolding a curated subset of 3,800 Ab–Ag complexes from SAbDab using multiple state-of-the-art models under diverse inference-time settings. The resulting dataset, SCALE (scFv–Ag CompLex Ensembles), includes standardized scFv–Ag sequences and around 200,000 predicted complexes spanning different models, sampling strategies, and auxiliary inputs. Using SCALE, we evaluate model performance in recovering correct scFv–Ag interfaces and assess the ability of existing confidence metrics to select the best structure from prediction ensembles. We find that while confidence scores effectively distinguish easy from hard scFv–Ag complexes, they often fail to identify the highest-quality interface for a given target. Further analysis shows that near-correct interfaces typically appear in ensembles but at low frequency, and inference-time choices such as sampling, recycling, and using evolutionary or structural information are crucial for accurate scFv–Ag complex predictions. Dataset and analysis code are available at https://huggingface.co/datasets/ravishah1/SCALE
The most recent methods substantially outperformed earlier ones, producing medium-or-better top-ranked models for approximately half of post-cutoff Fv complexes without templates or experimental restraints, and performing similarly on antigens with or without a close pre-cutoff homolog.
Minjae Park, Roman Nett, Brian M. Petersen et al.· bioRxiv· 0 citations
These findings provide practical guidance for integrating open-source protein structure prediction models into AI-driven nanobody discovery pipelines while highlighting the need for improved generalization across antigens.
Yannick Vogt, Rebekka Roßberg, Jan Habermann et al.· Frontiers in Bioinformatics· 1 citation
This work evaluated ImmuneBuilder, IgFold, AlphaFold3, GRAMM, and dyMEAN on 50 non-redundant humanized antibody–antigen complexes using multiple retained predictions and paired statistical testing, finding all three antibody structure predictors were accurate.
Ze-Yuan Yu, Ji-Lei Wu, Zi-Yao Ning et al.· Bioinformatics Advances· 1 citation
This thesis examines the integration of machine learning into computational structural biology, with an emphasis on modelling and predicting antibody–antigen interactions. Such interactions are fundamental to numerous biological processes and are central to therapeutic antibody design. Despite recent advances in AI-bas...
SAASBench provides a framework for evaluating the model's ability to estimate the specificity of a candidate antibody in relevant settings, indicating that strong performance on traditional affinity benchmarks does not automatically translate into reliable antibody specificity estimation in proteome-derived settings.
Dmitriy Umerenkov, Ivan Poddiakov· Proceedings of the 32nd ACM...· 0 citations
This work presents Antigen‐VHH Interface Database (AVIDbase), a highly curated dataset of nanobody‐antigen structures that provides a nonredundant set of structures with standardized chain identifiers, harmonized metadata, and cleaned atomic coordinates in a ready‐to‐use format for ML applications.
Tadej Medved, J. Lah, G. Miličić et al.· Protein Science· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.