A protein model reached near-experimental error—then stumbled on engineered mutations
KaML inferred the acidity of naturally evolved protein sites from sequence alone, but its advantage weakened on 89 deeply buried engineered mutations. The contrast shows where evolutionary training signals help—and where structure still matters.
The short version
- What happened
- Across four natural-protein benchmarks, the sequence-only KaML-ESM models reported root-mean-square errors of about 0.5 pH units for six ionisable amino-acid types.
- Who it affects
- Scientists could use the open sequence-first tool to triage candidate sites before slower structural modelling or laboratory work, provided its uncertainty is not mistaken for evidence that a protein will be safe or effective.
- What remains unproven
- The study is computational and retrospective; it does not test whether KaML improves prospective protein design, drug discovery or laboratory productivity.
Keep in mind
The study is computational and retrospective; it does not test whether KaML improves prospective protein design, drug discovery or laboratory productivity.
Synthetic pretraining labels were generated by an earlier structure-based model, so they add scale rather than independent experimental truth.
The 89 engineered buried mutations were a clear weakness, limiting claims about novel designed proteins outside evolutionary patterns.
The human-proteome scan proposes functional sites and mechanisms; those remain hypotheses until experimentally validated.
Multi-source analysis · 2 linked sources. Primary analysed source date: 24 October 2026. Earliest linked supporting source: 15 July 2026.
Read the full report · 4 min The evidence, methods, implications and limitations
Sequence carried more electrostatic information than expected
Researchers at the University of Maryland trained KaML-ESM2 and KaML-ESMC to estimate a residue's pKa—the pH at which it changes protonation state—from an amino-acid sequence. That value affects protein charge, stability, binding and catalytic behaviour. Across four benchmarks of natural proteins, the models reported root-mean-square errors of about 0.5 pH units for aspartate, glutamate, histidine, cysteine, tyrosine and lysine, generally outperforming the structure-based KaML-CBTree and the empirical PROPKA3 comparator.
The pipeline did not learn from experimental measurements alone. It first used a synthetic GAINES set containing 29,457 predicted pKa shifts across 9,945 Protein Data Bank proteins, then fine-tuned separate acid and base models on the experimental PKAD-3r collection. A temporal external set contained 55 residue measurements published after the database cut-off. This design tests some generalisation, but the synthetic labels came from the team's earlier model and are not new laboratory measurements.[1][2]
Engineered sites exposed the boundary
The most useful negative result came from 89 engineered residues buried inside staphylococcal nuclease variants. These mutations lack the evolutionary context that a protein language model learns from natural sequences, and KaML's performance deteriorated. The paper therefore supports a bounded claim: sequence embeddings can encode electrostatic regularities shaped by evolution, but they do not replace explicit structural or physics-based analysis when engineers create unusual local environments.
For protein engineers and drug-discovery teams, fast sequence-only screening could narrow candidates before costly simulation or experiment. It cannot establish that a designed protein will fold, bind or work in a cell, and a pKa error is not a clinical outcome. Confidence would rise with preregistered tests on independently designed proteins, prospective wet-lab measurements and comparisons that hold training data and compute constant. The work was NIH-funded; Biohub supplied compute credits for ESMC, and the authors declared no competing interests.[1][2]
The distinction that matters
Where the evidence is strong—and where it breaks
The same model faces progressively less familiar evidence.
Learn
Combine experimental pKa records with synthetic labels
29,457 synthetic residue shifts from 9,945 proteins
Check
Test natural proteins and 55 later measurements
About 0.5-unit RMSE across four natural-protein benchmarks
Stress test
Predict 89 deeply buried engineered mutations
Accuracy drops when evolutionary support is missing