Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2022-05-25

75
structures analysed (15 full · 20.0%)
68.0%
confidently wrong
11.3%
novel sequences
00.0%
novel & wrong
0.921
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 6 of 75 structures (8.0%) are confidently wrong; median TM-score is 0.921.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.921 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7WPS_A P04275 von Willebrand antigen 2 EM 4.32 2022-01-24 58.30 86.28 0.28 0.59 9.62 19.29 0.64 wrong
7WPQ_A P04275 von Willebrand antigen 2 EM 3.27 2022-01-24 58.30 86.28 0.28 0.60 9.53 19.30 0.64 wrong
7WPP_E P04275 von Willebrand antigen 2 EM 2.85 2022-01-24 58.30 86.28 0.28 0.61 9.53 19.26 0.64 wrong
7WN3_A P04275 von Willebrand antigen 2 EM 3.29 2022-01-17 58.30 86.28 0.28 0.59 9.98 19.27 0.64 wrong
7WQT_A P04275 von Willebrand antigen 2 EM 4.30 2022-01-26 58.30 86.28 0.28 0.59 9.80 19.28 0.64 wrong
7WPR_A P04275 von Willebrand antigen 2 EM 4.39 2022-01-24 58.30 86.28 0.28 0.59 9.80 19.28 0.64 wrong
7TOP_PR A7H9Z6 PR20 EM 2.40 2022-01-24 63.41 0.20 0.51 ok
7S3R_A P22466 Galanin NMR 2021-09-08 65.89 0.19 0.50 25.00 6.13 0.25 ok
7YYK_A P07996 Thrombospondin-1 X-ray 2.60 2022-02-18 3.40 74.34 0.67 0.91 35.53 6.34 0.24 ok
7SC0_A Q03135 Caveolin-1 EM 3.40 2021-09-26 100.00 novel 85.00 0.64 0.80 43.80 4.11 0.21 ok
7PII_K Q03188 Centromere protein C EM 2.68 2021-08-19 0.00 46.20 0.22 0.63 22.62 8.88 0.20 ok
7VAG_A Q14973 Sodium/bile acid cotransporter EM 3.32 2021-08-29 83.50 0.76 0.20 ok
7EUO_A P63096 Guanine nucleotide-binding protein G(i) su EM 2.90 2021-05-18 93.75 0.80 0.18 ok
7VAD_A Q14973 Sodium/bile acid cotransporter EM 3.41 2021-08-29 83.50 0.79 0.18 ok
7WSI_A Q14973 Sodium/bile acid cotransporter EM 3.32 2022-01-29 83.50 0.80 0.17 ok
7FCI_A Q14973 Sodium/bile acid cotransporter EM 3.30 2021-07-14 83.50 0.80 0.17 ok
7S3O_A P22466 Galanin NMR 2021-09-07 68.54 0.21 0.61 38.46 4.24 0.17 ok
7SQO_A P63096 Guanine nucleotide-binding protein G(i) su EM 3.17 2021-11-05 93.75 0.82 0.17 ok
7S3Q_A P22466 Galanin NMR 2021-09-08 68.02 0.23 0.59 44.64 3.80 0.16 ok
7S3C_A P26368 Splicing factor U2AF 65 kDa subunit X-ray 1.51 2021-09-05 73.19 0.82 0.13 ok
7Q6C_A P13671 Complement component C6 X-ray 2.29 2021-11-06 79.62 0.85 0.12 ok
7S3A_A P26368 Splicing factor U2AF 65 kDa subunit X-ray 1.48 2021-09-05 73.19 0.84 0.12 ok
7S3B_A P26368 Splicing factor U2AF 65 kDa subunit X-ray 1.89 2021-09-05 73.19 0.84 0.12 ok
7EUO_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.90 2021-05-18 89.56 0.87 0.11 ok
7W9T_B Q07699 Sodium channel subunit beta-1 EM 3.00 2021-12-10 87.06 0.90 0.09 ok
7W9P_B Q07699 Sodium channel subunit beta-1 EM 2.90 2021-12-10 87.06 0.90 0.09 ok
7S1X_A P55011 Solute carrier family 12 member 2 EM 2.90 2021-09-02 73.12 0.88 0.09 ok
7PII_D P62807 Histone H2B type 1-C/E/F/G/I EM 2.68 2021-08-19 88.12 0.90 0.09 ok
7W9M_B Q07699 Sodium channel subunit beta-1 EM 3.00 2021-12-10 87.06 0.90 0.09 ok
7WGQ_B Q15788 15-meric peptide from Nuclear receptor coa X-ray 2.43 2021-12-28 46.72 0.84 0.08 ok
7QI1_E P13569 Cystic fibrosis transmembrane conductance X-ray 1.76 2021-12-14 0.00 30.53 0.31 0.81 46.88 4.03 0.07 ok
7SQO_R O43614 Orexin receptor type 2 EM 3.17 2021-11-05 78.94 0.91 0.07 ok
7U7N_D Q8NEV9 Interleukin-27 subunit alpha EM 3.47 2022-03-07 75.62 0.91 0.07 ok
7WGO_B Q15788 15-meric peptide from Nuclear receptor coa X-ray 2.36 2021-12-28 58.92 0.66 0.89 75.00 1.90 0.06 ok
7MZ0_A P06746 DNA polymerase beta X-ray 2.02 2021-05-23 94.25 0.93 0.06 ok
7W9M_A Q15858 Sodium channel protein type 9 subunit alph EM 3.00 2021-12-10 69.06 0.91 0.06 ok
7RH2_A Q15306 ICSAT transcription factor X-ray 2.47 2021-07-16 71.56 0.92 0.06 ok
7MZ1_A P06746 DNA polymerase beta X-ray 2.17 2021-05-23 94.25 0.94 0.05 ok
7W9P_A Q15858 Sodium channel protein type 9 subunit alph EM 2.90 2021-12-10 69.06 0.92 0.05 ok
7MZ2_A P06746 DNA polymerase beta X-ray 2.09 2021-05-23 94.25 0.94 0.05 ok
7W9T_A Q15858 Sodium channel protein type 9 subunit alph EM 3.00 2021-12-10 69.06 0.93 0.05 ok
7P0P_A Q8N5K1 CDGSH iron-sulfur domain-containing protei X-ray 1.74 2021-06-30 90.38 0.95 0.05 ok
7U7N_A Q6UWB1 Interleukin-27 receptor subunit alpha EM 3.47 2022-03-07 78.94 0.94 0.05 ok
7S1Y_A P55011 Solute carrier family 12 member 2 EM 3.60 2021-09-02 73.12 0.94 0.04 ok
7S1Z_A P55011 Solute carrier family 12 member 2 EM 3.30 2021-09-02 73.12 0.94 0.04 ok
7EUO_R P21462 fMet-Leu-Phe receptor EM 2.90 2021-05-18 83.81 0.95 0.04 ok
7WGP_B Q15788 15-meric peptide from Nuclear receptor coa X-ray 2.53 2021-12-28 59.43 0.58 0.86 88.64 1.47 0.04 ok
7P0O_A Q9NZ45 CDGSH iron-sulfur domain-containing protei X-ray 1.65 2021-06-30 91.19 0.96 0.04 ok
7U7N_B P40189 Interleukin-6 receptor subunit beta EM 3.47 2022-03-07 74.62 0.95 0.04 ok
7ZEH_A Q969T7 7-methylguanosine phosphate-specific 5'-nu X-ray 1.50 2022-03-31 92.38 0.96 0.04 ok
7PII_A P49450 Histone H3-like centromeric protein A EM 2.68 2021-08-19 81.50 0.96 0.03 ok
7QI1_A S7N159 14-3-3 protein theta X-ray 1.76 2021-12-14 80.12 0.96 0.03 ok
7X1N_A Q14814 Myocyte enhancer factor 2D/deleted in azoo X-ray 3.31 2022-02-24 53.75 0.95 0.03 ok
7T1T_A O60674 Tyrosine-protein kinase JAK2 X-ray 2.08 2021-12-02 86.88 0.97 0.03 ok
7U7N_C Q14213 Interleukin-27 subunit beta EM 3.47 2022-03-07 87.62 0.97 0.03 ok
7PII_C Q93077 Histone H2A type 1-C EM 2.68 2021-08-19 91.00 0.98 0.02 ok
7WGP_A P37231 Isoform 1 of Peroxisome proliferator-activ X-ray 2.53 2021-12-28 76.12 0.97 0.02 ok
7WGQ_A P37231 Isoform 1 of Peroxisome proliferator-activ X-ray 2.43 2021-12-28 76.12 0.97 0.02 ok
7EUV_A P05413 Fatty acid-binding protein, heart X-ray 1.28 2021-05-19 96.19 0.98 0.02 ok
7PII_B P62805 Histone H4 EM 2.68 2021-08-19 89.81 0.98 0.02 ok
7WGO_A P37231 Isoform 1 of Peroxisome proliferator-activ X-ray 2.36 2021-12-28 76.12 0.98 0.02 ok
7OYJ_A Q15562 Transcriptional enhancer factor TEF-4 X-ray 1.91 2021-06-24 70.75 0.98 0.01 ok
7RGG_A O94925 Glutaminase kidney isoform, mitochondrial X-ray 3.00 2021-07-15 80.19 0.98 0.01 ok
7ZBG_A Q02880 DNA topoisomerase 2-beta X-ray 2.30 2022-03-23 73.44 0.98 0.01 ok
7QFN_A Q02880 DNA topoisomerase 2-beta X-ray 2.62 2021-12-06 73.44 0.98 0.01 ok
7WGN_A Q03181 Peroxisome proliferator-activated receptor X-ray 1.81 2021-12-28 82.88 0.99 0.01 ok
7WGL_A Q03181 Peroxisome proliferator-activated receptor X-ray 2.09 2021-12-28 82.88 0.99 0.01 ok
7W9P_C O60939 Sodium channel subunit beta-2 EM 2.90 2021-12-10 85.81 0.99 0.01 ok
7QFO_A Q02880 DNA topoisomerase 2-beta X-ray 1.90 2021-12-06 73.44 0.99 0.01 ok
7W9T_C O60939 Sodium channel subunit beta-2 EM 3.00 2021-12-10 85.81 0.99 0.01 ok
7W9M_C O60939 Sodium channel subunit beta-2 EM 3.00 2021-12-10 85.81 0.99 0.01 ok
7EUW_A P05413 Fatty acid-binding protein, heart X-ray 1.55 2021-05-19 96.19 0.99 0.01 ok
7REN_A O94925 Glutaminase kidney isoform, mitochondrial X-ray 2.80 2021-07-13 80.19 0.99 0.01 ok
7EUO_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.90 2021-05-18 97.06 0.99 0.01 ok
7OZX_A P51570 Galactokinase X-ray 2.30 2021-06-29 97.19 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.