Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2021-03-17

120
structures analysed (27 full · 22.5%)
97.5%
confidently wrong
32.5%
novel sequences
21.7%
novel & wrong
0.936
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 9 of 120 structures (7.5%) are confidently wrong; median TM-score is 0.936.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.936 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7DU2_P Q9H1D9 DNA-directed RNA polymerase III subunit RP EM 3.35 2021-01-07 3.60 90.67 0.57 0.40 4.81 15.01 0.74 ok
7DN3_P Q9H1D9 DNA-directed RNA polymerase III subunit RP EM 3.50 2020-12-08 3.60 90.67 0.57 0.40 4.81 15.01 0.74 ok
7DU2_Q O15318 DNA-directed RNA polymerase III subunit RP EM 3.35 2021-01-07 100.00 novel 84.26 0.35 0.57 0.87 17.60 0.71 wrong
7DN3_Q O15318 DNA-directed RNA polymerase III subunit RP EM 3.50 2020-12-08 100.00 novel 84.26 0.35 0.57 0.87 17.60 0.71 wrong
6M75_A P29558 RNA-binding motif, single-stranded-interac X-ray 2.57 2020-03-17 1.00 92.19 0.53 0.94 10.33 14.24 0.65 ok
6M6X_A P62826 GTP-binding nuclear protein Ran X-ray 2.88 2020-03-16 0.50 90.02 0.81 0.91 12.92 14.57 0.58 ok
6X2L_A P43005 Excitatory amino acid transporter 3 EM 2.85 2020-05-20 40.40 89.91 0.63 0.79 9.73 10.19 0.56 ok
6X3F_A P43005 Excitatory amino acid transporter 3 EM 3.03 2020-05-21 40.60 89.90 0.59 0.76 11.61 9.61 0.53 ok
6ZBI_A P0DP23 Calmodulin-1 NMR 2020-06-08 0.00 85.49 0.47 0.83 11.99 10.08 0.52 wrong
6YNS_A P0DP23 Calmodulin-1 X-ray 3.94 2020-04-14 0.00 87.48 0.52 0.93 12.86 8.99 0.49 ok
7B1F_C O43683 Mitotic checkpoint serine/threonine-protei X-ray 1.75 2020-11-24 62.62 0.37 0.39 ok
7DN3_I Q9Y2Y1 DNA-directed RNA polymerase III subunit RP EM 3.50 2020-12-08 48.70 83.73 0.58 0.60 20.26 7.37 0.38 ok
6YNU_A P0DP23 Calmodulin-1 X-ray 3.12 2020-04-14 0.00 85.95 0.61 0.94 28.25 6.61 0.34 ok
7B1J_C O43683 Mitotic checkpoint serine/threonine-protei X-ray 2.90 2020-11-25 62.62 0.49 0.32 ok
7B1H_C O43683 Mitotic checkpoint serine/threonine-protei X-ray 2.40 2020-11-24 62.62 0.53 0.29 ok
6Z6R_B P00742 Coagulation factor X X-ray 2.13 2020-05-29 0.00 93.49 0.20 0.50 40.28 5.27 0.29 wrong
6YYY_B P00742 Coagulation factor X X-ray 2.29 2020-05-06 0.00 93.49 0.24 0.48 38.89 5.26 0.29 wrong
6Z6Q_B P00742 Coagulation factor X X-ray 1.81 2020-05-29 0.00 93.49 0.25 0.50 38.89 5.27 0.29 wrong
6YYX_B P00742 Coagulation factor X X-ray 1.53 2020-05-06 0.00 93.49 0.14 0.50 40.28 5.12 0.28 wrong
6YYW_B P00742 Coagulation factor X X-ray 2.27 2020-05-06 0.00 93.49 0.15 0.50 40.28 5.13 0.28 wrong
7DU2_I Q9Y2Y1 DNA-directed RNA polymerase III subunit RP EM 3.35 2021-01-07 48.70 87.13 0.67 0.58 38.30 5.48 0.28 ok
7CMZ_B Q9UPP1 Histone lysine demethylase PHF8 X-ray 1.70 2020-07-29 100.00 novel 56.38 0.37 0.57 16.67 7.58 0.26 ok
6WSM_A Q92599 Septin-8 X-ray 2.45 2020-05-01 76.25 0.77 0.17 ok
7DU2_M Q9NVU0 DNA-directed RNA polymerase III subunit RP EM 3.35 2021-01-07 78.88 0.81 0.15 ok
7DN3_M Q9NVU0 DNA-directed RNA polymerase III subunit RP EM 3.50 2020-12-08 78.88 0.81 0.15 ok
7B1J_A Q9Y6D9 Mitotic spindle assembly checkpoint protei X-ray 2.90 2020-11-25 81.19 0.81 0.15 ok
7DU2_L P53803 DNA-directed RNA polymerases I, II, and II EM 3.35 2021-01-07 85.75 0.83 0.14 ok
7DN3_L P53803 DNA-directed RNA polymerases I, II, and II EM 3.50 2020-12-08 85.75 0.83 0.14 ok
6M6O_A O15519 CASP8 and FADD-like apoptosis regulator NMR 2020-03-16 67.10 83.78 0.77 0.80 57.32 3.10 0.14 ok
6ZBI_B P19634 Sodium/hydrogen exchanger 1 NMR 2020-06-08 0.00 55.07 0.66 0.80 45.14 4.95 0.14 ok
7JHX_C Q9HCE0 Ectopic P granules protein 5 homolog X-ray 1.91 2020-07-21 73.50 0.82 0.13 ok
6WBP_A Q14141 Septin-6 X-ray 1.80 2020-03-27 80.94 0.85 0.12 ok
7DU2_D O75575 DNA-directed RNA polymerase III subunit RP EM 3.35 2021-01-07 82.88 0.85 0.12 ok
7DN3_D O75575 DNA-directed RNA polymerase III subunit RP EM 3.50 2020-12-08 82.88 0.85 0.12 ok
7B1H_A Q9Y6D9 Mitotic spindle assembly checkpoint protei X-ray 2.40 2020-11-24 81.19 0.85 0.12 ok
6X93_C Q08334 Interleukin-10 receptor subunit beta EM 3.50 2020-06-02 82.12 0.86 0.12 ok
6X93_A P22301 Interleukin-10 EM 3.50 2020-06-02 87.88 0.87 0.11 ok
7DU2_N P05423 DNA-directed RNA polymerase III subunit RP EM 3.35 2021-01-07 64.12 0.83 0.11 ok
7DN3_N P05423 DNA-directed RNA polymerase III subunit RP EM 3.50 2020-12-08 64.12 0.83 0.11 ok
7LHX_A P09012 U1 small nuclear ribonucleoprotein A X-ray 2.20 2021-01-26 79.50 0.88 0.09 ok
7B1F_A Q9Y6D9 Mitotic spindle assembly checkpoint protei X-ray 1.75 2020-11-24 81.19 0.89 0.09 ok
6UD0_B P0CG47 Ubiquitin NMR 2019-09-18 0.00 92.50 0.94 0.92 83.44 2.67 0.08 ok
7DU2_G Q9Y535 DNA-directed RNA polymerase III subunit RP EM 3.35 2021-01-07 88.00 0.91 0.08 ok
7DN3_G Q9Y535 DNA-directed RNA polymerase III subunit RP EM 3.50 2020-12-08 88.00 0.91 0.08 ok
6ULM_A Q12864 Cadherin-17 X-ray 2.15 2019-10-08 59.20 91.29 0.93 0.96 82.86 1.53 0.08 ok
6YYV_A Q12797 Aspartyl/asparaginyl beta-hydroxylase X-ray 1.77 2020-05-06 71.81 0.90 0.07 ok
7L26_A Q92918 Mitogen-activated protein kinase kinase ki X-ray 2.30 2020-12-16 68.19 0.89 0.07 ok
6WCU_A Q99719 Septin-5 X-ray 1.80 2020-03-31 77.50 0.91 0.07 ok
7E2M_A Q9P2K8 eIF-2-alpha kinase GCN2 X-ray 2.35 2021-02-05 72.94 0.91 0.07 ok
7DU2_J P62875 DNA-directed RNA polymerases I, II, and II EM 3.35 2021-01-07 92.94 0.93 0.07 ok
7DN3_J P62875 DNA-directed RNA polymerases I, II, and II EM 3.50 2020-12-08 92.94 0.93 0.07 ok
6UD0_A P0CG47 Ubiquitin NMR 2019-09-18 0.00 94.12 0.95 0.95 89.14 2.08 0.07 ok
6YYU_A Q12797 Aspartyl/asparaginyl beta-hydroxylase X-ray 2.11 2020-05-06 71.81 0.91 0.07 ok
6ZPL_A P48067 Sodium- and chloride-dependent glycine tra X-ray 3.94 2020-07-08 81.12 0.92 0.07 ok
6ZBV_A P48067 Sodium- and chloride-dependent glycine tra X-ray 3.40 2020-06-09 81.12 0.92 0.06 ok
6WB3_A O43236 Septin-4 X-ray 1.35 2020-03-26 53.12 0.89 0.06 ok
7BA0_A Q13451 Peptidyl-prolyl cis-trans isomerase FKBP5 X-ray 1.14 2020-12-15 92.50 0.94 0.06 ok
7CZB_A Q9BUN8 Derlin-1 EM 3.80 2020-09-07 80.00 0.93 0.06 ok
7L24_A Q92918 Mitogen-activated protein kinase kinase ki X-ray 2.68 2020-12-16 68.19 0.92 0.05 ok
7DU2_K P0DPB6 DNA-directed RNA polymerases I and III sub EM 3.35 2021-01-07 86.38 0.94 0.05 ok
7DN3_K P0DPB6 DNA-directed RNA polymerases I and III sub EM 3.50 2020-12-08 86.38 0.94 0.05 ok
7NBM_A P40261 Nicotinamide N-methyltransferase X-ray 2.69 2021-01-27 96.06 0.95 0.05 ok
7BKG_A P40261 Nicotinamide N-methyltransferase X-ray 2.33 2021-01-15 96.06 0.95 0.05 ok
7E2K_A Q9P2K8 eIF-2-alpha kinase GCN2 X-ray 2.04 2021-02-05 72.94 0.93 0.05 ok
7NBJ_A P40261 Nicotinamide N-methyltransferase X-ray 2.27 2021-01-27 96.06 0.95 0.05 ok
7L25_A Q92918 Mitogen-activated protein kinase kinase ki X-ray 1.85 2020-12-16 68.19 0.93 0.05 ok
6M5Y_A P09382 Galectin-1,Galectin-1 X-ray 1.38 2020-03-12 0.80 96.48 0.49 0.92 94.63 1.59 0.05 wrong
6YLI_A Q07817 Bcl-2-like protein 1 X-ray 1.90 2020-04-07 72.50 0.94 0.05 ok
6T3O_A P52179 Myomesin-1 X-ray 1.80 2019-10-11 8.00 84.80 0.95 0.93 93.58 0.97 0.05 ok
7DU2_O Q9BUI4 DNA-directed RNA polymerase III subunit RP EM 3.35 2021-01-07 89.06 0.95 0.05 ok
7DN3_O Q9BUI4 DNA-directed RNA polymerase III subunit RP EM 3.50 2020-12-08 89.06 0.95 0.05 ok
7NBQ_A P40261 Nicotinamide N-methyltransferase X-ray 2.48 2021-01-27 96.06 0.96 0.04 ok
6UD0_C Q99816 Tumor susceptibility gene 101 protein NMR 2019-09-18 0.00 96.02 0.97 0.94 95.57 0.76 0.04 ok
7BLE_A P40261 Nicotinamide N-methyltransferase X-ray 2.81 2021-01-18 96.06 0.96 0.04 ok
7DU2_E P19388 DNA-directed RNA polymerases I, II, and II EM 3.35 2021-01-07 93.06 0.96 0.04 ok
7DN3_E P19388 DNA-directed RNA polymerases I, II, and II EM 3.50 2020-12-08 93.06 0.96 0.04 ok
6WBE_A Q8WYJ6 Septin-1 X-ray 2.10 2020-03-26 76.12 0.95 0.04 ok
7B9Z_A Q13451 Peptidyl-prolyl cis-trans isomerase FKBP5 X-ray 1.44 2020-12-15 92.50 0.96 0.04 ok
7DU2_F P61218 DNA-directed RNA polymerases I, II, and II EM 3.35 2021-01-07 78.44 0.95 0.04 ok
7DN3_F P61218 DNA-directed RNA polymerases I, II, and II EM 3.50 2020-12-08 78.44 0.95 0.04 ok
7AWX_A Q13451 Peptidyl-prolyl cis-trans isomerase FKBP5 X-ray 2.20 2020-11-09 92.50 0.96 0.03 ok
6X93_B Q13651 Interleukin-10 receptor subunit alpha EM 3.50 2020-06-02 62.00 0.95 0.03 ok
7A6X_AAA Q13451 Peptidyl-prolyl cis-trans isomerase FKBP5 X-ray 1.67 2020-08-27 92.50 0.96 0.03 ok
7JHX_A Q9H0R8 Gamma-aminobutyric acid receptor-associate X-ray 1.91 2020-07-21 95.00 0.97 0.03 ok
7CCY_A P08397 Porphobilinogen deaminase X-ray 2.40 2020-06-18 90.06 0.97 0.03 ok
7A6W_AAA Q13451 Peptidyl-prolyl cis-trans isomerase FKBP5 X-ray 1.85 2020-08-27 92.50 0.97 0.03 ok
7CMZ_A Q92547 DNA topoisomerase 2-binding protein 1 X-ray 1.70 2020-07-29 66.06 0.96 0.03 ok
7B9Y_A Q13451 Peptidyl-prolyl cis-trans isomerase FKBP5 X-ray 1.35 2020-12-15 92.50 0.97 0.03 ok
7CCZ_A P08397 Porphobilinogen deaminase X-ray 1.79 2020-06-18 90.06 0.97 0.03 ok
7CD0_A P08397 Porphobilinogen deaminase X-ray 2.31 2020-06-18 90.06 0.97 0.03 ok
7CCX_A P08397 Porphobilinogen deaminase X-ray 1.84 2020-06-18 90.06 0.97 0.03 ok
7M05_A O14744 Protein arginine N-methyltransferase 5 EM 2.39 2021-03-10 93.31 0.97 0.03 ok
7DU2_H P52434 DNA-directed RNA polymerases I, II, and II EM 3.35 2021-01-07 84.25 0.97 0.02 ok
7DN3_H P52434 DNA-directed RNA polymerases I, II, and II EM 3.50 2020-12-08 84.25 0.97 0.02 ok
6X3E_A P43005 Excitatory amino acid transporter 3 EM 3.42 2020-05-21 80.12 0.98 0.02 ok
6X2Z_A P43005 Excitatory amino acid transporter 3 EM 3.03 2020-05-21 80.12 0.98 0.02 ok
7DU2_C O15160 DNA-directed RNA polymerases I and III sub EM 3.35 2021-01-07 92.12 0.98 0.02 ok
7DN3_C O15160 DNA-directed RNA polymerases I and III sub EM 3.50 2020-12-08 92.12 0.98 0.02 ok
6YXJ_B Q9H074 Polyadenylate-binding protein-interacting X-ray 3.50 2020-05-02 71.81 0.98 0.02 ok
7DU2_B Q9NW08 DNA-directed RNA polymerase III subunit RP EM 3.35 2021-01-07 89.00 0.98 0.01 ok
7DN3_B Q9NW08 DNA-directed RNA polymerase III subunit RP EM 3.50 2020-12-08 89.00 0.98 0.01 ok
6W51_B P61769 Beta-2-microglobulin X-ray 3.53 2020-03-12 94.06 0.98 0.01 ok
7DU2_A O14802 DNA-directed RNA polymerase III subunit RP EM 3.35 2021-01-07 88.31 0.99 0.01 ok
7DN3_A O14802 DNA-directed RNA polymerase III subunit RP EM 3.50 2020-12-08 88.31 0.99 0.01 ok
6W51_A A0A140T913 MHC class I antigen X-ray 3.53 2020-03-12 84.62 0.99 0.01 ok
6WU8_A Q06124 Tyrosine-protein phosphatase non-receptor X-ray 2.40 2020-05-04 85.94 0.99 0.01 ok
7M05_B Q9BQA1 Methylosome protein 50 EM 2.39 2021-03-10 91.00 0.99 0.01 ok
7L1A_A P31153 S-adenosylmethionine synthase isoform type X-ray 1.25 2020-12-14 96.06 0.99 0.01 ok
7JWZ_A P48736 Phosphatidylinositol 4,5-bisphosphate 3-ki X-ray 2.65 2020-08-26 87.81 0.99 0.01 ok
6Z6Q_A Q12797 Aspartyl/asparaginyl beta-hydroxylase X-ray 1.81 2020-05-29 71.81 0.99 0.01 ok
7JWE_A P48736 Phosphatidylinositol 4,5-bisphosphate 3-ki X-ray 2.55 2020-08-25 87.81 0.99 0.01 ok
6W4R_A Q9NUW8 Tyrosyl-DNA phosphodiesterase 1 X-ray 1.82 2020-03-11 80.62 0.99 0.01 ok
7LJE_A Q09472 Histone acetyltransferase p300 X-ray 2.61 2021-01-29 53.25 0.99 0.01 ok
7JX0_A P48736 Phosphatidylinositol 4,5-bisphosphate 3-ki X-ray 3.15 2020-08-26 87.81 0.99 0.01 ok
6Z6R_A Q12797 Aspartyl/asparaginyl beta-hydroxylase X-ray 2.13 2020-05-29 71.81 0.99 0.01 ok
6YYY_A Q12797 Aspartyl/asparaginyl beta-hydroxylase X-ray 2.29 2020-05-06 71.81 0.99 0.00 ok
6YYW_A Q12797 Aspartyl/asparaginyl beta-hydroxylase X-ray 2.27 2020-05-06 71.81 0.99 0.00 ok
7BI5_A P00918 Carbonic anhydrase 2 X-ray 1.74 2021-01-12 97.38 1.00 0.00 ok
6YYX_A Q12797 Aspartyl/asparaginyl beta-hydroxylase X-ray 1.53 2020-05-06 71.81 1.00 0.00 ok
6W5X_A Q9Y253 DNA polymerase eta X-ray 2.59 2020-03-14 76.88 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.