Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2022-06-29

98
structures analysed (19 full · 19.4%)
11.0%
confidently wrong
11.0%
novel sequences
00.0%
novel & wrong
0.954
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 1 of 98 structures (1.0%) are confidently wrong; median TM-score is 0.954.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.954 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7VZF_A P00441 Superoxide dismutase [Cu-Zn] EM 2.95 2021-11-16 0.00 98.17 0.17 0.49 0.00 25.29 0.95 wrong
7UKH_A Q9NZV8 Potassium voltage-gated channel subfamily EM 2.33 2022-04-01 62.30 83.76 0.59 0.77 4.64 16.52 0.68 ok
7SME_B Q13547 Histone deacetylase 1 X-ray 2.64 2021-10-25 68.20 0.39 0.73 32.50 5.06 0.21 ok
7SMD_B Q9Y6B2 EP300-interacting inhibitor of differentia X-ray 2.15 2021-10-25 65.54 0.22 0.54 42.86 4.41 0.18 ok
7XJK_A P22466 Galanin EM 3.30 2022-04-18 100.00 novel 66.98 0.45 0.62 48.44 4.07 0.17 ok
7OXN_A P05067 Amyloid-beta precursor protein X-ray 2.50 2021-06-22 32.72 0.47 0.41 19.64 7.79 0.16 ok
7TRB_C Q15788 co-activator X-ray 2.15 2022-01-28 46.72 0.67 0.15 ok
7S6H_B P09874 Poly [ADP-ribose] polymerase 1 X-ray 3.10 2021-09-14 82.38 0.83 0.14 ok
7MYJ_B Q9Y478 5'-AMP-activated protein kinase subunit be X-ray 2.95 2021-05-21 77.69 0.82 0.14 ok
7UKG_I P42658 Dipeptidyl-peptidase 6 EM 2.24 2022-04-01 86.69 0.84 0.14 ok
7S6M_B P09874 Poly [ADP-ribose] polymerase 1 X-ray 3.20 2021-09-14 82.38 0.84 0.13 ok
7OW1_A P05067 Amyloid-beta precursor protein X-ray 1.40 2021-06-16 32.15 0.60 0.43 27.50 6.06 0.12 ok
7X2C_A P63092 Guanine nucleotide-binding protein G(s) su EM 3.20 2022-02-25 91.31 0.87 0.11 ok
7F50_A P0DMV9 Heat shock 70 kDa protein 1B X-ray 1.70 2021-06-21 88.69 0.88 0.11 ok
7F4Z_A P0DMV9 Heat shock 70 kDa protein 1B X-ray 1.80 2021-06-21 88.69 0.88 0.10 ok
7UNM_A Q9BSA9 Endosomal/lysosomal potassium channel TMEM EM 2.61 2022-04-11 81.75 0.88 0.10 ok
7F4X_A P0DMV9 Heat shock 70 kDa protein 1B Multiple methods 1.60 2021-06-21 88.69 0.89 0.10 ok
7MYJ_A P54646 5'-AMP-activated protein kinase catalytic X-ray 2.95 2021-05-21 76.69 0.89 0.09 ok
7XJK_D P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.30 2022-04-18 89.56 0.90 0.09 ok
7TTI_A Q9UP95 Solute carrier family 12 member 4 EM 3.50 2022-02-01 81.56 0.89 0.09 ok
7X8S_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.09 2022-03-14 89.56 0.90 0.09 ok
7X2C_F P21728 D(1A) dopamine receptor EM 3.20 2022-02-25 72.44 0.89 0.08 ok
7XJL_A Q9BT56 spexin EM 3.50 2022-04-18 69.36 0.60 0.79 73.21 2.17 0.08 ok
5SAV_A Q08345 Epithelial discoidin domain-containing rec X-ray 1.76 2021-06-22 1.90 88.22 0.94 0.92 82.39 3.42 0.08 ok
7SMC_B P29374 AT-rich interactive domain-containing prot X-ray 2.70 2021-10-25 44.17 0.23 0.66 56.82 2.77 0.08 ok
7XJL_D P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.50 2022-04-18 89.56 0.92 0.07 ok
7X8S_R P43220 Glucagon-like peptide 1 receptor EM 3.09 2022-03-14 81.50 0.91 0.07 ok
7UKF_A Q9NZV8 Potassium voltage-gated channel subfamily EM 3.02 2022-04-01 71.50 0.90 0.07 ok
7X8R_R P43220 Glucagon-like peptide 1 receptor EM 2.61 2022-03-14 81.50 0.91 0.07 ok
7UKH_I Q9NS61 Isoform 2 of Kv channel-interacting protei EM 2.33 2022-04-01 69.31 0.90 0.07 ok
7X2C_D P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2022-02-25 89.56 0.92 0.07 ok
7UKC_A Q9NZV8 Potassium voltage-gated channel subfamily EM 3.00 2022-04-01 71.50 0.91 0.07 ok
7S68_B P09874 Poly [ADP-ribose] polymerase 1 X-ray 3.30 2021-09-13 82.38 0.92 0.06 ok
7TA6_A P01375 Tumor necrosis factor X-ray 2.67 2021-12-20 84.56 0.92 0.06 ok
5SAU_A Q08345 Epithelial discoidin domain-containing rec X-ray 1.80 2021-06-22 1.90 88.17 0.95 0.90 88.33 2.68 0.06 ok
7UKD_A Q9NZV8 Potassium voltage-gated channel subfamily EM 2.88 2022-04-01 71.50 0.91 0.06 ok
7XJL_F O43603 Galanin receptor type 2 EM 3.50 2022-04-18 77.94 0.92 0.06 ok
5SAX_A Q08345 Epithelial discoidin domain-containing rec X-ray 1.90 2021-06-22 1.90 87.84 0.95 0.90 88.49 2.73 0.06 ok
7XJK_F O43603 Galanin receptor type 2 EM 3.30 2022-04-18 77.94 0.93 0.06 ok
5SAY_A Q08345 Epithelial discoidin domain-containing rec X-ray 2.19 2021-06-22 1.90 88.28 0.97 0.92 88.62 2.17 0.06 ok
5SAW_A Q08345 Epithelial discoidin domain-containing rec X-ray 1.60 2021-06-22 1.90 89.02 0.97 0.92 90.38 2.18 0.05 ok
7TA3_B P01375 Tumor necrosis factor X-ray 2.50 2021-12-20 84.56 0.94 0.05 ok
7UKE_A Q9NZV8 Potassium voltage-gated channel subfamily EM 3.01 2022-04-01 71.50 0.93 0.05 ok
5SB2_A Q08345 Epithelial discoidin domain-containing rec X-ray 1.60 2021-06-22 1.90 89.09 0.96 0.93 91.26 1.35 0.05 ok
7TTH_A Q9UP95 Solute carrier family 12 member 4 EM 3.25 2022-02-01 81.56 0.94 0.05 ok
7S81_B P09874 Poly [ADP-ribose] polymerase 1 X-ray 3.60 2021-09-17 82.38 0.94 0.05 ok
5SAZ_A Q08345 Epithelial discoidin domain-containing rec X-ray 1.80 2021-06-22 1.90 88.88 0.97 0.90 90.78 1.73 0.05 ok
7S81_C P09874 Poly [ADP-ribose] polymerase 1 X-ray 3.60 2021-09-17 82.38 0.95 0.05 ok
7ZDD_D P0DPK5 Histone H3.X X-ray 1.62 2022-03-29 56.07 0.41 0.92 80.00 1.38 0.04 ok
7UKG_A Q9NZV8 Potassium voltage-gated channel subfamily EM 2.24 2022-04-01 71.50 0.94 0.04 ok
7F68_A P01111 GTPase NRas X-ray 1.24 2021-06-24 92.06 0.95 0.04 ok
5SB0_A Q08345 Epithelial discoidin domain-containing rec X-ray 1.97 2021-06-22 1.90 88.91 0.97 0.93 92.43 1.49 0.04 ok
5SB1_A Q08345 Epithelial discoidin domain-containing rec X-ray 1.53 2021-06-22 1.90 88.91 0.97 0.93 92.08 1.47 0.04 ok
7S68_A P09874 Fusion of PARP1 zinc fingers 1 and 3 (Zn1, X-ray 3.30 2021-09-13 82.38 0.95 0.04 ok
7XGJ_A P08253 Matrix metalloproteinase-2 X-ray 2.80 2022-04-05 89.75 0.95 0.04 ok
7R80_D P61769 Beta-2-microglobulin X-ray 2.90 2021-06-25 94.06 0.96 0.04 ok
7UK5_A Q9NZV8 Potassium voltage-gated channel subfamily EM 2.76 2022-03-31 71.50 0.94 0.04 ok
7S81_A P09874 Poly [ADP-ribose] polymerase 1 X-ray 3.60 2021-09-17 82.38 0.96 0.04 ok
7X8R_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.61 2022-03-14 89.56 0.96 0.04 ok
7XJO_A P08253 Matrix metalloproteinase-2 X-ray 2.00 2022-04-18 89.75 0.96 0.03 ok
8A3P_A Q8NB37 Glutamine amidotransferase-like class 1 do X-ray 2.70 2022-06-08 94.88 0.97 0.03 ok
7S6M_A P09874 Fusion of human PARP1 zinc fingers 1 and 3 X-ray 3.20 2021-09-14 82.38 0.97 0.03 ok
7S6H_A P09874 Fusion of human PARP1 zinc fingers 1 and 3 X-ray 3.10 2021-09-14 82.38 0.97 0.03 ok
8A3O_A O95825 Quinone oxidoreductase-like protein 1 X-ray 2.90 2022-06-08 91.75 0.97 0.02 ok
7TRB_A Q96RI1 Bile acid receptor X-ray 2.15 2022-01-28 68.81 0.96 0.02 ok
7L5O_A Q06187 Tyrosine-protein kinase BTK X-ray 1.21 2020-12-22 84.44 0.97 0.02 ok
7R80_C S6BVK3 MHC class I antigen X-ray 2.90 2021-06-25 86.25 0.97 0.02 ok
7MYJ_E P54619 5'-AMP-activated protein kinase subunit ga X-ray 2.95 2021-05-21 86.56 0.98 0.02 ok
7XI7_A P00374 Dihydrofolate reductase X-ray 1.65 2022-04-12 96.12 0.98 0.02 ok
7WM3_A P22626 Heterogeneous nuclear ribonucleoproteins A X-ray 1.62 2022-01-14 69.19 0.97 0.02 ok
7L5P_A Q06187 Tyrosine-protein kinase BTK X-ray 2.14 2020-12-22 84.44 0.98 0.02 ok
7XXA_E P55899 IgG receptor FcRn large subunit p51 EM 3.09 2022-05-29 85.00 0.98 0.02 ok
7Z9F_A P07478 Trypsin-2 X-ray 1.70 2022-03-21 92.06 0.98 0.02 ok
7R7W_B P61769 Beta-2-microglobulin X-ray 1.17 2021-06-25 94.06 0.98 0.02 ok
7R7Y_B P61769 Beta-2-microglobulin X-ray 1.60 2021-06-25 94.06 0.98 0.02 ok
7Z7E_A Q9H3D4 Isoform 4 of Tumor protein 63 X-ray 1.80 2022-03-15 63.19 0.98 0.01 ok
7R7V_B P61769 Beta-2-microglobulin X-ray 1.60 2021-06-25 94.06 0.98 0.01 ok
7SME_A P28749 Retinoblastoma-like protein 1 X-ray 2.64 2021-10-25 71.75 0.98 0.01 ok
7SMC_A P28749 Retinoblastoma-like protein 1 X-ray 2.70 2021-10-25 71.75 0.98 0.01 ok
7ZDD_A Q9UPN9 E3 ubiquitin-protein ligase TRIM33 X-ray 1.62 2022-03-29 60.84 0.98 0.01 ok
7SMF_A P28749 Retinoblastoma-like protein 1 X-ray 3.00 2021-10-25 71.75 0.98 0.01 ok
7SMD_A P28749 Retinoblastoma-like protein 1 X-ray 2.15 2021-10-25 71.75 0.98 0.01 ok
7R7R_A Q9UM73 ALK tyrosine kinase receptor X-ray 1.94 2021-06-25 68.19 0.98 0.01 ok
7NAM_A O75581 Low-density lipoprotein receptor-related p X-ray 1.60 2021-06-21 79.19 0.99 0.01 ok
7R7X_B P61769 Beta-2-microglobulin X-ray 2.10 2021-06-25 94.06 0.99 0.01 ok
7R7X_A U6BR87 MHC class I antigen X-ray 2.10 2021-06-25 90.00 0.99 0.01 ok
7XJK_C P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.30 2022-04-18 97.06 0.99 0.01 ok
7R7K_A Q9UM73 ALK tyrosine kinase receptor X-ray 1.83 2021-06-24 68.19 0.99 0.01 ok
7XJL_C P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.50 2022-04-18 97.06 0.99 0.01 ok
7X2C_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2022-02-25 97.06 0.99 0.01 ok
7R7V_A S6BVK3 MHC class I antigen X-ray 1.60 2021-06-25 86.25 0.99 0.00 ok
7V5T_A Q13867 Bleomycin hydrolase X-ray 3.25 2021-08-18 98.00 1.00 0.00 ok
7Z9F_B P07478 Trypsin-2 X-ray 1.70 2022-03-21 92.06 1.00 0.00 ok
7V5S_A Q13867 Bleomycin hydrolase X-ray 3.02 2021-08-18 98.00 1.00 0.00 ok
7R7W_A S6BVK3 MHC class I antigen X-ray 1.17 2021-06-25 86.25 1.00 0.00 ok
7XF9_A Q13867 Bleomycin hydrolase X-ray 3.20 2022-04-01 98.00 1.00 0.00 ok
7R7Y_A U6BR87 MHC class I antigen X-ray 1.60 2021-06-25 90.00 1.00 0.00 ok
7V5L_A Q13867 Bleomycin hydrolase X-ray 1.74 2021-08-17 98.00 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.