Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2019-05-15

83
structures analysed (60 full · 72.3%)
33.6%
confidently wrong
11.2%
novel sequences
00.0%
novel & wrong
0.951
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 3 of 83 structures (3.6%) are confidently wrong; median TM-score is 0.951.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.951 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6O85_I Q9NR50 Translation initiation factor eIF-2B subun EM 3.03 2019-03-08 0.00 74.31 0.94 0.65 18.33 13.70 0.38 ok
6O81_I Q9NR50 Translation initiation factor eIF-2B subun EM 3.21 2019-03-08 0.00 74.31 0.95 0.65 18.33 13.70 0.38 ok
6O9Z_I Q9NR50 Translation initiation factor eIF-2B subun EM 3.03 2019-03-15 0.00 74.31 0.94 0.65 19.27 13.66 0.38 ok
6GR8_B Q9NQS7 Inner centromere protein X-ray 1.75 2018-06-10 0.00 79.52 0.48 0.83 25.00 7.53 0.33 wrong
6GR9_B Q9NQS7 Inner centromere protein X-ray 2.25 2018-06-10 0.00 82.61 0.56 0.90 38.02 6.02 0.26 ok
6OGE_D P01834 Trastuzumab FAB LIGHT CHAIN EM 4.36 2019-04-02 0.00 97.03 0.39 0.59 52.57 3.24 0.19 wrong
6O81_S P41091 Eukaryotic translation initiation factor 2 EM 3.21 2019-03-08 0.50 87.07 0.87 0.68 57.13 4.20 0.17 ok
6O85_S P41091 Eukaryotic translation initiation factor 2 EM 3.03 2019-03-08 0.00 87.07 0.87 0.68 57.32 4.19 0.17 ok
6OGE_E Q6GMX6 Trastuzumab FAB HEAVY CHAIN EM 4.36 2019-04-02 0.00 89.84 0.79 0.72 55.56 3.19 0.16 ok
6Q9O_A Q00987 E3 ubiquitin-protein ligase Mdm2 X-ray 1.21 2018-12-18 0.00 90.16 0.88 0.86 58.24 5.22 0.16 ok
6JO8_M Q9BRK3 Matrix remodeling-associated protein 8 X-ray 3.50 2019-03-20 100.00 novel 90.75 0.84 0.85 58.33 2.97 0.15 ok
6EC0_A H6VRG1 Keratin 1 X-ray 2.98 2018-08-07 61.81 0.77 0.14 ok
6OGE_A P04626 Receptor tyrosine-protein kinase erbB-2 EM 4.36 2019-04-02 0.00 89.35 0.92 0.83 61.95 3.16 0.14 ok
6JPJ_A P22455 Fibroblast growth factor receptor 4 X-ray 2.64 2019-03-27 0.00 86.66 0.90 0.87 64.05 4.42 0.14 ok
6OGE_C P0DOX5 Pertuzumab FAB HEAVY CHAIN EM 4.36 2019-04-02 0.00 90.60 0.85 0.81 62.05 2.54 0.13 ok
6Q9L_A Q00987 E3 ubiquitin-protein ligase Mdm2 X-ray 1.13 2018-12-18 0.00 90.49 0.89 0.87 63.56 4.60 0.13 ok
6Q9H_A Q00987 E3 ubiquitin-protein ligase Mdm2 X-ray 2.00 2018-12-18 0.00 91.26 0.87 0.85 67.39 4.01 0.12 ok
6DE9_A Q9NZ45 CDGSH iron-sulfur domain-containing protei X-ray 1.95 2018-05-11 91.19 0.87 0.12 ok
6QI9_A Q9Y265 RuvB-like 1 EM 4.63 2019-01-18 0.00 89.49 0.91 0.80 71.29 5.80 0.12 ok
6QI9_D Q9Y230 RuvB-like 2 EM 4.63 2019-01-18 0.00 90.24 0.90 0.79 69.59 2.74 0.11 ok
6DFM_A P11021 Endoplasmic reticulum chaperone BiP X-ray 2.14 2018-05-15 90.00 0.87 0.11 ok
6DFO_A P11021 Endoplasmic reticulum chaperone BiP X-ray 2.54 2018-05-15 90.00 0.88 0.11 ok
6E2J_B P13645 Keratin, type I cytoskeletal 10 X-ray 2.39 2018-07-11 64.31 0.83 0.11 ok
6O85_L P05198 Eukaryotic translation initiation factor 2 EM 3.03 2019-03-08 1.40 80.55 0.89 0.90 67.27 2.25 0.11 ok
6O81_L P05198 Eukaryotic translation initiation factor 2 EM 3.21 2019-03-08 1.40 80.55 0.90 0.90 67.09 2.24 0.11 ok
6O9Z_L P05198 Eukaryotic translation initiation factor 2 EM 3.03 2019-03-15 1.40 80.08 0.89 0.80 70.88 2.64 0.10 ok
6JM9_X Q8TEK3 Histone-lysine N-methyltransferase, H3 lys EM 7.30 2019-03-07 0.00 89.87 0.93 0.85 73.25 2.00 0.10 ok
6GG1_A Q13007 Interleukin-24 X-ray 1.30 2018-05-02 83.38 0.88 0.10 ok
6OI4_E Q99460 26S proteasome non-ATPase regulatory subun X-ray 1.76 2019-04-08 54.84 0.48 0.93 62.50 2.40 0.08 ok
6O9Z_A Q13144 Translation initiation factor eIF-2B subun EM 3.03 2019-03-15 0.00 89.03 0.98 0.93 79.28 4.70 0.08 ok
6O85_A Q13144 Translation initiation factor eIF-2B subun EM 3.03 2019-03-08 0.00 89.03 0.98 0.93 80.40 4.62 0.08 ok
6ILK_E P08174 Complement decay-accelerating factor EM 3.00 2018-10-18 78.25 0.90 0.08 ok
6ILJ_E P08174 Complement decay-accelerating factor EM 3.60 2018-10-18 78.25 0.90 0.08 ok
6E2J_A P04264 Keratin, type II cytoskeletal 1 X-ray 2.39 2018-07-11 63.06 0.88 0.08 ok
6EC0_B P13645 Keratin, type I cytoskeletal 10 X-ray 2.98 2018-08-07 64.31 0.88 0.08 ok
6O81_A Q13144 Translation initiation factor eIF-2B subun EM 3.21 2019-03-08 0.30 86.93 0.98 0.92 80.81 4.86 0.08 ok
6JMA_X Q8TEK3 Histone-lysine N-methyltransferase, H3 lys EM 6.80 2019-03-07 0.00 89.87 0.95 0.84 85.06 1.74 0.07 ok
6OGE_B P01834 Pertuzumab FAB LIGHT CHAIN EM 4.36 2019-04-02 0.00 97.03 0.48 0.83 86.68 1.28 0.07 wrong
6O85_G Q14232 Translation initiation factor eIF-2B subun EM 3.03 2019-03-08 0.00 92.94 0.97 0.88 89.30 1.24 0.06 ok
6O81_G Q14232 Translation initiation factor eIF-2B subun EM 3.21 2019-03-08 0.00 92.94 0.97 0.89 89.47 1.19 0.06 ok
6OQD_A Q07820 Induced myeloid leukemia cell differentiat X-ray 1.48 2019-04-26 0.00 89.31 0.95 0.93 89.42 2.41 0.06 ok
6OQB_A Q07820 Induced myeloid leukemia cell differentiat X-ray 1.60 2019-04-26 0.00 89.42 0.95 0.93 89.84 2.37 0.06 ok
6ILM_F P61769 Beta-2-microglobulin EM 3.40 2018-10-19 94.06 0.95 0.05 ok
6O81_C P49770 Translation initiation factor eIF-2B subun EM 3.21 2019-03-08 0.00 89.74 0.98 0.90 91.48 1.13 0.05 ok
6O85_E Q9UI10 Translation initiation factor eIF-2B subun EM 3.03 2019-03-08 0.00 91.07 0.98 0.90 92.51 1.21 0.05 ok
6N9D_B P01033 Metalloproteinase inhibitor 1 X-ray 2.67 2018-12-03 2.80 93.94 0.96 0.92 94.00 1.25 0.05 ok
6O81_E Q9UI10 Translation initiation factor eIF-2B subun EM 3.21 2019-03-08 0.00 91.07 0.98 0.91 92.16 1.20 0.05 ok
6DCU_A P37231 Peroxisome proliferator-activated receptor X-ray 2.95 2018-05-08 76.12 0.94 0.05 ok
6O85_C P49770 Translation initiation factor eIF-2B subun EM 3.03 2019-03-08 0.00 89.74 0.98 0.91 92.90 1.10 0.05 ok
6NE4_A O75084 Frizzled-7 X-ray 1.65 2018-12-16 6.10 90.27 0.95 0.93 93.28 1.23 0.05 ok
6JMA_Y P0CG47 Ubiquitin EM 6.80 2019-03-07 0.00 94.12 0.93 0.90 93.75 1.04 0.04 ok
6O9Z_C P49770 Translation initiation factor eIF-2B subun EM 3.03 2019-03-15 0.00 89.74 0.98 0.93 92.90 1.08 0.04 ok
6Q9S_A O15151 Protein Mdm4 X-ray 2.40 2018-12-18 0.00 90.76 0.94 0.95 92.82 1.38 0.04 ok
6O9Z_E Q9UI10 Translation initiation factor eIF-2B subun EM 3.03 2019-03-15 0.00 91.37 0.98 0.92 93.98 1.10 0.04 ok
6OI4_C P0CG48 ubiquitin X-ray 1.76 2019-04-08 0.00 90.10 0.96 0.96 94.33 1.65 0.04 ok
6NE2_A O75084 Frizzled-7 X-ray 1.30 2018-12-15 6.10 90.27 0.95 0.93 94.12 1.23 0.04 ok
6OI4_A Q16186 Proteasomal ubiquitin receptor ADRM1 X-ray 1.76 2019-04-08 0.00 89.37 0.95 0.93 93.92 1.21 0.04 ok
6O9Z_G Q14232 Translation initiation factor eIF-2B subun EM 3.03 2019-03-15 0.00 92.75 0.98 0.93 96.12 0.96 0.04 ok
6Q96_A Q00987 E3 ubiquitin-protein ligase Mdm2 X-ray 1.80 2018-12-17 0.00 94.32 0.96 0.95 95.40 0.93 0.04 ok
6O6G_A Q07820 Induced myeloid leukemia cell differentiat X-ray 2.40 2019-03-06 0.00 90.85 0.97 0.93 94.66 0.95 0.04 ok
6NE1_A Q9ULV1 Frizzled-4 X-ray 3.01 2018-12-15 0.00 90.71 0.97 0.94 96.61 0.77 0.04 ok
6N6O_A P33981 Dual specificity protein kinase TTK X-ray 2.60 2018-11-26 0.00 93.26 0.99 0.96 96.85 1.06 0.04 ok
6NDZ_A Q9H461 Frizzled-8 X-ray 2.26 2018-12-14 0.00 88.64 0.96 0.93 95.49 0.98 0.04 ok
6OQN_A Q07820 Induced myeloid leukemia cell differentiat X-ray 1.70 2019-04-26 0.00 90.56 0.97 0.94 96.19 1.01 0.03 ok
6OQC_A Q07820 Induced myeloid leukemia cell differentiat X-ray 1.80 2019-04-26 0.00 90.31 0.97 0.94 95.23 1.17 0.03 ok
5ZWK_A Q2TU34 Fructose-1,6-bisphosphatase 1 X-ray 2.10 2018-05-15 94.50 0.96 0.03 ok
6O6F_A Q07820 Induced myeloid leukemia cell differentiat X-ray 1.60 2019-03-06 0.00 90.56 0.98 0.94 96.69 0.98 0.03 ok
6MAV_B P01033 Metalloproteinase inhibitor 1 X-ray 2.37 2018-08-28 89.62 0.96 0.03 ok
6GR8_A Q9UQB9 Aurora kinase C X-ray 1.75 2018-06-10 84.00 0.96 0.03 ok
6Q9Y_A O15151 Protein Mdm4 X-ray 1.20 2018-12-18 0.00 91.89 0.97 0.95 97.35 0.68 0.03 ok
6ILM_E P55899 IgG receptor FcRn large subunit p51 EM 3.40 2018-10-19 85.00 0.97 0.03 ok
6Q9U_A O15151 Protein Mdm4 X-ray 2.40 2018-12-18 0.00 91.69 0.97 0.97 97.97 0.69 0.03 ok
6N9D_A P08254 Stromelysin-1 X-ray 2.67 2018-12-03 0.00 92.05 0.98 0.96 97.67 0.71 0.03 ok
6Q9Q_A O15151 Protein Mdm4 X-ray 2.10 2018-12-18 0.00 92.38 0.98 0.98 100.00 0.46 0.03 ok
6DCX_A P62136 Serine/threonine-protein phosphatase PP1-a X-ray 3.41 2018-05-08 91.25 0.97 0.03 ok
6Q9W_A O15151 Protein Mdm4 X-ray 1.55 2018-12-18 0.00 91.69 0.98 0.97 98.55 0.53 0.02 ok
6OOV_A Q96FZ2 Embryonic stem cell-specific 5-hydroxymeth X-ray 2.20 2019-04-23 0.00 97.07 1.00 0.99 99.50 0.45 0.02 ok
6GR9_A Q9UQB9 Aurora kinase C X-ray 2.25 2018-06-10 84.00 0.98 0.02 ok
6MAV_A P08254 Stromelysin-1 X-ray 2.37 2018-08-28 85.69 0.98 0.02 ok
6GRA_A O14965 Aurora kinase A X-ray 2.60 2018-06-10 75.06 0.98 0.01 ok
6DCX_C Q8WUF5 RelA-associated inhibitor X-ray 3.41 2018-05-08 57.19 0.98 0.01 ok
6H0U_A P49841 Glycogen synthase kinase-3 beta X-ray 2.30 2018-07-10 88.25 0.99 0.01 ok
6IC2_A P00918 Carbonic anhydrase 2 X-ray 1.15 2018-12-01 97.38 0.99 0.01 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.