Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2021-08-11

77
structures analysed (4 full · 5.2%)
00.0%
confidently wrong
00.0%
novel sequences
00.0%
novel & wrong
0.972
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 0 of 77 structures (0.0%) are confidently wrong; median TM-score is 0.972.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.972 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7D9U_B Q02153 Guanylate cyclase soluble subunit beta-1 EM 3.80 2020-10-14 0.00 88.50 0.54 0.86 2.55 18.57 0.74 ok
7D9T_A Q02108 Guanylate cyclase soluble subunit alpha-1 EM 4.10 2020-10-14 0.50 88.19 0.52 0.87 4.98 14.50 0.70 ok
7D9U_A Q02108 Guanylate cyclase soluble subunit alpha-1 EM 3.80 2020-10-14 0.50 88.88 0.60 0.87 9.88 12.66 0.58 ok
7D9R_B Q02153 Guanylate cyclase soluble subunit beta-1 EM 3.70 2020-10-14 85.38 0.53 0.40 ok
7D9S_B Q02153 Guanylate cyclase soluble subunit beta-1 EM 3.90 2020-10-14 85.38 0.54 0.40 ok
7D9T_B Q02153 Guanylate cyclase soluble subunit beta-1 EM 4.10 2020-10-14 85.38 0.55 0.38 ok
7D9S_A Q02108 Guanylate cyclase soluble subunit alpha-1 EM 3.90 2020-10-14 77.44 0.61 0.30 ok
7D9R_A Q02108 Guanylate cyclase soluble subunit alpha-1 EM 3.70 2020-10-14 77.44 0.62 0.30 ok
7CPD_E Q9H169 Stathmin-4 X-ray 2.51 2020-08-06 84.19 0.77 0.20 ok
7ONU_E O15091 Mitochondrial ribonuclease P catalytic sub EM 3.00 2021-05-26 78.94 0.78 0.17 ok
7DUR_R P43220 Glucagon-like peptide 1 receptor EM 3.30 2021-01-11 81.50 0.83 0.14 ok
7LWH_B O95835 Serine/threonine-protein kinase LATS1 X-ray 1.61 2021-03-01 0.00 42.28 0.46 0.70 31.52 5.47 0.14 ok
7P0M_A P36776 Lon protease homolog, mitochondrial EM 2.75 2021-06-30 76.69 0.84 0.13 ok
7P09_A P36776 Lon protease homolog, mitochondrial EM 2.70 2021-06-29 76.69 0.84 0.12 ok
7EVM_A P63092 Guanine nucleotide-binding protein G(s) su EM 2.50 2021-05-21 91.31 0.87 0.12 ok
7DUR_A P63092 Guanine nucleotide-binding protein G(s) su EM 3.30 2021-01-11 91.31 0.88 0.11 ok
7LRG_G Q14896 Myosin-binding protein C, cardiac-type EM 6.10 2021-02-16 78.81 0.86 0.11 ok
7P0B_A P36776 Lon protease homolog, mitochondrial EM 4.11 2021-06-29 76.69 0.88 0.09 ok
7OFV_A P54764 Ephrin type-A receptor 4 X-ray 1.43 2021-05-05 83.50 0.90 0.09 ok
7COW_S P07305 Histone H1.0 X-ray 2.86 2020-08-05 68.75 0.89 0.08 ok
7ONU_F Q7L0Y3 tRNA methyltransferase 10 homolog C EM 3.00 2021-05-26 78.19 0.90 0.08 ok
6XQI_F P54725 UV excision repair protein RAD23 homolog A X-ray 2.34 2020-07-09 69.38 0.90 0.07 ok
7LDG_A O75031 Heat shock factor 2-binding protein X-ray 2.56 2021-01-13 91.00 0.94 0.05 ok
7LWH_A P35240 Merlin X-ray 1.61 2021-03-01 87.38 0.95 0.05 ok
7BO6_B Q15788 Nuclear receptor coactivator 1 X-ray 2.86 2021-01-24 46.72 0.90 0.05 ok
7COW_C P04908 Histone H2A type 1-B/E X-ray 2.86 2020-08-05 90.75 0.95 0.04 ok
7RNV_A P52735 Guanine nucleotide exchange factor VAV2 X-ray 2.15 2021-07-29 83.12 0.95 0.04 ok
7NL0_C P04908 Histone H2A type 1-B/E EM 3.50 2021-02-19 90.75 0.95 0.04 ok
7RNS_A P27986 Isoform 2 of Phosphatidylinositol 3-kinase X-ray 1.14 2021-07-29 83.19 0.95 0.04 ok
7LAJ_A U3KQA6 Bromodomain-containing protein 2 X-ray 1.85 2021-01-06 63.44 0.94 0.04 ok
7L4W_A Q99685 Monoglyceride lipase X-ray 2.20 2020-12-21 93.88 0.96 0.03 ok
7L4T_A Q99685 Monoglyceride lipase X-ray 2.20 2020-12-21 93.88 0.96 0.03 ok
7LAH_A U3KQA6 Bromodomain-containing protein 2 X-ray 1.60 2021-01-06 63.44 0.95 0.03 ok
7RNN_D P78348 Acid-sensing ion channel 1 EM 2.86 2021-07-29 83.75 0.97 0.03 ok
7L4U_A Q99685 Monoglyceride lipase X-ray 2.25 2020-12-21 93.88 0.97 0.03 ok
7EVM_R P43220 Glucagon-like peptide 1 receptor EM 2.50 2021-05-21 81.50 0.97 0.03 ok
7LAI_A U3KQA6 Bromodomain-containing protein 2 X-ray 1.85 2021-01-06 63.44 0.96 0.02 ok
7DFW_A Q9UHC9 NPC1-like intracellular cholesterol transp EM 2.69 2020-11-10 84.19 0.97 0.02 ok
7COW_B P62805 Histone H4 X-ray 2.86 2020-08-05 89.81 0.97 0.02 ok
7CP4_A O96013 Serine/threonine-protein kinase PAK 4 X-ray 2.50 2020-08-06 70.06 0.97 0.02 ok
7P5J_A Q9H313 Protein tweety homolog 1 EM 4.00 2021-07-14 89.62 0.98 0.02 ok
7NQ4_B Q9H974 Queuine tRNA-ribosyltransferase accessory X-ray 2.88 2021-03-01 89.75 0.98 0.02 ok
7NL0_B P62805 Histone H4 EM 3.50 2021-02-19 89.81 0.98 0.02 ok
7M5L_A P12004 Proliferating cell nuclear antigen X-ray 3.00 2021-03-24 94.31 0.98 0.02 ok
7RNU_A O00459 Phosphatidylinositol 3-kinase regulatory s X-ray 1.45 2021-07-29 81.62 0.98 0.02 ok
7NLD_A Q9NZQ7 Programmed cell death 1 ligand 1 X-ray 2.30 2021-02-22 88.25 0.98 0.02 ok
7NQ4_A Q9BXR0 Queuine tRNA-ribosyltransferase catalytic X-ray 2.88 2021-03-01 93.69 0.98 0.02 ok
7EDO_E P61769 Beta-2-microglobulin X-ray 2.70 2021-03-16 94.06 0.98 0.02 ok
7COW_D P06899 Histone H2B type 1-J X-ray 2.86 2020-08-05 85.50 0.98 0.02 ok
7EHM_A P13995 Bifunctional methylenetetrahydrofolate deh X-ray 2.13 2021-03-30 89.62 0.98 0.02 ok
7DFZ_A Q9UHC9 NPC1-like intracellular cholesterol transp EM 3.58 2020-11-10 84.19 0.98 0.02 ok
7M5M_A P12004 Proliferating cell nuclear antigen X-ray 3.00 2021-03-24 94.31 0.98 0.02 ok
7EHN_A P13995 Bifunctional methylenetetrahydrofolate deh X-ray 2.25 2021-03-30 89.62 0.98 0.02 ok
7EHV_A P13995 Bifunctional methylenetetrahydrofolate deh X-ray 2.61 2021-03-30 89.62 0.98 0.02 ok
7JUL_A P60484 Phosphatidylinositol 3,4,5-trisphosphate 3 X-ray 2.53 2020-08-20 83.00 0.98 0.02 ok
7EDO_B P61769 Beta-2-microglobulin X-ray 2.70 2021-03-16 94.06 0.98 0.01 ok
7COW_A P68431 Histone H3.1 X-ray 2.86 2020-08-05 86.06 0.98 0.01 ok
7CNU_A Q96FJ2 Dynein light chain 2, cytoplasmic X-ray 2.00 2020-08-03 95.56 0.98 0.01 ok
7CP3_A O96013 Serine/threonine-protein kinase PAK 4 X-ray 2.90 2020-08-05 70.06 0.98 0.01 ok
7M5N_A P12004 Proliferating cell nuclear antigen X-ray 3.11 2021-03-24 94.31 0.99 0.01 ok
7ONU_A Q99714 3-hydroxyacyl-CoA dehydrogenase type-2 EM 3.00 2021-05-26 96.88 0.99 0.01 ok
7RBQ_A Q6P2P2 Protein arginine N-methyltransferase 9 X-ray 2.20 2021-07-06 86.62 0.98 0.01 ok
7LWD_A P31645 Sodium-dependent serotonin transporter EM 3.65 2021-03-01 84.69 0.98 0.01 ok
7M22_N O60462 Neuropilin-2 EM 3.65 2021-03-15 78.62 0.98 0.01 ok
7NL0_D P06899 Histone H2B type 1-J EM 3.50 2021-02-19 85.50 0.99 0.01 ok
7P5C_A Q9C0H2 Protein tweety homolog 3 EM 3.20 2021-07-14 79.44 0.99 0.01 ok
7P54_A Q9BSA4 Protein tweety homolog 2 EM 3.30 2021-07-14 82.00 0.99 0.01 ok
7P5M_A Q9BSA4 Protein tweety homolog 2 EM 3.92 2021-07-14 82.00 0.99 0.01 ok
7L1X_A P68400 Casein kinase II subunit alpha X-ray 1.80 2020-12-15 88.94 0.99 0.01 ok
7OM8_B P63010 AP-2 complex subunit beta EM 10.50 2021-05-21 82.56 0.99 0.01 ok
7NL0_A P68431 Histone H3.1 EM 3.50 2021-02-19 86.06 0.99 0.01 ok
7M4T_A O00255 Menin X-ray 2.74 2021-03-22 84.44 0.99 0.01 ok
7L50_A Q99685 Monoglyceride lipase X-ray 2.30 2020-12-21 93.88 0.99 0.01 ok
7LAU_A U3KQA6 Bromodomain-containing protein 2 X-ray 2.40 2021-01-06 63.44 0.99 0.01 ok
7EHJ_A P13995 Bifunctional methylenetetrahydrofolate deh X-ray 2.16 2021-03-29 89.62 0.99 0.01 ok
7OUP_A Q9NY33 Dipeptidyl peptidase 3 X-ray 2.65 2021-06-12 95.31 1.00 0.00 ok
7JS8_A Q92769 Histone deacetylase 2 X-ray 1.63 2020-08-14 85.56 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.