Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2022-12-21

105
structures analysed (10 full · 9.5%)
54.8%
confidently wrong
54.8%
novel sequences
21.9%
novel & wrong
0.95
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 5 of 105 structures (4.8%) are confidently wrong; median TM-score is 0.95.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.95 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
8BBG_A Q8NEZ3 WD repeat-containing protein 19 EM 3.50 2022-10-12 63.90 86.33 0.61 0.92 0.00 51.32 0.86 ok
8BBG_C Q9HBG6 Intraflagellar transport protein 122 homol EM 3.50 2022-10-12 75.90 novel 85.63 0.57 0.90 0.00 44.99 0.85 ok
8BBG_B Q96RY7 Intraflagellar transport protein 140 homol EM 3.50 2022-10-12 100.00 novel 81.13 0.51 0.86 1.30 29.49 0.77 ok
8BBG_D Q7Z4L5 SNAP-tag,Tetratricopeptide repeat protein EM 3.50 2022-10-12 0.60 83.14 0.60 0.87 3.59 14.00 0.66 ok
7T91_A P08151 Isoform 2 of Zinc finger protein GLI1 X-ray 2.05 2021-12-17 0.00 82.74 0.45 0.87 8.96 12.99 0.57 wrong
8BBG_F Q96FT9 Intraflagellar transport protein 43 homolo EM 3.50 2022-10-12 100.00 novel 84.23 0.42 0.81 32.02 7.01 0.34 wrong
8BBE_F Q96FT9 Intraflagellar transport protein 43 homolo EM 3.50 2022-10-12 100.00 novel 84.23 0.42 0.81 32.02 7.01 0.34 wrong
7WU7_1 O60925 Prefoldin subunit 1 EM 3.85 2022-02-07 93.06 0.73 0.25 ok
7WU7_5 Q99471 Prefoldin subunit 5 EM 3.85 2022-02-07 91.94 0.75 0.23 ok
7WU7_A P17987 T-complex protein 1 subunit alpha EM 3.85 2022-02-07 89.00 0.75 0.22 ok
8BBE_D Q7Z4L5 SNAP-tag,Tetratricopeptide repeat protein EM 3.50 2022-10-12 83.12 0.73 0.22 ok
8BBG_E Q9P2L0 WD repeat-containing protein 35 EM 3.50 2022-10-12 85.62 0.75 0.22 ok
7WU7_2 Q9UHV9 Prefoldin subunit 2 EM 3.85 2022-02-07 79.19 0.73 0.21 ok
8BBE_E Q9P2L0 WD repeat-containing protein 35 EM 3.50 2022-10-12 85.62 0.75 0.21 ok
8HKW_C Q12888 Peptide from TP53-binding protein 1 X-ray 1.90 2022-11-28 100.00 novel 34.80 0.19 0.48 10.71 10.51 0.21 ok
7WU7_3 P61758 Prefoldin subunit 3 EM 3.85 2022-02-07 86.00 0.76 0.21 ok
7WU7_6 O15212 Prefoldin subunit 6 EM 3.85 2022-02-07 94.38 0.79 0.20 ok
7WU7_G Q99832 T-complex protein 1 subunit eta EM 3.85 2022-02-07 88.88 0.79 0.19 ok
7W7Z_A Q05397 Isoform 5 of Focal adhesion kinase 1 X-ray 2.15 2021-12-07 74.50 0.75 0.18 ok
8HAF_P P12272 PTHrP[1-36] EM 3.25 2022-10-26 62.88 0.71 0.18 ok
8EOP_A Q8IZY2 Phospholipid-transporting ATPase ABCA7 EM 3.70 2022-10-04 75.38 0.76 0.18 ok
8GWR_A O94925 Glutaminase kidney isoform, mitochondrial X-ray 2.80 2022-09-17 80.19 0.80 0.16 ok
7WU7_4 Q9NQP4 Prefoldin subunit 4 EM 3.85 2022-02-07 87.44 0.83 0.15 ok
7WCN_A P63092 Guanine nucleotide-binding protein G(s) su EM 2.87 2021-12-20 91.31 0.86 0.13 ok
7WU7_C P49368 T-complex protein 1 subunit gamma EM 3.85 2022-02-07 89.06 0.86 0.13 ok
7WCM_A P63092 Guanine nucleotide-binding protein G(s) su EM 2.33 2021-12-20 91.31 0.86 0.13 ok
7WU7_H P50990 T-complex protein 1 subunit theta EM 3.85 2022-02-07 87.69 0.86 0.12 ok
7WU7_D P50991 T-complex protein 1 subunit delta EM 3.85 2022-02-07 89.69 0.86 0.12 ok
7WU7_E P48643 T-complex protein 1 subunit epsilon EM 3.85 2022-02-07 89.38 0.87 0.12 ok
8GZ3_B P04839 Cytochrome b-245 heavy chain EM 3.30 2022-09-24 90.25 0.87 0.11 ok
8BBE_C Q9HBG6 Intraflagellar transport protein 122 homol EM 3.50 2022-10-12 82.88 0.87 0.11 ok
8BI8_A P29475 Nitric oxide synthase, brain X-ray 1.59 2022-11-01 0.00 76.36 0.41 0.86 61.96 2.58 0.11 wrong
7WCN_C P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.87 2021-12-20 89.56 0.89 0.10 ok
8BLV_A O00560 Syntenin-1 X-ray 1.50 2022-11-10 83.00 0.88 0.10 ok
8EE6_A Q8IZY2 Phospholipid-transporting ATPase ABCA7 EM 4.00 2022-09-06 75.38 0.87 0.10 ok
8EDW_A Q8IZY2 Phospholipid-transporting ATPase ABCA7 EM 3.60 2022-09-06 75.38 0.87 0.10 ok
7WU7_B P78371 T-complex protein 1 subunit beta EM 3.85 2022-02-07 89.81 0.90 0.09 ok
7WU7_F P40227 T-complex protein 1 subunit zeta EM 3.85 2022-02-07 89.88 0.90 0.09 ok
8BI9_A P29475 Nitric oxide synthase, brain X-ray 1.44 2022-11-01 9.60 76.36 0.45 0.86 75.00 2.07 0.08 wrong
7WCM_C P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.33 2021-12-20 89.56 0.92 0.07 ok
7WCN_R Q8TDV5 Glucose-dependent insulinotropic receptor EM 2.87 2021-12-20 86.75 0.92 0.07 ok
7WCM_R Q8TDV5 Glucose-dependent insulinotropic receptor EM 2.33 2021-12-20 86.75 0.92 0.07 ok
8HA0_P P01270 Parathyroid hormone EM 2.62 2022-10-26 72.12 0.90 0.07 ok
8HAF_R Q03431 Parathyroid hormone/parathyroid hormone-re EM 3.25 2022-10-26 70.94 0.92 0.05 ok
8EEB_A Q8IZY2 Phospholipid-transporting ATPase ABCA7 EM 3.90 2022-09-06 75.38 0.93 0.05 ok
8AYH_C P01031 Complement C5 beta chain EM 3.35 2022-09-02 81.56 0.94 0.05 ok
7T9U_A Q86WV6 Stimulator of interferon genes protein X-ray 2.46 2021-12-20 83.75 0.94 0.05 ok
7W9U_A Q05397 Isoform 5 of Focal adhesion kinase 1 X-ray 2.16 2021-12-10 74.50 0.93 0.05 ok
8D4Y_A Q14839 Chromodomain-helicase-DNA-binding protein X-ray 2.90 2022-06-03 64.62 0.92 0.05 ok
7T9V_A Q86WV6 Stimulator of interferon genes protein X-ray 2.68 2021-12-20 83.75 0.94 0.05 ok
7W8I_A Q05397 Isoform 5 of Focal adhesion kinase 1 X-ray 1.94 2021-12-07 74.50 0.94 0.04 ok
7XYW_A Q9C0D3 Protein zyg-11 homolog B X-ray 2.50 2022-06-02 92.31 0.95 0.04 ok
7XYX_A Q9C0D3 Protein zyg-11 homolog B X-ray 2.87 2022-06-02 92.31 0.95 0.04 ok
8HAO_H P01270 Parathyroid hormone EM 3.76 2022-10-26 72.12 0.94 0.04 ok
7XYV_A Q9C0D3 Protein zyg-11 homolog B X-ray 2.52 2022-06-02 92.31 0.96 0.04 ok
8HA0_R Q03431 Parathyroid hormone/parathyroid hormone-re EM 2.62 2022-10-26 70.94 0.95 0.04 ok
7QG0_A Q6SZW1 NAD(+) hydrolase SARM1 EM 4.02 2021-12-07 85.69 0.96 0.03 ok
8AYH_A P01031 Complement C5 alpha chain EM 3.35 2022-09-02 81.56 0.96 0.03 ok
8HAO_I Q03431 Parathyroid hormone/parathyroid hormone-re EM 3.76 2022-10-26 70.94 0.95 0.03 ok
7PWZ_A P31947 14-3-3 protein sigma X-ray 2.50 2021-10-07 92.88 0.97 0.03 ok
7PWT_A P31947 14-3-3 protein sigma X-ray 2.31 2021-10-07 92.88 0.97 0.03 ok
7WNM_B Q9BYF1 Angiotensin-converting enzyme 2 X-ray 2.70 2022-01-18 90.69 0.97 0.03 ok
7XYU_A Q7Z7L7 Protein zer-1 homolog X-ray 2.70 2022-06-02 90.81 0.97 0.02 ok
7XYS_A Q7Z7L7 Protein zer-1 homolog X-ray 1.70 2022-06-02 90.81 0.98 0.02 ok
7UYH_B P0CG48 Ubiquitin X-ray 2.80 2022-05-06 88.62 0.98 0.02 ok
8BW4_A Q8WWQ0 PH-interacting protein X-ray 1.55 2022-12-06 66.06 0.97 0.02 ok
7TC3_A P27695 DNA-(apurinic or apyrimidinic site) endonu X-ray 1.25 2021-12-22 90.44 0.98 0.02 ok
8BW3_A Q8WWQ0 PH-interacting protein X-ray 1.30 2022-12-06 66.06 0.97 0.02 ok
7TC2_A P27695 DNA-(apurinic or apyrimidinic site) endonu X-ray 1.43 2021-12-22 90.44 0.98 0.02 ok
8E50_A Q9HCL2 Glycerol-3-phosphate acyltransferase 1, mi EM 3.67 2022-08-19 80.12 0.98 0.02 ok
8BW2_A Q8WWQ0 PH-interacting protein X-ray 1.35 2022-12-06 66.06 0.97 0.02 ok
8E4Y_A Q9HCL2 Glycerol-3-phosphate acyltransferase 1, mi EM 3.40 2022-08-19 80.12 0.98 0.02 ok
7S3V_A Q16719 Kynureninase X-ray 3.25 2021-09-08 95.44 0.99 0.01 ok
7QHJ_AA O60911 Cathepsin L2 X-ray 1.40 2021-12-13 92.94 0.99 0.01 ok
7QGW_A O60911 Cathepsin L2 X-ray 1.30 2021-12-10 92.94 0.99 0.01 ok
7QHK_AA O60911 Cathepsin L2 X-ray 1.83 2021-12-13 92.94 0.99 0.01 ok
8GZ3_A P13498 Cytochrome b-245 light chain EM 3.30 2022-09-24 76.88 0.98 0.01 ok
7QFH_AA O60911 Cathepsin L2 X-ray 1.52 2021-12-06 92.94 0.99 0.01 ok
7WCI_A P05413 Fatty acid-binding protein, heart X-ray 0.85 2021-12-20 96.19 0.99 0.01 ok
7QFF_AA O60911 Cathepsin L2 X-ray 1.50 2021-12-06 92.94 0.99 0.01 ok
8B2N_A P39900 Macrophage metalloelastase X-ray 1.85 2022-09-14 86.94 0.99 0.01 ok
7WDJ_A P05413 Fatty acid-binding protein, heart X-ray 0.90 2021-12-21 96.19 0.99 0.01 ok
7WD6_A P05413 Fatty acid-binding protein, heart X-ray 0.95 2021-12-21 96.19 0.99 0.01 ok
7WC3_A P15090 Fatty acid-binding protein, adipocyte X-ray 1.50 2021-12-18 95.75 0.99 0.01 ok
8D4U_A P08246 Neutrophil elastase X-ray 1.90 2022-06-02 88.19 0.99 0.01 ok
7QFM_A P11309 Serine/threonine-protein kinase pim-1 X-ray 1.95 2021-12-06 89.44 0.99 0.01 ok
8D4V_A P08311 Cathepsin G, C-terminal truncated form X-ray 1.85 2022-06-02 91.38 0.99 0.01 ok
7WCN_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.87 2021-12-20 97.06 0.99 0.01 ok
8DL3_A Q5T6V5 Queuosine salvage protein X-ray 2.26 2022-07-06 96.19 0.99 0.01 ok
8D4S_A P08311 Cathepsin G, C-terminal truncated form X-ray 1.95 2022-06-02 91.38 0.99 0.01 ok
7UGK_A Q5T6V5 Queuosine salvage protein DUF2419 X-ray 1.78 2022-03-24 96.19 0.99 0.01 ok
8HKW_A O00629 Importin subunit alpha-3 X-ray 1.90 2022-11-28 86.06 0.99 0.01 ok
8D4Q_A P08246 Neutrophil elastase X-ray 2.20 2022-06-02 88.19 0.99 0.01 ok
7X73_A Q96KQ7 Histone-lysine N-methyltransferase EHMT2 X-ray 1.49 2022-03-09 68.31 0.99 0.01 ok
7WCM_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.33 2021-12-20 97.06 1.00 0.00 ok
7QHD_A P06276 Cholinesterase X-ray 2.04 2021-12-12 93.38 1.00 0.00 ok
7OWR_A P30419 Glycylpeptide N-tetradecanoyltransferase 1 X-ray 2.39 2021-06-18 83.25 1.00 0.00 ok
7OWP_A P30419 Glycylpeptide N-tetradecanoyltransferase 1 X-ray 1.81 2021-06-18 83.25 1.00 0.00 ok
7QHE_A P06276 Cholinesterase X-ray 2.47 2021-12-12 93.38 1.00 0.00 ok
7OWQ_A P30419 Glycylpeptide N-tetradecanoyltransferase 1 X-ray 3.00 2021-06-18 83.25 1.00 0.00 ok
7UQ3_A Q8N371 Bifunctional peptidase and arginyl-hydroxy X-ray 1.49 2022-04-19 88.88 1.00 0.00 ok
7OWU_A P30419 Glycylpeptide N-tetradecanoyltransferase 1 X-ray 2.08 2021-06-18 83.25 1.00 0.00 ok
7OWN_A P30419 Glycylpeptide N-tetradecanoyltransferase 1 X-ray 2.10 2021-06-18 83.25 1.00 0.00 ok
7OWM_A P30419 Glycylpeptide N-tetradecanoyltransferase 1 X-ray 1.50 2021-06-18 83.25 1.00 0.00 ok
7OWO_A P30419 Glycylpeptide N-tetradecanoyltransferase 1 X-ray 1.70 2021-06-18 83.25 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.