Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2024-07-24

118
structures analysed (17 full · 14.4%)
54.2%
confidently wrong
54.2%
novel sequences
00.0%
novel & wrong
0.95
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 5 of 118 structures (4.2%) are confidently wrong; median TM-score is 0.95.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.95 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
9CK3_A P37840 Alpha-synuclein EM 2.04 2024-07-08 0.00 85.40 0.25 0.26 3.93 23.42 0.75 wrong
9BQ2_B O75955 Flotillin-1 EM 3.50 2024-05-08 49.30 82.17 0.41 0.86 3.67 20.27 0.70 wrong
8XVT_N Q15906 Vacuolar protein sorting-associated protei EM 3.20 2024-01-15 0.00 83.09 0.34 0.69 2.83 17.95 0.70 wrong
8XVG_N Q15906 Vacuolar protein sorting-associated protei EM 9.40 2024-01-15 0.00 83.09 0.34 0.69 2.83 17.95 0.70 wrong
9BQ2_A J3QLD9 Flotillin-2 EM 3.50 2024-05-08 9.80 80.55 0.52 0.88 5.60 20.12 0.65 ok
8THO_A Q9H165 B-cell lymphoma/leukemia 11A NMR 2023-07-17 60.50 78.00 0.32 0.55 13.50 11.32 0.47 wrong
8XVT_G Q9NPF5 DNA methyltransferase 1-associated protein EM 3.20 2024-01-15 0.00 86.48 0.63 0.79 18.16 10.82 0.47 ok
8XVG_G Q9NPF5 DNA methyltransferase 1-associated protein EM 9.40 2024-01-15 0.00 86.48 0.63 0.79 18.16 10.82 0.47 ok
9FOR_A Q13148 TAR DNA-binding protein 43 EM 2.75 2024-06-12 0.00 44.41 0.27 0.36 1.21 22.51 0.42 ok
8PR7_C Q8TEP8 Centrosomal protein of 192 kDa X-ray 2.76 2023-07-12 100.00 novel 48.21 0.34 0.62 1.17 15.31 0.41 ok
9FOF_A Q13148 TAR DNA-binding protein 43 EM 2.90 2024-06-11 0.00 44.27 0.29 0.40 1.95 19.13 0.39 ok
8XVT_M Q9H2F5 Isoform 2 of Enhancer of polycomb homolog EM 3.20 2024-01-15 76.00 novel 66.86 0.45 0.63 21.93 9.76 0.32 ok
8XVG_M Q9H2F5 Isoform 2 of Enhancer of polycomb homolog EM 9.40 2024-01-15 76.00 novel 66.86 0.45 0.63 21.93 9.76 0.32 ok
9FOR_B P50995 Annexin A11 EM 2.75 2024-06-12 100.00 novel 37.08 0.30 0.42 6.25 14.49 0.28 ok
9FOF_B P50995 Annexin A11 EM 2.90 2024-06-11 100.00 novel 37.08 0.29 0.42 7.64 14.53 0.28 ok
8K4O_F P09341 Growth-regulated alpha protein EM 3.01 2023-07-20 80.81 0.71 0.23 ok
8PTS_A Q16774 Guanylate kinase X-ray 1.76 2023-07-14 93.94 0.78 0.21 ok
8XVT_A Q9Y265 RuvB-like 1 EM 3.20 2024-01-15 87.56 0.79 0.19 ok
8XVG_A Q9Y265 RuvB-like 1 EM 9.40 2024-01-15 87.56 0.79 0.19 ok
8K4P_C P63096 Guanine nucleotide-binding protein G(i) su EM 2.81 2023-07-20 93.75 0.82 0.17 ok
8XVT_B Q9Y230 RuvB-like 2 EM 3.20 2024-01-15 84.12 0.81 0.16 ok
8XVG_B Q9Y230 RuvB-like 2 EM 9.40 2024-01-15 84.12 0.81 0.16 ok
8K4O_C P63096 Guanine nucleotide-binding protein G(I) su EM 3.01 2023-07-20 93.75 0.83 0.16 ok
9IJ9_A P63096 Guanine nucleotide-binding protein G(i) su EM 2.70 2024-06-21 93.75 0.84 0.15 ok
8KE7_A Q02880 DNA topoisomerase 2-beta X-ray 2.80 2023-08-11 73.44 0.83 0.13 ok
8OPT_B Q9H9Z2 Protein lin-28 homolog A EM 3.65 2023-04-08 5.80 89.20 0.52 0.69 64.88 2.47 0.13 ok
8W50_A P11388 DNA topoisomerase 2-alpha X-ray 2.67 2023-08-25 74.88 0.85 0.12 ok
8OPS_B Q9H9Z2 Protein lin-28 homolog A EM 3.82 2023-04-08 5.80 89.20 0.61 0.75 69.64 2.30 0.11 ok
9FGQ_D P33778 Histone H2B type 1-B EM 2.50 2024-05-24 88.12 0.88 0.10 ok
9CMH_A O14493 Claudin-4 EM 4.00 2024-07-15 84.56 0.89 0.09 ok
9IJA_R Q9NYV8 Taste receptor type 2 member 14 EM 3.05 2024-06-21 81.75 0.89 0.09 ok
9IJ9_R Q9NYV8 Taste receptor type 2 member 14 EM 2.70 2024-06-21 81.75 0.89 0.09 ok
9IIW_R Q9NYV8 Taste receptor type 2 member 14 EM 3.15 2024-06-21 81.75 0.89 0.09 ok
8YI7_A P29459 Interleukin-12 subunit alpha EM 3.57 2024-02-29 79.00 0.89 0.09 ok
8XRP_A P29459 Interleukin-12 subunit alpha EM 3.75 2024-01-07 79.00 0.89 0.09 ok
9IIX_R Q9NYV8 Taste receptor type 2 member 14 EM 2.89 2024-06-21 81.75 0.90 0.09 ok
8YI7_D P42701 Interleukin-12 receptor subunit beta-1 EM 3.57 2024-02-29 77.50 0.90 0.08 ok
8XRP_D P42701 Interleukin-12 receptor subunit beta-1 EM 3.75 2024-01-07 77.50 0.90 0.08 ok
8XOK_A O15439 ATP-binding cassette sub-family C member 4 EM 2.84 2024-01-01 83.06 0.91 0.07 ok
8ZSV_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.96 2024-06-05 89.56 0.92 0.07 ok
8K4O_G P59768 Guanine nucleotide-binding protein subunit EM 3.01 2023-07-20 89.56 0.92 0.07 ok
9IIX_C P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.89 2024-06-21 89.56 0.92 0.07 ok
9BDP_ANG P03950 Angiogenin EM 3.70 2024-04-12 89.81 0.93 0.07 ok
9BDN_ANG P03950 Angiogenin EM 3.10 2024-04-12 89.81 0.93 0.06 ok
8K4P_G P59768 Guanine nucleotide-binding protein subunit EM 2.81 2023-07-20 89.56 0.93 0.06 ok
9FGQ_C Q6FI13 Histone H2A type 2-A EM 2.50 2024-05-24 91.00 0.93 0.06 ok
9BDL_ANG P03950 Angiogenin EM 2.80 2024-04-12 89.81 0.93 0.06 ok
8YBJ_C P04908 Histone H2A type 1-B/E EM 2.38 2024-02-14 90.75 0.94 0.06 ok
8YBK_C P04908 Histone H2A type 1-B/E EM 2.69 2024-02-14 90.75 0.94 0.06 ok
8OEF_A Q5VYS8 Terminal uridylyltransferase 7 EM 4.00 2023-03-10 66.06 0.91 0.06 ok
8YI7_C Q99665 Interleukin-12 receptor subunit beta-2 EM 3.57 2024-02-29 72.94 0.93 0.05 ok
8ZSP_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.14 2024-06-05 89.56 0.94 0.05 ok
8YBK_A P68431 Histone H3.1 EM 2.69 2024-02-14 86.06 0.94 0.05 ok
8ZSS_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.07 2024-06-05 89.56 0.94 0.05 ok
8OPP_A Q5VYS8 Terminal uridylyltransferase 7 EM 3.76 2023-04-07 66.06 0.93 0.05 ok
8PR7_A O14965 Aurora kinase A X-ray 2.76 2023-07-12 75.06 0.94 0.05 ok
8K4D_B O60216 64-kDa C-terminal product X-ray 3.52 2023-07-18 61.22 0.93 0.04 ok
9FH9_C Q7L7L0 Histone H2A type 3 EM 2.50 2024-05-27 90.94 0.95 0.04 ok
8WDZ_A Q9BYF1 Angiotensin-converting enzyme 2 EM 2.71 2023-09-16 90.69 0.95 0.04 ok
8R7H_B P34896 Serine hydroxymethyltransferase, cytosolic EM 3.29 2023-11-24 96.62 0.96 0.04 ok
8PTA_A P45983 Mitogen-activated protein kinase 8 X-ray 2.41 2023-07-13 82.38 0.95 0.04 ok
9FH9_K P14635 G2/mitotic-specific cyclin-B1 EM 2.50 2024-05-27 76.56 0.95 0.04 ok
8WE1_A Q9BYF1 Angiotensin-converting enzyme 2 EM 2.47 2023-09-16 90.69 0.96 0.04 ok
9IJ9_C P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.70 2024-06-21 89.56 0.96 0.04 ok
8WDY_A Q9BYF1 Angiotensin-converting enzyme 2 EM 2.69 2023-09-16 90.69 0.96 0.04 ok
8WE0_A Q9BYF1 Angiotensin-converting enzyme 2 EM 2.80 2023-09-16 90.69 0.96 0.04 ok
8PT9_A P45983 Mitogen-activated protein kinase 8 X-ray 2.70 2023-07-13 82.38 0.95 0.04 ok
8XVT_I O96019 Actin-like protein 6A EM 3.20 2024-01-15 91.56 0.96 0.04 ok
8XVG_I O96019 Actin-like protein 6A EM 9.40 2024-01-15 91.56 0.96 0.04 ok
8XRP_C Q99665 Interleukin-12 receptor subunit beta-2 EM 3.75 2024-01-07 72.94 0.95 0.04 ok
8WE4_A Q9BYF1 Angiotensin-converting enzyme 2 EM 2.91 2023-09-17 90.69 0.96 0.04 ok
8PT3_A P28482 Mitogen-activated protein kinase 1 X-ray 1.80 2023-07-13 90.38 0.96 0.04 ok
8PSR_A P28482 Mitogen-activated protein kinase 1 X-ray 1.85 2023-07-13 90.38 0.96 0.03 ok
8ZSJ_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.80 2024-06-05 89.56 0.96 0.03 ok
8YI7_B P29460 Interleukin-12 subunit beta EM 3.57 2024-02-29 91.12 0.96 0.03 ok
8XRP_B P29460 Interleukin-12 subunit beta EM 3.75 2024-01-07 91.12 0.96 0.03 ok
8PT8_A P45983 Mitogen-activated protein kinase 8 X-ray 2.78 2023-07-13 82.38 0.96 0.03 ok
8PT1_A P28482 Mitogen-activated protein kinase 1 X-ray 1.80 2023-07-13 90.38 0.97 0.03 ok
8PT0_A P28482 Mitogen-activated protein kinase 1 X-ray 1.65 2023-07-13 90.38 0.97 0.03 ok
8OPS_A Q5VYS8 Terminal uridylyltransferase 7 EM 3.82 2023-04-08 66.06 0.96 0.03 ok
9B9R_A O15062 Zinc finger and BTB domain-containing prot EM 3.70 2024-04-03 50.28 0.94 0.03 ok
8OPT_A Q5VYS8 Terminal uridylyltransferase 7 EM 3.65 2023-04-08 66.06 0.96 0.03 ok
8PT5_A P28482 Mitogen-activated protein kinase 1 X-ray 1.95 2023-07-13 90.38 0.97 0.02 ok
9FGQ_A P68431 Histone H3.1 EM 2.50 2024-05-24 86.06 0.97 0.02 ok
9FH9_B P62805 Histone H4 EM 2.50 2024-05-27 89.81 0.98 0.02 ok
8PST_A P28482 Mitogen-activated protein kinase 1 X-ray 1.90 2023-07-13 90.38 0.98 0.02 ok
8PVQ_A P26022 Pentraxin-related protein PTX3 X-ray 2.43 2023-07-18 76.75 0.97 0.02 ok
8PSW_A P28482 Mitogen-activated protein kinase 1 X-ray 2.00 2023-07-13 90.38 0.98 0.02 ok
8WDR_A Q9BYF1 Angiotensin-converting enzyme 2 X-ray 3.47 2023-09-16 90.69 0.98 0.02 ok
8Y7L_A P22736 Nuclear receptor subfamily 4immunitygroup X-ray 2.68 2024-02-04 66.06 0.97 0.02 ok
8YBK_D P06899 Histone H2B type 1-J EM 2.69 2024-02-14 85.50 0.98 0.02 ok
8WDS_A Q9BYF1 Angiotensin-converting enzyme 2 X-ray 3.40 2023-09-16 90.69 0.98 0.02 ok
8PSY_A P28482 Mitogen-activated protein kinase 1 X-ray 2.55 2023-07-13 90.38 0.98 0.02 ok
9ERY_A Q9NZQ7 Programmed cell death 1 ligand 1 X-ray 2.70 2024-03-25 88.25 0.98 0.02 ok
8XVT_K P60709 Actin, cytoplasmic 1 EM 3.20 2024-01-15 95.19 0.98 0.02 ok
8XVG_K P60709 ACTB protein (Fragment) EM 9.40 2024-01-15 95.19 0.98 0.02 ok
9FGQ_B P62805 Histone H4 EM 2.50 2024-05-24 89.81 0.98 0.02 ok
9B9V_A Q96C00 Zinc finger and BTB domain-containing prot EM 8.10 2024-04-03 59.44 0.97 0.02 ok
8R7H_A P34896 Serine hydroxymethyltransferase, cytosolic EM 3.29 2023-11-24 96.62 0.98 0.02 ok
8YBJ_A P68431 Histone H3.1 EM 2.38 2024-02-14 86.06 0.98 0.02 ok
8YBK_B P62805 Histone H4 EM 2.69 2024-02-14 89.81 0.98 0.02 ok
8WQO_A O60885 Isoform C of Bromodomain-containing protei X-ray 1.13 2023-10-12 55.31 0.98 0.01 ok
8YBJ_B P62805 Histone H4 EM 2.38 2024-02-14 89.81 0.99 0.01 ok
8K4D_A Q8N3U4 Cohesin subunit SA-2 X-ray 3.52 2023-07-18 79.50 0.99 0.01 ok
8ZSV_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.96 2024-06-05 97.06 0.99 0.01 ok
9FH9_A P68431 Histone H3.1 EM 2.50 2024-05-27 86.06 0.99 0.01 ok
8U57_A P37231 Peroxisome proliferator-activated receptor X-ray 2.00 2023-09-12 76.12 0.99 0.01 ok
8K4O_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.01 2023-07-20 97.06 0.99 0.01 ok
8ZSP_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.14 2024-06-05 97.06 0.99 0.01 ok
8ZSS_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.07 2024-06-05 97.06 0.99 0.01 ok
8PTT_A Q9UKK9 ADP-sugar pyrophosphatase X-ray 2.50 2023-07-14 92.44 0.99 0.01 ok
8K4P_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.81 2023-07-20 97.06 0.99 0.01 ok
9BNQ_A P14174 Macrophage migration inhibitory factor X-ray 1.09 2024-05-02 98.56 0.99 0.01 ok
8YBJ_D P06899 Histone H2B type 1-J EM 2.38 2024-02-14 85.50 0.99 0.01 ok
9BNR_A P14174 Macrophage migration inhibitory factor X-ray 1.53 2024-05-02 98.56 0.99 0.01 ok
9IIX_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.89 2024-06-21 97.06 0.99 0.01 ok
8ZSJ_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.80 2024-06-05 97.06 0.99 0.01 ok
9IJ9_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.70 2024-06-21 97.06 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.