Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2020-09-30

109
structures analysed (50 full · 45.9%)
21.8%
confidently wrong
109.2%
novel sequences
00.0%
novel & wrong
0.945
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 2 of 109 structures (1.8%) are confidently wrong; median TM-score is 0.945.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.945 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6YXQ_A Q8N3C0 Activating signal cointegrator 1 complex s X-ray 2.70 2020-05-03 100.00 novel 63.14 0.58 0.71 4.17 20.18 0.52 ok
6ZEE_C Q9C0D0 Phosphatase and actin regulator X-ray 1.90 2020-06-16 100.00 novel 89.48 0.58 0.86 27.90 7.27 0.36 ok
6ZEF_C Q9C0D0 Phosphatase and actin regulator X-ray 1.94 2020-06-16 100.00 novel 89.58 0.50 0.78 29.23 6.61 0.35 ok
6UJ6_A P02787 Transferrin X-ray 2.68 2019-10-02 0.30 95.05 0.82 0.93 33.78 6.25 0.34 ok
6ST2_A Q07817 Bcl-2-like protein 1 X-ray 1.79 2019-09-09 0.00 88.75 0.75 0.82 34.09 8.64 0.33 ok
6ZRQ_A P10997 Islet amyloid polypeptide EM 3.90 2020-07-14 2.80 71.31 0.15 0.37 23.91 7.41 0.33 wrong
6ZRR_A P10997 Islet amyloid polypeptide EM 4.00 2020-07-14 2.80 71.31 0.17 0.37 22.83 7.41 0.33 wrong
6ZEG_C Q9C0D0 Phosphatase and actin regulator X-ray 1.09 2020-06-16 100.00 novel 89.31 0.58 0.87 32.95 5.95 0.31 ok
6UT2_A Q6P5Q4 Leiomodin-2 NMR 2019-10-29 0.00 75.85 0.52 0.79 25.62 7.32 0.30 ok
6ZEH_C Q9C0D0 Phosphatase and actin regulator X-ray 1.30 2020-06-16 100.00 novel 89.25 0.59 0.88 35.00 5.54 0.29 ok
6ZEI_C Q9C0D0 Phosphatase and actin regulator X-ray 1.39 2020-06-16 100.00 novel 89.25 0.60 0.87 35.00 5.51 0.29 ok
6UPW_L P18206 Vinculin EM 2.90 2019-10-18 86.56 0.73 0.24 ok
6UPV_L P35221 Catenin alpha-1 EM 3.20 2019-10-18 82.94 0.74 0.22 ok
6R17_C Q9BXU0 Testis-expressed protein 12 X-ray 2.42 2019-03-13 100.00 novel 97.75 0.94 1.00 55.95 3.01 0.18 ok
6SQC_B Q9Y6Q9 Nuclear receptor coactivator 3 X-ray 2.28 2019-09-03 0.00 67.96 0.49 0.76 46.95 5.02 0.18 ok
7BSQ_A Q8NB49 ATP11C EM 3.20 2020-03-31 82.94 0.79 0.18 ok
7BSP_A Q8NB49 ATP11C EM 4.00 2020-03-31 82.94 0.79 0.18 ok
6XBM_A P63096 Guanine nucleotide-binding protein G(i) su EM 3.14 2020-06-06 93.75 0.82 0.17 ok
6XBL_A P63096 Guanine nucleotide-binding protein G(i) su EM 3.96 2020-06-06 93.75 0.82 0.17 ok
6XBJ_A P63096 Guanine nucleotide-binding protein G(i) su EM 3.88 2020-06-06 93.75 0.82 0.17 ok
6XBK_A P63096 Guanine nucleotide-binding protein G(i) su EM 3.24 2020-06-06 93.75 0.82 0.17 ok
6T7H_A P00734 Thrombin light chain X-ray 2.32 2019-10-22 0.00 92.23 0.69 0.84 65.83 2.92 0.13 ok
7BSS_A Q8NB49 ATP11C EM 3.30 2020-03-31 82.94 0.84 0.13 ok
6Y5N_A Q86Y01 E3 ubiquitin-protein ligase DTX1 X-ray 1.88 2020-02-25 74.44 0.84 0.12 ok
6SSB_A P43405 Tyrosine-protein kinase SYK X-ray 2.08 2019-09-06 0.00 91.41 0.91 0.87 70.85 4.12 0.12 ok
6Y5P_A Q86Y01 E3 ubiquitin-protein ligase DTX1 X-ray 1.74 2020-02-25 74.44 0.84 0.12 ok
6XBL_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.96 2020-06-06 89.56 0.87 0.11 ok
6SVC_A Q13526 Peptidyl-prolyl cis-trans isomerase NIMA-i NMR 2019-09-18 5.80 92.10 0.61 0.78 75.00 2.25 0.10 ok
6LIN_A Q15119 [Pyruvate dehydrogenase (acetyl-transferri X-ray 2.67 2019-12-12 0.30 93.29 0.93 0.91 78.56 4.01 0.10 ok
6T7H_B P00734 Thrombin heavy chain X-ray 2.32 2019-10-22 0.00 90.08 0.91 0.81 80.04 3.00 0.09 ok
7CBX_A O14733 Dual specificity mitogen-activated protein X-ray 2.06 2020-06-15 77.25 0.89 0.09 ok
7K7A_A P19438 Tumor necrosis factor receptor superfamily NMR 2020-09-22 100.00 novel 85.60 0.55 0.83 74.17 1.99 0.09 ok
7BSW_A Q8NB49 ATP11C EM 3.90 2020-03-31 82.94 0.91 0.08 ok
7BSV_A Q8NB49 ATP11C EM 3.00 2020-03-31 82.94 0.91 0.08 ok
6XBJ_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.88 2020-06-06 89.56 0.92 0.07 ok
6XBK_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.24 2020-06-06 89.56 0.93 0.07 ok
6SVH_A Q13526 Peptidyl-prolyl cis-trans isomerase NIMA-i NMR 2019-09-18 5.80 92.10 0.72 0.82 85.71 1.43 0.06 ok
7BSP_C Q9NV96 CDC50A EM 4.00 2020-03-31 89.50 0.93 0.06 ok
6WN7_A P33763 Protein S100-A5 X-ray 1.25 2020-04-22 93.94 0.93 0.06 ok
7BSQ_C Q9NV96 CDC50A EM 3.20 2020-03-31 89.50 0.93 0.06 ok
7BSW_C Q9NV96 CDC50A EM 3.90 2020-03-31 89.50 0.93 0.06 ok
7BSS_C Q9NV96 CDC50A EM 3.30 2020-03-31 89.50 0.94 0.06 ok
7BSV_C Q9NV96 CDC50A EM 3.00 2020-03-31 89.50 0.94 0.06 ok
7BSU_C Q9NV96 Cell cycle control protein 50A EM 3.20 2020-03-31 89.50 0.94 0.05 ok
6LIO_A Q15119 [Pyruvate dehydrogenase (acetyl-transferri X-ray 1.76 2019-12-12 0.30 94.52 0.97 0.94 93.01 1.35 0.05 ok
6R17_A Q6PIF2 Synaptonemal complex central element prote X-ray 2.42 2019-03-13 100.00 novel 98.10 0.94 1.00 94.89 0.88 0.05 ok
6XBM_R Q99835 Smoothened homolog EM 3.14 2020-06-06 72.75 0.93 0.05 ok
6STJ_A Q07820 Induced myeloid leukemia cell differentiat X-ray 2.20 2019-09-10 0.00 90.79 0.95 0.90 92.02 1.16 0.05 ok
6YI8_A P22455 Fibroblast growth factor receptor 4 X-ray 2.13 2020-04-01 73.62 0.93 0.05 ok
6XBM_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.14 2020-06-06 89.56 0.95 0.05 ok
6XBK_R Q99835 Smoothened homolog EM 3.24 2020-06-06 72.75 0.94 0.05 ok
6V02_A P11717 Cation-independent mannose-6-phosphate rec X-ray 2.46 2019-11-18 73.12 0.94 0.05 ok
6LIL_A Q15119 [Pyruvate dehydrogenase (acetyl-transferri X-ray 1.93 2019-12-12 0.30 94.19 0.98 0.94 93.79 1.09 0.05 ok
6KZQ_A P43378 Tyrosine-protein phosphatase non-receptor X-ray 1.70 2019-09-25 1.00 93.99 0.97 0.92 94.26 1.20 0.05 ok
6SQ2_D Q969X0 RILP-like protein 2 X-ray 1.68 2019-09-03 100.00 novel 93.07 0.79 0.97 93.55 0.92 0.05 ok
6TG0_A P00533 Epidermal growth factor receptor X-ray 1.50 2019-11-14 0.70 85.93 0.96 0.94 91.10 1.44 0.04 ok
6TG1_A P00533 Epidermal growth factor receptor X-ray 1.60 2019-11-14 0.70 85.70 0.97 0.94 91.70 1.32 0.04 ok
6L03_A P43378 Tyrosine-protein phosphatase non-receptor X-ray 2.08 2019-09-25 1.00 93.91 0.98 0.93 94.53 1.16 0.04 ok
6TFV_A P00533 Epidermal growth factor receptor X-ray 1.50 2019-11-14 0.70 85.70 0.96 0.93 91.17 1.42 0.04 ok
7A92_D Q9BYF1 Angiotensin-converting enzyme 2 EM 4.20 2020-09-01 90.69 0.95 0.04 ok
6TFU_A P00533 Epidermal growth factor receptor X-ray 2.00 2019-11-14 0.70 85.52 0.96 0.93 91.39 1.62 0.04 ok
7JV1_D Q8IVT5 Kinase suppressor of Ras 1 X-ray 3.62 2020-08-20 60.44 0.93 0.04 ok
6TFW_A P00533 Epidermal growth factor receptor X-ray 2.00 2019-11-14 0.70 85.90 0.97 0.94 93.05 1.27 0.04 ok
7JUZ_A Q8IVT5 Kinase suppressor of Ras 1 X-ray 3.21 2020-08-20 60.44 0.94 0.04 ok
7JV0_A Q8IVT5 Kinase suppressor of Ras 1 X-ray 3.63 2020-08-20 60.44 0.94 0.04 ok
6TFY_A P00533 Epidermal growth factor receptor X-ray 1.70 2019-11-14 0.70 85.84 0.97 0.94 92.67 1.69 0.04 ok
7JUW_B Q8IVT5 Kinase suppressor of Ras 1 X-ray 2.88 2020-08-20 60.44 0.94 0.04 ok
7JUX_A Q8IVT5 Kinase suppressor of Ras 1 X-ray 3.34 2020-08-20 60.44 0.94 0.04 ok
7A6U_A Q9Y210 Short transient receptor potential channel EM 3.62 2020-08-26 76.69 0.95 0.04 ok
6KZH_A P27348 14-3-3 protein theta X-ray 2.65 2019-09-24 4.70 96.28 0.98 0.96 97.05 1.03 0.04 ok
6XBL_R Q99835 Smoothened homolog EM 3.96 2020-06-06 72.75 0.95 0.04 ok
6TFZ_A P00533 Epidermal growth factor receptor X-ray 1.80 2019-11-14 0.70 86.19 0.97 0.95 93.94 1.15 0.04 ok
6XBJ_R Q99835 Smoothened homolog EM 3.88 2020-06-06 72.75 0.95 0.04 ok
6QZW_A Q6V1X1 Dipeptidyl peptidase 8 X-ray 3.20 2019-03-12 0.00 94.27 1.00 0.97 97.21 0.70 0.03 ok
6QZV_A Q86TI2 Dipeptidyl peptidase 9 X-ray 3.00 2019-03-12 0.00 94.56 0.99 0.95 97.15 0.78 0.03 ok
6Y09_A Q9H082 Ras-related protein Rab-33B X-ray 2.40 2020-02-07 80.62 0.96 0.03 ok
6L05_U P00749 Urokinase-type plasminogen activator X-ray 2.49 2019-09-26 0.00 87.70 0.98 0.95 96.22 1.29 0.03 ok
6L1R_A Q08945 FACT complex subunit SSRP1 X-ray 1.80 2019-09-30 1.00 86.11 0.96 0.94 96.50 0.75 0.03 ok
6L1E_A Q08945 FACT complex subunit SSRP1 X-ray 2.09 2019-09-29 0.00 90.59 0.99 0.98 97.87 0.67 0.03 ok
7JUQ_B Q6VAB6 Kinase suppressor of Ras 2 X-ray 3.22 2020-08-20 60.84 0.95 0.03 ok
6L04_U P00749 Urokinase-type plasminogen activator X-ray 2.21 2019-09-26 0.00 87.70 0.98 0.95 96.53 1.28 0.03 ok
7JUU_B Q6VAB6 Kinase suppressor of Ras 2 X-ray 3.19 2020-08-20 60.84 0.95 0.03 ok
6KZG_A P27348 14-3-3 protein theta X-ray 2.00 2019-09-24 4.70 96.35 0.98 0.98 97.80 0.94 0.03 ok
7JUT_B Q6VAB6 Kinase suppressor of Ras 2 X-ray 3.09 2020-08-20 60.84 0.95 0.03 ok
6KZE_A Q9Y233 cAMP and cAMP-inhibited cGMP 3',5'-cyclic X-ray 2.50 2019-09-24 0.00 94.09 0.99 0.96 99.35 0.52 0.03 ok
6SQE_A Q92793 CREB-binding protein X-ray 1.51 2019-09-03 0.00 94.97 0.98 0.98 99.14 0.52 0.03 ok
6ZAY_A Q9H082 Ras-related protein Rab-33B X-ray 2.40 2020-06-06 80.62 0.97 0.03 ok
6SQ2_A P61006 Ras-related protein Rab-8A X-ray 1.68 2019-09-03 1.10 93.08 0.99 0.97 97.30 0.63 0.03 ok
7JUV_B Q6VAB6 Kinase suppressor of Ras 2 X-ray 3.36 2020-08-20 60.84 0.96 0.03 ok
6SQM_A Q92793 CREB-binding protein X-ray 1.80 2019-09-04 0.00 95.27 0.98 0.98 98.46 0.57 0.03 ok
7JUS_B Q6VAB6 Kinase suppressor of Ras 2 X-ray 2.99 2020-08-20 60.84 0.96 0.03 ok
7JUR_B Q6VAB6 Kinase suppressor of Ras 2 X-ray 2.82 2020-08-20 60.84 0.96 0.03 ok
6SQF_A Q92793 CREB-binding protein X-ray 2.01 2019-09-03 0.00 94.97 0.99 0.98 99.14 0.44 0.02 ok
6LP8_A Q02127 Dihydroorotate dehydrogenase (quinone), mi X-ray 1.79 2020-01-09 0.00 97.70 0.99 0.98 98.70 0.90 0.02 ok
6LP6_A Q02127 Dihydroorotate dehydrogenase (quinone), mi X-ray 1.79 2020-01-09 0.00 97.70 0.99 0.98 98.70 0.90 0.02 ok
7D2C_A Q460N5 Protein mono-ADP-ribosyltransferase PARP14 X-ray 1.56 2020-09-16 81.69 0.98 0.02 ok
6VLT_A P11712 Cytochrome P450 2C9 X-ray 3.12 2020-01-25 92.94 0.98 0.02 ok
6LP7_A Q02127 Dihydroorotate dehydrogenase (quinone), mi X-ray 1.80 2020-01-09 0.00 97.77 1.00 0.99 99.52 0.45 0.01 ok
7BSU_A Q8NB49 ATP11C EM 3.20 2020-03-31 82.94 0.98 0.01 ok
6Y73_A A1Z1Q3 ADP-ribose glycohydrolase MACROD2 X-ray 1.70 2020-02-28 71.62 0.98 0.01 ok
6XBL_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.96 2020-06-06 97.06 0.99 0.01 ok
6WP5_A P14618 Pyruvate kinase PKM X-ray 2.17 2020-04-26 96.81 0.99 0.01 ok
6YXQ_B Q9H1I8 Activating signal cointegrator 1 complex s X-ray 2.70 2020-05-03 77.38 0.99 0.01 ok
6WP4_A P14618 Pyruvate kinase PKM X-ray 1.90 2020-04-26 96.81 0.99 0.01 ok
6XBJ_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.88 2020-06-06 97.06 0.99 0.01 ok
6XBK_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.24 2020-06-06 97.06 0.99 0.01 ok
6XBM_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.14 2020-06-06 97.06 0.99 0.01 ok
6ZEE_A P62136 Serine/threonine-protein phosphatase PP1-a X-ray 1.90 2020-06-16 91.25 1.00 0.00 ok
6ZEF_A P62136 Serine/threonine-protein phosphatase PP1-a X-ray 1.94 2020-06-16 91.25 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.