Live Stats, next update: Wed 09 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2023-07-19

81
structures analysed (9 full · 11.1%)
44.9%
confidently wrong
00.0%
novel sequences
00.0%
novel & wrong
0.951
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 4 of 81 structures (4.9%) are confidently wrong; median TM-score is 0.951.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.951 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
8PKP_M Q9BS18 Anaphase-promoting complex subunit 13 EM 3.20 2023-06-27 0.00 77.27 0.23 0.76 0.43 20.85 0.69 wrong
8P4F_Z O00267 Transcription elongation factor SPT5 EM 4.00 2023-05-20 0.00 89.47 0.59 0.86 9.84 13.85 0.59 ok
8P2K_Nb A0A7I2YQL2 Transcription factor BTF3 EM 2.90 2023-05-16 0.00 84.92 0.66 0.81 28.30 10.13 0.33 ok
8PKP_D P60006 Anaphase-promoting complex subunit 15 EM 3.20 2023-06-27 0.00 84.66 0.38 0.87 29.46 6.64 0.32 wrong
8H0I_D Q13951 Core binding factor beta EM 2.80 2022-09-29 0.00 90.02 0.69 0.70 43.22 5.55 0.25 ok
8DVG_C P01116 VAL-VAL-VAL-GLY-ALA-GLY-GLY-VAL-GLY-LYS X-ray 2.59 2022-07-28 96.46 0.27 0.65 40.00 4.35 0.25 wrong
8J62_D Q13951 Core binding factor beta EM 2.50 2023-04-24 85.81 0.75 0.21 ok
7ZCB_B Q63HQ2 Pikachurin X-ray 2.50 2022-03-26 80.56 0.74 0.21 ok
8PKP_H Q96DE5 Anaphase-promoting complex subunit 16 EM 3.20 2023-06-27 0.00 90.97 0.68 0.91 49.56 4.56 0.21 ok
8PKP_N Q9UJX6 Anaphase-promoting complex subunit 2 EM 3.20 2023-06-27 78.75 0.74 0.20 ok
8IC0_B P63096 Guanine nucleotide-binding protein G(i) su EM 3.41 2023-02-10 93.75 0.83 0.16 ok
8OL9_L P00740 Coagulation factor IX light chain X-ray 2.60 2023-03-30 80.31 0.80 0.16 ok
8IC0_F P10145 Interleukin-8 EM 3.41 2023-02-10 88.06 0.82 0.16 ok
8OIZ_A Q16531 DNA damage-binding protein 1 X-ray 2.50 2023-03-23 92.00 0.83 0.16 ok
8OJH_A Q16531 DNA damage-binding protein 1 X-ray 2.72 2023-03-24 92.00 0.83 0.15 ok
8PKP_G Q8NHZ8 Anaphase-promoting complex subunit CDC26 EM 3.20 2023-06-27 0.00 92.31 0.41 0.87 62.04 2.66 0.14 wrong
8BW5_L P00734 Thrombin light chain X-ray 2.80 2022-12-06 0.00 93.08 0.70 0.86 63.71 3.04 0.14 ok
8PKP_C Q9NYG5 Anaphase-promoting complex subunit 11 EM 3.20 2023-06-27 92.38 0.87 0.12 ok
8EZG_A P01116 GTPase KRas X-ray 2.52 2022-10-31 91.50 0.88 0.11 ok
8IC0_D P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.41 2023-02-10 89.56 0.88 0.11 ok
8P2K_Na Q13765 Nascent polypeptide-associated complex sub EM 2.90 2023-05-16 72.69 0.86 0.10 ok
8PKP_J P30260 Cell division cycle protein 27 homolog EM 3.20 2023-06-27 69.00 0.86 0.10 ok
8AG1_A P43489 Tumor necrosis factor receptor superfamily X-ray 3.30 2022-07-19 77.00 0.87 0.10 ok
8F0M_A P01116 Isoform 2B of GTPase KRas X-ray 2.44 2022-11-03 91.50 0.92 0.08 ok
8BW5_H P00734 Thrombin heavy chain X-ray 2.80 2022-12-06 83.94 0.91 0.08 ok
8PKP_A Q9H1A4 Anaphase-promoting complex subunit 1 EM 3.20 2023-06-27 77.06 0.91 0.07 ok
8PKP_K Q13042 Cell division cycle protein 16 homolog EM 3.20 2023-06-27 78.88 0.91 0.07 ok
8AU0_A O94901 SUN domain-containing protein 1 X-ray 2.07 2022-08-24 60.38 0.89 0.07 ok
8IC0_A P25024 C-X-C chemokine receptor type 1 EM 3.41 2023-02-10 78.06 0.92 0.06 ok
8CK3_A Q99814 Endothelial PAS domain-containing protein X-ray 1.71 2023-02-14 58.56 0.92 0.05 ok
8PKP_I Q9UJX5 Anaphase-promoting complex subunit 4 EM 3.20 2023-06-27 80.94 0.94 0.05 ok
8H06_A Q9BYF1 Processed angiotensin-converting enzyme 2 EM 2.66 2022-09-28 90.69 0.95 0.05 ok
8PKP_O Q9UJX4 Anaphase-promoting complex subunit 5 EM 3.20 2023-06-27 81.62 0.94 0.05 ok
8CK8_A Q99814 Endothelial PAS domain-containing protein X-ray 2.30 2023-02-14 58.56 0.92 0.04 ok
7YHW_A Q9BYF1 Angiotensin-converting enzyme 2 EM 3.09 2022-07-14 90.69 0.95 0.04 ok
8CK4_A Q99814 Endothelial PAS domain-containing protein X-ray 2.29 2023-02-14 58.56 0.93 0.04 ok
7ZC9_A Q63HQ2 Pikachurin X-ray 2.10 2022-03-26 80.56 0.95 0.04 ok
8B7D_A Q9NUM4 Transmembrane protein 106B X-ray 2.59 2022-09-29 75.88 0.94 0.04 ok
8H0I_A Q9HC16 APOBEC3G EM 2.80 2022-09-29 88.56 0.95 0.04 ok
7YJ3_A Q9BYF1 Angiotensin-converting enzyme 2 EM 3.14 2022-07-19 90.69 0.95 0.04 ok
7W91_A Q96MT8 Centrosomal protein of 63 kDa X-ray 3.29 2021-12-09 77.31 0.95 0.04 ok
8DNT_F P61769 Beta-2-microglobulin X-ray 3.18 2022-07-11 94.06 0.96 0.04 ok
8SBC_B P27986 Phosphatidylinositol 3-kinase regulatory s X-ray 2.30 2023-04-03 83.19 0.95 0.04 ok
8SBJ_B P27986 Phosphatidylinositol 3-kinase regulatory s X-ray 3.10 2023-04-03 83.19 0.95 0.04 ok
8PKP_U Q9UJX2 Cell division cycle protein 23 homolog EM 3.20 2023-06-27 84.88 0.95 0.04 ok
8GBQ_B Q96EQ8 E3 ubiquitin-protein ligase RNF125 X-ray 1.74 2023-02-27 77.38 0.95 0.04 ok
8J62_A Q9HC16 APOBEC3G EM 2.50 2023-04-24 88.56 0.96 0.03 ok
8P4E_Z O00267 Transcription elongation factor SPT5 EM 3.90 2023-05-20 68.56 0.95 0.03 ok
8GCB_B Q96EQ8 E3 ubiquitin-protein ligase RNF125 X-ray 2.39 2023-03-01 77.38 0.96 0.03 ok
8GCB_A P62837 Ubiquitin-conjugating enzyme E2 D2 X-ray 2.39 2023-03-01 96.50 0.97 0.03 ok
8P5P_A Q7Z6L1 Tectonin beta-propeller repeat-containing X-ray 1.90 2023-05-24 78.38 0.96 0.03 ok
8CK3_B P27540 Aryl hydrocarbon receptor nuclear transloc X-ray 1.71 2023-02-14 55.50 0.95 0.03 ok
8DVG_A P04439 HLA class I histocompatibility antigen, A- X-ray 2.59 2022-07-28 87.12 0.97 0.03 ok
8CK4_B P27540 Aryl hydrocarbon receptor nuclear transloc X-ray 2.29 2023-02-14 55.50 0.95 0.03 ok
8CK8_B P27540 Aryl hydrocarbon receptor nuclear transloc X-ray 2.30 2023-02-14 55.50 0.95 0.03 ok
8PKP_L Q9UM13 Anaphase-promoting complex subunit 10 EM 3.20 2023-06-27 90.19 0.97 0.03 ok
8H5C_A Q9BYF1 Processed angiotensin-converting enzyme 2 X-ray 2.90 2022-10-12 90.69 0.97 0.03 ok
7YDS_A Q9NZQ7 Programmed cell death 1 ligand 1 X-ray 2.30 2022-07-04 88.25 0.97 0.03 ok
8P4E_M O60942 mRNA-capping enzyme EM 3.90 2023-05-20 85.44 0.97 0.02 ok
8PKP_Y Q9UJX3 Anaphase-promoting complex subunit 7 EM 3.20 2023-06-27 83.00 0.97 0.02 ok
8DP0_A P48736 Phosphatidylinositol 4,5-bisphosphate 3-ki EM 2.96 2022-07-14 87.81 0.97 0.02 ok
8DVG_B P61769 Beta-2-microglobulin X-ray 2.59 2022-07-28 94.06 0.98 0.02 ok
8OL9_H P00740 Coagulation factor IX heavy chain X-ray 2.60 2023-03-30 80.31 0.98 0.02 ok
8I6K_A P41218 Myeloid cell nuclear differentiation antig X-ray 2.40 2023-01-28 77.88 0.98 0.02 ok
8DNT_E U5YKE0 MHC class I antigen alpha chain X-ray 3.18 2022-07-11 89.19 0.98 0.02 ok
8I7X_A Q16740 ATP-dependent Clp protease proteolytic sub X-ray 1.99 2023-02-02 82.31 0.98 0.01 ok
8ONE_A O60568 Multifunctional procollagen lysine hydroxy X-ray 2.30 2023-04-02 91.38 0.98 0.01 ok
8GBQ_A P62837 Ubiquitin-conjugating enzyme E2 D2 X-ray 1.74 2023-02-27 96.50 0.99 0.01 ok
8P4F_O Q8N1G2 Cap-specific mRNA (nucleoside-2'-O-)-methy EM 4.00 2023-05-20 86.25 0.99 0.01 ok
8P4E_O Q8N1G2 Cap-specific mRNA (nucleoside-2'-O-)-methy EM 3.90 2023-05-20 86.25 0.99 0.01 ok
8OIZ_B Q96SW2 Protein cereblon X-ray 2.50 2023-03-23 86.62 0.99 0.01 ok
8DNQ_A P25440 Bromodomain-containing protein 2 X-ray 1.84 2022-07-11 64.06 0.99 0.01 ok
8IC0_C P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.41 2023-02-10 97.06 0.99 0.01 ok
8OJH_B Q96SW2 Protein cereblon X-ray 2.72 2023-03-24 86.62 0.99 0.01 ok
8P2K_MA P53582 Methionine aminopeptidase 1 EM 2.90 2023-05-16 94.38 0.99 0.01 ok
7YIW_A P05186 Alkaline phosphatase, tissue-nonspecific i X-ray 2.89 2022-07-18 93.31 0.99 0.01 ok
7YIV_A P05186 Alkaline phosphatase, tissue-nonspecific i X-ray 3.18 2022-07-18 93.31 0.99 0.01 ok
8SBJ_A P42336 Phosphatidylinositol 4,5-bisphosphate 3-ki X-ray 3.10 2023-04-03 92.38 0.99 0.01 ok
8SBC_A P42336 Phosphatidylinositol 4,5-bisphosphate 3-ki X-ray 2.30 2023-04-03 92.38 1.00 0.00 ok
8P4F_Y P63272 Transcription elongation factor SPT4 EM 4.00 2023-05-20 96.50 1.00 0.00 ok
8DHK_A Q9Y6N5 Sulfide:quinone oxidoreductase X-ray 2.30 2022-06-27 93.00 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.