Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2024-12-25

110
structures analysed (14 full · 12.7%)
54.5%
confidently wrong
10.9%
novel sequences
10.9%
novel & wrong
0.916
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 5 of 110 structures (4.5%) are confidently wrong; median TM-score is 0.916.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.916 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
8XK1_A P06213 Isoform Short of Insulin receptor EM 3.31 2023-12-22 0.20 87.99 0.50 0.87 2.33 17.73 0.73 wrong
8XKM_A P06213 Isoform Short of Insulin receptor EM 5.00 2023-12-23 0.20 87.32 0.52 0.77 2.04 17.95 0.72 ok
9CHO_A Q5S007 Leucine-rich repeat serine/threonine-prote EM 7.80 2024-07-01 0.00 80.57 0.63 0.78 2.22 22.04 0.72 ok
9BDE_R P01130 Low-density lipoprotein receptor EM 4.18 2024-04-11 0.00 75.80 0.35 0.73 1.38 19.05 0.66 wrong
8JR6_A P07900 Heat shock protein HSP 90-alpha NMR 2023-06-16 0.00 87.30 0.64 0.59 7.38 19.32 0.63 ok
8JRA_A P07900 Heat shock protein HSP 90-alpha NMR 2023-06-16 0.50 87.30 0.66 0.62 7.59 22.01 0.61 ok
8JR7_A P07900 Heat shock protein HSP 90-alpha NMR 2023-06-16 0.50 87.30 0.65 0.57 11.39 20.59 0.52 ok
8XKR_A P06213 Isoform Short of Insulin receptor EM 3.53 2023-12-24 0.20 87.22 0.70 0.72 15.13 15.22 0.50 ok
8JTI_e P60896 26S proteasome complex subunit DSS1 EM 3.80 2023-06-21 0.00 67.98 0.26 0.57 8.16 13.26 0.48 ok
9BZ0_e Q9BW61 DET1- and DDB1-associated protein 1 EM 1.90 2024-05-24 100.00 novel 71.51 0.34 0.68 10.85 10.52 0.45 wrong
8JTI_C P62195 26S protease regulatory subunit 8 EM 3.80 2023-06-21 0.00 85.58 0.62 0.79 17.81 8.14 0.43 ok
9BZ0_c Q2YD98 UV-stimulated scaffold protein A EM 1.90 2024-05-24 4.20 88.64 0.66 0.92 22.84 7.84 0.40 ok
9COO_R P01130 Low-density lipoprotein receptor EM 3.73 2024-07-17 0.00 72.39 0.47 0.78 25.63 6.48 0.29 wrong
8XJS_A P06213 Isoform Short of Insulin receptor EM 3.24 2023-12-22 77.62 0.72 0.22 ok
8VAZ_E Q2I0M4 Leucine-rich repeat-containing protein 26 EM 2.82 2023-12-11 82.50 0.75 0.21 ok
8JTI_B P62191 26S protease regulatory subunit 4 EM 3.80 2023-06-21 77.81 0.75 0.19 ok
9IKQ_C Q96CV9 Optineurin X-ray 1.93 2024-06-28 77.25 0.77 0.18 ok
8S0T_H P51948 CDK-activating kinase assembly factor MAT1 EM 2.30 2024-02-14 85.38 0.79 0.18 ok
8XKR_C P05019 Insulin-like growth factor I EM 3.53 2023-12-24 59.53 0.70 0.18 ok
8UVI_A Q8WWT9 Na(+)/dicarboxylate cotransporter 3 EM 2.53 2023-11-03 81.75 0.79 0.17 ok
8S0R_H P51948 CDK-activating kinase assembly factor MAT1 EM 2.40 2024-02-14 85.38 0.80 0.17 ok
8JTI_V O43242 26S proteasome non-ATPase regulatory subun EM 3.80 2023-06-21 72.56 0.77 0.17 ok
8XKM_C P05019 Insulin-like growth factor I EM 5.00 2023-12-23 59.53 0.72 0.17 ok
8WFS_B P13224 Platelet glycoprotein Ib beta chain EM 3.36 2023-09-20 87.94 0.81 0.17 ok
8JTI_D P43686 26S protease regulatory subunit 6B EM 3.80 2023-06-21 80.12 0.80 0.16 ok
8VVC_A P33527 Multidrug resistance-associated protein 1 EM 4.32 2024-01-30 82.62 0.81 0.16 ok
8XK1_C P05019 Insulin-like growth factor I EM 3.31 2023-12-22 59.53 0.76 0.15 ok
8XJS_C P05019 Insulin-like growth factor I EM 3.24 2023-12-22 59.53 0.76 0.14 ok
8VAV_E Q2I0M4 Leucine-rich repeat-containing protein 26 EM 3.13 2023-12-11 82.50 0.83 0.14 ok
8JTI_Z P51665 26S proteasome non-ATPase regulatory subun EM 3.80 2023-06-21 83.12 0.83 0.14 ok
8JTI_d P48556 26S proteasome non-ATPase regulatory subun EM 3.80 2023-06-21 64.88 0.79 0.14 ok
8JTI_X O00231 26S proteasome non-ATPase regulatory subun EM 3.80 2023-06-21 82.69 0.84 0.13 ok
8JTI_F P17980 26S protease regulatory subunit 6A EM 3.80 2023-06-21 80.62 0.84 0.12 ok
8JTI_A P35998 26S protease regulatory subunit 7 EM 3.80 2023-06-21 80.56 0.86 0.12 ok
9BDT_I P01130 Low-density lipoprotein receptor EM 5.40 2024-04-12 75.44 0.86 0.10 ok
8JTI_W O00232 26S proteasome non-ATPase regulatory subun EM 3.80 2023-06-21 78.94 0.87 0.10 ok
9JK7_A Q9ULK5 Vang-like protein 2 EM 2.90 2024-09-15 73.31 0.87 0.10 ok
9JKA_A Q9ULK5 Vang-like protein 2 EM 2.50 2024-09-15 73.31 0.87 0.09 ok
8WFS_E P14770 Platelet glycoprotein IX EM 3.36 2023-09-20 84.69 0.89 0.09 ok
9E83_A O15393 Transmembrane protease serine 2 non-cataly X-ray 2.07 2024-11-04 79.38 0.89 0.09 ok
9JK9_A Q8TAA9 Vang-like protein 1 EM 2.20 2024-09-15 75.62 0.89 0.09 ok
9JK8_A Q8TAA9 Vang-like protein 1 EM 2.60 2024-09-15 75.62 0.89 0.09 ok
8JTI_Y Q15008 26S proteasome non-ATPase regulatory subun EM 3.80 2023-06-21 82.38 0.90 0.08 ok
9BZ0_d Q16531 DNA damage-binding protein 1 EM 1.90 2024-05-24 92.00 0.91 0.08 ok
8JTI_f Q13200 26S proteasome non-ATPase regulatory subun EM 3.80 2023-06-21 65.06 0.87 0.08 ok
9F7I_B P08603 Complement factor H X-ray 2.85 2024-05-03 78.31 0.90 0.08 ok
8JTI_a Q9UNM6 26S proteasome non-ATPase regulatory subun EM 3.80 2023-06-21 70.75 0.89 0.08 ok
9CY8_A P54764 Ephrin type-A receptor 4 X-ray 2.50 2024-08-01 83.50 0.90 0.08 ok
9HQJ_A P09651 Heterogeneous nuclear ribonucleoprotein A1 X-ray 1.60 2024-12-16 67.56 0.88 0.08 ok
9HQL_A P09651 Heterogeneous nuclear ribonucleoprotein A1 X-ray 1.75 2024-12-16 67.56 0.88 0.08 ok
9BF9_D P18627 Lymphocyte activation gene 3 protein X-ray 3.40 2024-04-17 78.38 0.90 0.08 ok
8VT4_A P33527 Multidrug resistance-associated protein 1 EM 3.79 2024-01-25 82.62 0.91 0.07 ok
9JK6_A Q8TAA9 Vang-like protein 1 EM 3.00 2024-09-15 75.62 0.90 0.07 ok
8JTI_E P62333 26S protease regulatory subunit 10B EM 3.80 2023-06-21 86.88 0.92 0.07 ok
9BZ0_a Q13216 DNA excision repair protein ERCC-8 EM 1.90 2024-05-24 91.62 0.92 0.07 ok
8JTI_c O00487 26S proteasome non-ATPase regulatory subun EM 3.80 2023-06-21 81.44 0.92 0.07 ok
8JTI_J O14818 Proteasome subunit alpha type-7 EM 3.80 2023-06-21 94.38 0.93 0.07 ok
8VUX_A P33527 Multidrug resistance-associated protein 1 EM 3.54 2024-01-30 82.62 0.92 0.06 ok
8WFS_a P07359 Platelet glycoprotein Ib alpha chain EM 3.36 2023-09-20 4.60 78.14 0.49 0.88 82.95 1.58 0.06 wrong
9BZ0_b Q03468 DNA excision repair protein ERCC-6 EM 1.90 2024-05-24 60.88 0.90 0.06 ok
8S0R_J P50613 Cyclin-dependent kinase 7 EM 2.40 2024-02-14 82.00 0.93 0.06 ok
8JTI_I P25789 Proteasome subunit alpha type-4 EM 3.80 2023-06-21 93.50 0.94 0.06 ok
8VAZ_A Q12791 Calcium-activated potassium channel subuni EM 2.82 2023-12-11 76.00 0.92 0.06 ok
8JTI_H P25787 Proteasome subunit alpha type-2 EM 3.80 2023-06-21 94.75 0.94 0.06 ok
9BTZ_A Q95460 Major histocompatibility complex class I-r X-ray 3.00 2024-05-15 87.50 0.93 0.06 ok
8JTI_K P28066 Proteasome subunit alpha type-5 EM 3.80 2023-06-21 94.12 0.94 0.06 ok
8VAV_A Q12791 Calcium-activated potassium channel subuni EM 3.13 2023-12-11 76.00 0.93 0.05 ok
8JTI_u P0CG48 Polyubiquitin-B EM 3.80 2023-06-21 88.62 0.94 0.05 ok
8S0T_J P50613 Cyclin-dependent kinase 7 EM 2.30 2024-02-14 82.00 0.94 0.05 ok
9BD8_B P01130 Low-density lipoprotein receptor EM 4.80 2024-04-11 75.44 0.93 0.05 ok
9BTY_A Q95460 Major histocompatibility complex class I-r X-ray 2.85 2024-05-15 87.50 0.94 0.05 ok
9BZ0_f P49842 Inactive serine/threonine-protein kinase 1 EM 1.90 2024-05-24 87.44 0.94 0.05 ok
8JTI_U Q99460 26S proteasome non-ATPase regulatory subun EM 3.80 2023-06-21 79.25 0.94 0.05 ok
9BZ0_M A0A2K5RSX0 Transcription elongation factor 1 homolog EM 1.90 2024-05-24 78.94 0.94 0.05 ok
9BTX_A Q95460 Major histocompatibility complex class I-r X-ray 2.05 2024-05-15 87.50 0.94 0.05 ok
9BU0_A Q95460 Major histocompatibility complex class I-r X-ray 2.89 2024-05-15 87.50 0.95 0.05 ok
8JTI_M P25788 Proteasome subunit alpha type-3 EM 3.80 2023-06-21 94.50 0.96 0.04 ok
9BF9_B D7RIG0 HLA class II histocompatibility antigen DR X-ray 3.40 2024-04-17 84.94 0.95 0.04 ok
9JU1_A P15692 Vascular endothelial growth factor A, long X-ray 1.45 2024-10-07 63.91 0.94 0.04 ok
8T6M_F P61769 Beta-2-microglobulin EM 3.14 2023-06-16 94.06 0.96 0.03 ok
9MIU_A P53355 Death-associated protein kinase 1 X-ray 1.90 2024-12-13 82.56 0.96 0.03 ok
8JTI_G P60900 Proteasome subunit alpha type-6 EM 3.80 2023-06-21 96.06 0.97 0.03 ok
8JTI_b P55036 26S proteasome non-ATPase regulatory subun EM 3.80 2023-06-21 72.06 0.96 0.03 ok
9BF9_A P01903 HLA class II histocompatibility antigen, D X-ray 3.40 2024-04-17 89.19 0.97 0.03 ok
8JTI_L P25786 Proteasome subunit alpha type-1 EM 3.80 2023-06-21 91.88 0.97 0.02 ok
9DQD_A Q96SW2 Protein cereblon EM 3.00 2024-09-23 86.62 0.97 0.02 ok
9BTX_B P61769 Beta-2-microglobulin X-ray 2.05 2024-05-15 94.06 0.98 0.02 ok
9DQD_B Q16531 DNA damage-binding protein 1 EM 3.00 2024-09-23 92.00 0.98 0.02 ok
8T6M_E I3QHR3 MHC class I antigen EM 3.14 2023-06-16 96.44 0.98 0.02 ok
9BU0_B P61769 Beta-2-microglobulin X-ray 2.89 2024-05-15 94.06 0.98 0.02 ok
9BTY_B P61769 Beta-2-microglobulin X-ray 2.85 2024-05-15 94.06 0.98 0.02 ok
9BTZ_B P61769 Beta-2-microglobulin X-ray 3.00 2024-05-15 94.06 0.98 0.02 ok
8T7R_D P61769 Beta-2-microglobulin X-ray 3.84 2023-06-21 94.06 0.98 0.02 ok
9E83_B O15393 Transmembrane protease serine 2 X-ray 2.07 2024-11-04 79.38 0.98 0.02 ok
8UVB_A Q86YT5 Solute carrier family 13 member 5 EM 2.13 2023-11-02 86.06 0.98 0.01 ok
8XEL_B P05106 Integrin beta-3 EM 2.80 2023-12-12 87.00 0.99 0.01 ok
8T7R_C F6IQR9 MHC class I antigen (Fragment) X-ray 3.84 2023-06-21 89.00 0.99 0.01 ok
8S0R_I P51946 Cyclin-H EM 2.40 2024-02-14 86.38 0.99 0.01 ok
8S0T_I P51946 Cyclin-H EM 2.30 2024-02-14 86.38 0.99 0.01 ok
8UVE_A Q8WWT9 Na(+)/dicarboxylate cotransporter 3 EM 2.60 2023-11-02 81.75 0.99 0.01 ok
8UVC_A Q8WWT9 Na(+)/dicarboxylate cotransporter 3 EM 2.09 2023-11-02 81.75 0.99 0.01 ok
8UVG_A Q8WWT9 Na(+)/dicarboxylate cotransporter 3 EM 2.92 2023-11-02 81.75 0.99 0.01 ok
8UVF_A Q8WWT9 Na(+)/dicarboxylate cotransporter 3 EM 2.17 2023-11-02 81.75 0.99 0.01 ok
8UVD_A Q8WWT9 Na(+)/dicarboxylate cotransporter 3 EM 2.16 2023-11-02 81.75 0.99 0.01 ok
9F6X_A P36897 TGF-beta receptor type-1 X-ray 2.68 2024-05-02 84.19 0.99 0.01 ok
8XEL_A P06756 Integrin alpha-V EM 2.80 2023-12-12 88.31 0.99 0.01 ok
8UVH_A Q86YT5 Solute carrier family 13 member 5 EM 2.33 2023-11-02 86.06 0.99 0.01 ok
9IKQ_A P61006 Ras-related protein Rab-8A X-ray 1.93 2024-06-28 85.44 0.99 0.01 ok
8QGX_A P08246 Neutrophil elastase X-ray 2.30 2023-09-06 88.19 0.99 0.01 ok
8XJ2_A P31153 S-adenosylmethionine synthase isoform type EM 3.16 2023-12-20 96.06 0.99 0.01 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.