Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2021-07-07

127
structures analysed (17 full · 13.4%)
32.4%
confidently wrong
10.8%
novel sequences
00.0%
novel & wrong
0.967
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 3 of 127 structures (2.4%) are confidently wrong; median TM-score is 0.967.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.967 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7OCM_A P14210 Hepatocyte growth factor alpha chain,Hepat X-ray 1.70 2021-04-27 26.70 90.65 0.55 0.88 5.78 13.87 0.68 ok
7OLE_A Q9Y265 RuvB-like 1 EM 3.41 2021-05-19 0.00 89.13 0.60 0.56 21.48 9.44 0.46 ok
6XNK_A P99999 Cytochrome c X-ray 2.08 2020-07-03 97.94 0.73 0.27 ok
6XMN_B P25024 C-X-C chemokine receptor type 1 NMR 2020-06-30 100.00 novel 45.05 0.24 0.70 21.55 11.09 0.25 ok
6XOU_A Q5JRX3 Presequence protease, mitochondrial EM 4.00 2020-07-07 94.31 0.74 0.24 ok
7MTS_E P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2021-05-13 89.56 0.80 0.18 ok
7MTS_C P63096 Guanine nucleotide-binding protein G(i) su EM 3.20 2021-05-13 93.75 0.81 0.18 ok
6XM2_I P61812 Transforming growth factor beta-2 X-ray 1.91 2020-06-29 80.12 0.78 0.17 ok
6XMN_A P10145 Interleukin-8 NMR 2020-06-30 88.06 0.81 0.17 ok
7MTS_A Q14416 Metabotropic glutamate receptor 2 EM 3.20 2021-05-13 85.69 0.83 0.15 ok
7MTR_A Q14416 Metabotropic glutamate receptor 2 EM 3.30 2021-05-13 85.69 0.83 0.15 ok
7JHJ_A P63096 Guanine nucleotide-binding protein G(i) su EM 3.20 2020-07-20 93.75 0.85 0.15 ok
7OLE_B Q9Y230 RuvB-like 2 EM 3.41 2021-05-19 84.12 0.83 0.14 ok
7E14_A P63092 Gs EM 2.90 2021-01-30 91.31 0.85 0.14 ok
7MTQ_A Q14416 Metabotropic glutamate receptor 2 EM 3.65 2021-05-13 85.69 0.84 0.14 ok
7OLE_K Q9Y4R8 Telomere length regulation protein TEL2 ho EM 3.41 2021-05-19 83.88 0.85 0.13 ok
7AHV_L P00740 Coagulation factor IX X-ray 3.11 2020-09-25 80.31 0.85 0.12 ok
7D0O_B O95696 BRD1 protein X-ray 2.51 2020-09-11 0.00 71.30 0.50 0.83 58.04 2.92 0.12 wrong
7E14_R P43220 Glucagon-like peptide 1 receptor EM 2.90 2021-01-30 81.50 0.86 0.12 ok
7D0Q_B O95696 BRD1 protein X-ray 2.21 2020-09-11 0.00 72.00 0.50 0.85 60.71 3.01 0.12 ok
7D0S_B O95696 BRD1 protein X-ray 2.30 2020-09-11 0.00 71.30 0.49 0.83 58.93 2.88 0.11 wrong
7D0P_B O95696 BRD1 protein X-ray 1.80 2020-09-11 0.00 71.30 0.51 0.86 60.71 2.89 0.11 ok
7D0R_B O95696 BRD1 protein X-ray 1.95 2020-09-11 0.00 71.75 0.48 0.87 63.89 2.71 0.11 wrong
7F4G_R Q8IXW5 RPAP2 EM 2.78 2021-06-18 64.25 0.85 0.10 ok
7OLE_H O43156 TELO2-interacting protein 1 homolog,TELO2- EM 3.41 2021-05-19 81.25 0.88 0.10 ok
7MIY_C P54284 Voltage-dependent L-type calcium channel s EM 3.10 2021-04-18 73.94 0.87 0.09 ok
7MIX_C P54284 Voltage-dependent L-type calcium channel s EM 3.00 2021-04-18 73.94 0.87 0.09 ok
7KHK_A P10721 Mast/stem cell growth factor receptor Kit X-ray 2.34 2020-10-21 78.19 0.90 0.08 ok
7KHJ_A P10721 Mast/stem cell growth factor receptor Kit X-ray 2.80 2020-10-21 78.19 0.91 0.07 ok
7M60_B P40692 DNA mismatch repair protein Mlh1 NLS pepti X-ray 2.30 2021-03-25 28.98 0.42 0.64 42.50 4.06 0.07 ok
7AHU_D P00742 Coagulation factor X X-ray 2.60 2020-09-25 80.25 0.91 0.07 ok
7MWM_A Q9UBB5 Methyl-CpG-binding domain protein 2 X-ray 1.60 2021-05-17 67.00 0.90 0.07 ok
7KHG_A P10721 Mast/stem cell growth factor receptor Kit X-ray 2.15 2020-10-21 78.19 0.92 0.06 ok
6WBA_B P40692 DNA mismatch repair protein Mlh1 X-ray 2.15 2020-03-26 28.98 0.46 0.70 50.00 3.10 0.06 ok
6WBC_B P40692 DNA mismatch repair protein Mlh1 X-ray 2.15 2020-03-26 28.98 0.45 0.67 52.50 3.07 0.06 ok
6WBB_B P40692 DNA mismatch repair protein Mlh1 X-ray 2.66 2020-03-26 28.98 0.44 0.67 52.50 3.03 0.06 ok
7M6J_C Q16181 Septin-7 EM 3.60 2021-03-25 80.19 0.93 0.06 ok
7JHJ_C P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2020-07-20 89.56 0.94 0.06 ok
7NY8_A P01116 GTPase KRas X-ray 1.80 2021-03-21 91.50 0.94 0.05 ok
7BDX_A O75031 Heat shock factor 2-binding protein X-ray 2.60 2020-12-22 91.00 0.94 0.05 ok
7MC9_B P0CG47 Ubiquitin X-ray 3.10 2021-04-01 93.44 0.95 0.05 ok
7M6J_A Q15019 Septin-2 EM 3.60 2021-03-25 81.81 0.94 0.05 ok
7A00_A Q9Y566 SH3 and multiple ankyrin repeat domains pr X-ray 1.78 2020-08-05 47.44 0.90 0.05 ok
7ABM_A O75531 Barrier-to-autointegration factor X-ray 3.00 2020-09-08 96.75 0.95 0.05 ok
7B80_A Q9BVA6 Protein adenylyltransferase FICD X-ray 1.87 2020-12-12 83.56 0.95 0.05 ok
7B7Z_A Q9BVA6 Protein adenylyltransferase FICD X-ray 1.70 2020-12-12 83.56 0.95 0.04 ok
7M2F_A P24941 Cyclin-dependent kinase 2 X-ray 1.63 2021-03-16 88.44 0.95 0.04 ok
6XOT_A Q5JRX3 Presequence protease, mitochondrial EM 3.90 2020-07-07 94.31 0.96 0.04 ok
6S4A_A P13995 Bifunctional methylenetetrahydrofolate deh X-ray 1.95 2019-06-27 0.00 97.38 0.99 0.98 97.47 0.67 0.04 ok
7MIX_A Q00975 Voltage-dependent N-type calcium channel s EM 3.00 2021-04-18 59.91 0.94 0.04 ok
7MIY_A Q00975 Voltage-dependent N-type calcium channel s EM 3.10 2021-04-18 59.91 0.94 0.04 ok
7N71_A P48426 Phosphatidylinositol 5-phosphate 4-kinase X-ray 2.50 2021-06-09 85.69 0.96 0.03 ok
7L9L_A Q15059 Bromodomain-containing protein 3 X-ray 1.55 2021-01-04 66.88 0.95 0.03 ok
7M6J_B Q14141 Septin-6 EM 3.60 2021-03-25 80.94 0.96 0.03 ok
7BA3_A P31947 14-3-3 protein sigma X-ray 1.40 2020-12-15 92.88 0.97 0.03 ok
6LO2_C Q15910 Histone-lysine N-methyltransferase EZH2 X-ray 2.21 2020-01-02 0.00 95.95 0.85 0.99 97.41 0.58 0.03 ok
7BAA_A P31947 14-3-3 protein sigma X-ray 1.10 2020-12-15 92.88 0.97 0.03 ok
7BA7_A P31947 14-3-3 protein sigma X-ray 1.45 2020-12-15 92.88 0.97 0.03 ok
7BA5_A P31947 14-3-3 protein sigma X-ray 1.45 2020-12-15 92.88 0.97 0.03 ok
7BA9_A P31947 14-3-3 protein sigma X-ray 1.48 2020-12-15 92.88 0.97 0.03 ok
7BK3_A O14757 Serine/threonine-protein kinase Chk1 X-ray 2.00 2021-01-15 76.12 0.96 0.03 ok
6S4E_A P13995 Bifunctional methylenetetrahydrofolate deh X-ray 1.90 2019-06-27 0.00 97.52 0.99 0.98 98.89 0.55 0.03 ok
7B9M_A P31947 14-3-3 protein sigma X-ray 1.70 2020-12-14 92.88 0.97 0.03 ok
7BA8_A P31947 14-3-3 protein sigma X-ray 1.20 2020-12-15 92.88 0.97 0.03 ok
7BA6_A P31947 14-3-3 protein sigma X-ray 1.40 2020-12-15 92.88 0.97 0.03 ok
7B9T_A P31947 14-3-3 protein sigma X-ray 1.15 2020-12-14 92.88 0.97 0.03 ok
7B9R_A P31947 14-3-3 protein sigma X-ray 1.15 2020-12-14 92.88 0.97 0.03 ok
7BK2_A O14757 Serine/threonine-protein kinase Chk1 X-ray 2.00 2021-01-15 76.12 0.96 0.03 ok
7BAB_A P31947 14-3-3 protein sigma X-ray 1.30 2020-12-15 92.88 0.97 0.03 ok
7BK1_A O14757 Serine/threonine-protein kinase Chk1 X-ray 2.00 2021-01-15 76.12 0.96 0.03 ok
7AHV_H P00740 Coagulation factor IX X-ray 3.11 2020-09-25 80.31 0.97 0.03 ok
7BJX_A O14757 Serine/threonine-protein kinase Chk1 X-ray 2.40 2021-01-14 76.12 0.97 0.03 ok
7MWK_A Q9UBB5 Methyl-CpG-binding domain protein 2 X-ray 2.45 2021-05-17 67.00 0.96 0.03 ok
6UNR_A Q04771 Activin receptor type-1 X-ray 2.20 2019-10-13 83.12 0.97 0.03 ok
6UNS_A Q04771 Activin receptor type-1 X-ray 2.30 2019-10-13 83.12 0.97 0.02 ok
6UNQ_A Q04771 Activin receptor type-1 X-ray 2.40 2019-10-13 83.12 0.97 0.02 ok
7L9K_A P25440 Bromodomain-containing protein 2 X-ray 1.95 2021-01-04 64.06 0.96 0.02 ok
6S4F_A P13995 Bifunctional methylenetetrahydrofolate deh X-ray 2.20 2019-06-27 0.00 97.66 1.00 0.99 99.83 0.40 0.02 ok
7CFZ_A Q86UR1 NADPH oxidase activator 1 X-ray 1.89 2020-06-29 72.06 0.97 0.02 ok
6X9J_A P26358 DNA (cytosine-5)-methyltransferase 1 X-ray 1.79 2020-06-02 77.81 0.97 0.02 ok
7EEF_A Q15375 Ephrin type-A receptor 7 X-ray 2.60 2021-03-18 81.94 0.97 0.02 ok
6LO2_A O75530 Polycomb protein EED X-ray 2.21 2020-01-02 0.00 97.25 0.99 0.98 98.35 0.58 0.02 ok
7EED_A Q15375 Ephrin type-A receptor 7 X-ray 3.05 2021-03-18 81.94 0.98 0.02 ok
6X9I_A P26358 DNA (cytosine-5)-methyltransferase 1 X-ray 2.20 2020-06-02 77.81 0.98 0.02 ok
7CUE_B P68871 Hemoglobin subunit beta X-ray 2.75 2020-08-22 97.19 0.98 0.02 ok
7JWI_B P61769 Beta-2-microglobulin X-ray 3.02 2020-08-25 94.06 0.98 0.02 ok
6XOS_A Q5JRX3 Presequence protease, mitochondrial EM 3.70 2020-07-07 94.31 0.98 0.02 ok
7MTS_D P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2021-05-13 97.06 0.98 0.02 ok
6X9K_A P26358 DNA (cytosine-5)-methyltransferase 1 X-ray 2.65 2020-06-02 77.81 0.98 0.02 ok
7EEC_A Q15375 Ephrin type-A receptor 7 X-ray 3.10 2021-03-18 81.94 0.98 0.02 ok
7BKN_A O14757 Serine/threonine-protein kinase Chk1 X-ray 2.74 2021-01-16 76.12 0.98 0.01 ok
7CUE_A P69905 Hemoglobin subunit alpha X-ray 2.75 2020-08-22 98.06 0.99 0.01 ok
7AHU_C P00742 Coagulation factor X X-ray 2.60 2020-09-25 80.25 0.98 0.01 ok
7BJO_A O14757 Serine/threonine-protein kinase Chk1 X-ray 2.30 2021-01-14 76.12 0.98 0.01 ok
7D0P_A O95251 Histone acetyltransferase KAT7 X-ray 1.80 2020-09-11 72.56 0.98 0.01 ok
7BJR_A O14757 Serine/threonine-protein kinase Chk1 X-ray 1.90 2021-01-14 76.12 0.99 0.01 ok
7BJJ_A O14757 Serine/threonine-protein kinase Chk1 X-ray 1.80 2021-01-14 76.12 0.99 0.01 ok
7BJH_A O14757 Serine/threonine-protein kinase Chk1 X-ray 1.80 2021-01-14 76.12 0.99 0.01 ok
7D0Q_A O95251 Histone acetyltransferase KAT7 X-ray 2.21 2020-09-11 72.56 0.98 0.01 ok
7E7A_A Q03111 Protein ENL X-ray 2.64 2021-02-25 64.69 0.98 0.01 ok
7BKO_A O14757 Serine/threonine-protein kinase Chk1 X-ray 2.30 2021-01-16 76.12 0.99 0.01 ok
7BJE_A O14757 Serine/threonine-protein kinase Chk1 X-ray 1.80 2021-01-14 76.12 0.99 0.01 ok
7D0S_A O95251 Histone acetyltransferase KAT7 X-ray 2.30 2020-09-11 72.56 0.99 0.01 ok
7BJD_A O14757 Serine/threonine-protein kinase Chk1 X-ray 2.00 2021-01-14 76.12 0.99 0.01 ok
7D0R_A O95251 Histone acetyltransferase KAT7 X-ray 1.95 2020-09-11 72.56 0.99 0.01 ok
7BJM_A O14757 Serine/threonine-protein kinase Chk1 X-ray 2.30 2021-01-14 76.12 0.99 0.01 ok
7E74_A Q03111 Protein ENL X-ray 2.90 2021-02-25 64.69 0.99 0.01 ok
6UNP_A Q13873 Bone morphogenetic protein receptor type-2 X-ray 2.30 2019-10-13 57.38 0.98 0.01 ok
6XOW_A Q5JRX3 Presequence protease, mitochondrial EM 4.60 2020-07-07 94.31 0.99 0.01 ok
7D0O_A O95251 Histone acetyltransferase KAT7 X-ray 2.51 2020-09-11 72.56 0.99 0.01 ok
7A3K_A Q6V1X1 Dipeptidyl peptidase 8 X-ray 2.65 2020-08-18 90.44 0.99 0.01 ok
7OR4_A Q6V1X1 Dipeptidyl peptidase 8 X-ray 2.44 2021-06-04 90.44 0.99 0.01 ok
7L9J_A P25440 Bromodomain-containing protein 2 X-ray 1.85 2021-01-04 64.06 0.99 0.01 ok
6XMO_A P04075 Fructose-bisphosphate aldolase A X-ray 2.60 2020-06-30 96.44 0.99 0.01 ok
6XOV_A Q5JRX3 Presequence protease, mitochondrial EM 3.30 2020-07-07 94.31 0.99 0.01 ok
7MIY_D P54289 Voltage-dependent calcium channel subunit EM 3.10 2021-04-18 86.56 0.99 0.00 ok
7MIX_D P54289 Voltage-dependent calcium channel subunit EM 3.00 2021-04-18 86.56 0.99 0.00 ok
7JHJ_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2020-07-20 97.06 1.00 0.00 ok
6XMM_A P04075 Fructose-bisphosphate aldolase A X-ray 2.11 2020-06-30 96.44 1.00 0.00 ok
6XMH_A P04075 Fructose-bisphosphate aldolase A X-ray 1.95 2020-06-30 96.44 1.00 0.00 ok
7O2B_A Q9H7B4 Histone-lysine N-methyltransferase SMYD3 X-ray 2.03 2021-03-30 97.31 1.00 0.00 ok
6XML_A P04075 Fructose-bisphosphate aldolase A X-ray 1.88 2020-06-30 96.44 1.00 0.00 ok
7O2C_A Q9H7B4 Histone-lysine N-methyltransferase SMYD3 X-ray 1.52 2021-03-30 97.31 1.00 0.00 ok
7CFQ_A P61964 WD repeat-containing protein 5 X-ray 1.60 2020-06-27 93.31 1.00 0.00 ok
7O2A_A Q9H7B4 Histone-lysine N-methyltransferase SMYD3 X-ray 1.57 2021-03-30 97.31 1.00 0.00 ok
7CFP_A P61964 WD repeat-containing protein 5 X-ray 1.60 2020-06-27 93.31 1.00 0.00 ok
6XOV_B P05067 Amyloid-beta precursor protein EM 3.30 2020-07-07 67.38 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.