Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2019-02-27

101
structures analysed (49 full · 48.5%)
22.0%
confidently wrong
87.9%
novel sequences
00.0%
novel & wrong
0.965
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 2 of 101 structures (2.0%) are confidently wrong; median TM-score is 0.965.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.965 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6J08_A Q3KP22 Membrane-anchored junction protein X-ray 2.90 2018-12-21 100.00 novel 66.56 0.42 0.32 0.75 26.22 0.63 ok
6N88_B Q14974 Importin subunit beta-1 EM 6.20 2018-11-28 0.00 94.90 0.62 0.52 14.35 12.50 0.59 ok
6N89_A Q14974 Importin subunit beta-1 EM 7.50 2018-11-28 0.00 94.90 0.68 0.63 20.33 11.24 0.51 ok
6QJM_A P10636 Microtubule-associated protein tau EM 3.30 2019-01-24 0.00 65.88 0.29 0.52 2.03 12.13 0.51 ok
6ICT_E P60709 Actin, cytoplasmic 1 X-ray 1.95 2018-09-07 0.00 96.32 0.15 0.67 21.05 8.56 0.49 wrong
6ICV_C P60709 Actin, cytoplasmic 1 X-ray 2.15 2018-09-07 0.00 96.09 0.20 0.64 22.06 8.08 0.46 wrong
6J08_D Q8NHR7 Telomere repeats-binding bouquet formation X-ray 2.90 2018-12-21 100.00 novel 62.45 0.31 0.76 5.56 12.69 0.45 ok
6QEX_A P08183 Multidrug resistance protein 1 EM 3.60 2019-01-08 0.30 88.74 0.89 0.82 45.30 4.44 0.23 ok
6ILD_C Q13155 Aminoacyl tRNA synthase complex-interactin X-ray 1.88 2018-10-17 4.80 55.53 0.25 0.81 25.83 5.91 0.21 ok
6J07_A Q8NHR7 Telomere repeats-binding bouquet formation X-ray 3.30 2018-12-21 100.00 novel 94.25 0.88 0.82 55.61 6.02 0.20 ok
6NHY_A O14763 Tumor necrosis factor receptor superfamily NMR 2018-12-24 100.00 novel 79.70 0.50 0.83 48.61 4.69 0.19 ok
6QAU_A Q8IYT8 Serine/threonine-protein kinase ULK2 X-ray 2.48 2018-12-19 24.50 90.21 0.89 0.89 57.82 6.82 0.19 ok
6QAV_A Q8IYT8 Serine/threonine-protein kinase ULK2 X-ray 2.05 2018-12-19 24.50 90.54 0.88 0.88 58.09 6.50 0.18 ok
6M8R_K O75899 Gamma-aminobutyric acid type B receptor su X-ray 3.20 2018-08-22 100.00 novel 34.45 0.39 0.55 16.67 8.39 0.18 ok
6J07_B Q8NA31 Telomere repeats-binding bouquet formation X-ray 3.30 2018-12-21 100.00 novel 73.86 0.74 0.82 48.75 5.57 0.16 ok
6NHW_A O14763 Tumor necrosis factor receptor superfamily NMR 2018-12-24 100.00 novel 79.70 0.53 0.69 53.47 3.76 0.15 ok
6QAT_A Q8IYT8 Serine/threonine-protein kinase ULK2 X-ray 2.77 2018-12-19 24.50 91.70 0.91 0.90 71.62 5.14 0.13 ok
6N89_B P07305 Histone H1.0 EM 7.50 2018-11-28 23.80 95.05 0.75 0.72 70.27 2.29 0.12 ok
6H5T_A Q15811 Intersectin-1 X-ray 1.69 2018-07-25 72.31 0.83 0.12 ok
6NF8_z Q9H2K0 Translation initiation factor IF-3, mitoch EM 3.48 2018-12-19 30.40 88.54 0.90 0.81 71.01 2.31 0.11 ok
6NEQ_z Q9H2K0 Translation initiation factor IF-3, mitoch EM 3.32 2018-12-18 30.40 88.54 0.91 0.82 73.31 2.25 0.10 ok
6J8H_B Q07699 Sodium channel subunit beta-1 EM 3.20 2019-01-19 48.40 93.02 0.90 0.94 72.83 1.86 0.10 ok
6J8G_B Q07699 Sodium channel subunit beta-1 EM 3.20 2019-01-19 48.40 93.02 0.90 0.94 72.83 1.86 0.10 ok
6J8J_B Q07699 Sodium channel subunit beta-1 EM 3.20 2019-01-19 48.40 93.02 0.90 0.93 73.99 1.86 0.10 ok
6J8I_B Q07699 Sodium channel subunit beta-1 EM 3.20 2019-01-19 48.40 93.02 0.90 0.93 73.99 1.86 0.10 ok
6ITH_A P34741 Syndecan-2 NMR 2018-11-23 100.00 novel 87.24 0.79 0.92 79.29 2.45 0.09 ok
6I12_A Q16658 Fascin X-ray 1.65 2018-10-27 94.19 0.91 0.09 ok
6I18_A Q16658 Fascin X-ray 1.49 2018-10-27 94.19 0.91 0.09 ok
6I11_A Q16658 Fascin X-ray 1.67 2018-10-27 94.19 0.91 0.09 ok
6I16_A Q16658 Fascin X-ray 2.00 2018-10-27 94.19 0.91 0.09 ok
6I17_A Q16658 Fascin X-ray 1.56 2018-10-27 94.19 0.91 0.09 ok
6N88_C P07305 Histone H1.0 EM 6.20 2018-11-28 23.80 95.05 0.84 0.77 79.39 1.59 0.08 ok
6I14_A Q16658 Fascin X-ray 1.73 2018-10-27 94.19 0.91 0.08 ok
6J99_K Q8TEK3 Histone-lysine N-methyltransferase, H3 lys EM 4.10 2019-01-22 0.00 89.85 0.94 0.81 79.09 1.81 0.08 ok
6HOL_C Q6ZNE5 Beclin 1-associated autophagy-related key X-ray 1.40 2018-09-17 47.49 0.43 0.61 65.00 2.88 0.08 ok
6IB0_A O14733 Dual specificity mitogen-activated protein X-ray 2.60 2018-11-28 77.25 0.90 0.08 ok
6HX1_A O75460 Serine/threonine-protein kinase/endoribonu X-ray 2.14 2018-10-15 72.69 0.89 0.08 ok
6J99_L P62979 Ubiquitin EM 4.10 2019-01-22 0.00 91.41 0.85 0.81 81.58 1.76 0.08 ok
6I13_A Q16658 Fascin X-ray 1.79 2018-10-27 94.19 0.92 0.08 ok
6NCM_A O00409 Forkhead box protein N3 X-ray 2.70 2018-12-11 43.50 92.06 0.90 0.90 82.97 2.24 0.08 ok
6HV0_A O75460 Serine/threonine-protein kinase/endoribonu X-ray 2.73 2018-10-09 72.69 0.90 0.07 ok
6I15_A Q16658 Fascin X-ray 1.91 2018-10-27 94.19 0.92 0.07 ok
6I10_A Q16658 Fascin X-ray 2.10 2018-10-27 94.19 0.92 0.07 ok
6J8E_A Q99250 Sodium channel protein type 2 subunit alph EM 3.00 2019-01-18 43.80 84.03 0.98 0.89 83.43 1.80 0.07 ok
6I0Z_A Q16658 Fascin X-ray 1.77 2018-10-27 94.19 0.93 0.06 ok
6J8H_A Q15858 Sodium channel protein type 9 subunit alph EM 3.20 2019-01-19 45.20 84.56 0.99 0.90 86.73 1.46 0.06 ok
6J8G_A Q15858 Sodium channel protein type 9 subunit alph EM 3.20 2019-01-19 45.20 84.56 0.99 0.90 86.73 1.46 0.06 ok
6IB2_A O14733 Dual specificity mitogen-activated protein X-ray 2.10 2018-11-28 77.25 0.92 0.06 ok
6J8J_A Q15858 Sodium channel protein type 9 subunit alph EM 3.20 2019-01-19 45.20 84.56 0.99 0.90 87.21 1.44 0.06 ok
6J8I_A Q15858 Sodium channel protein type 9 subunit alph EM 3.20 2019-01-19 45.20 84.56 0.99 0.90 87.21 1.44 0.06 ok
6M8S_E P59768 Guanine nucleotide-binding protein G(I)/G( X-ray 3.71 2018-08-22 89.56 0.94 0.06 ok
6HOI_A Q9H0R8 Gamma-aminobutyric acid receptor-associate X-ray 1.14 2018-09-17 95.00 0.94 0.05 ok
6HOL_A Q9H0R8 Gamma-aminobutyric acid receptor-associate X-ray 1.40 2018-09-17 95.00 0.95 0.05 ok
6QAS_A O75385 Serine/threonine-protein kinase ULK1 X-ray 1.75 2018-12-19 0.00 90.65 0.96 0.92 91.88 1.39 0.05 ok
6J71_A P04626 Receptor tyrosine-protein kinase erbB-2 X-ray 2.92 2019-01-16 0.00 89.47 0.98 0.94 93.20 1.39 0.04 ok
6HMT_A P31947 14-3-3 protein sigma X-ray 1.10 2018-09-12 92.88 0.97 0.03 ok
6J8H_C O60939 Sodium channel subunit beta-2 EM 3.20 2019-01-19 1.70 96.06 0.98 0.94 96.88 0.63 0.03 ok
6J8G_C O60939 Sodium channel subunit beta-2 EM 3.20 2019-01-19 1.70 96.06 0.98 0.94 96.88 0.63 0.03 ok
6HHP_A P31947 14-3-3 protein sigma X-ray 1.80 2018-08-28 92.88 0.97 0.03 ok
6HKB_A P31947 14-3-3 protein sigma X-ray 1.70 2018-09-06 92.88 0.97 0.03 ok
6HN2_A P31947 14-3-3 protein sigma X-ray 1.70 2018-09-13 92.88 0.97 0.03 ok
6QNV_A P24821 Tenascin X-ray 1.40 2019-02-12 55.30 89.87 0.99 0.95 98.46 0.61 0.03 ok
6HKF_A P31947 14-3-3 protein sigma X-ray 1.80 2018-09-06 92.88 0.97 0.03 ok
6J8J_C O60939 Sodium channel subunit beta-2 EM 3.20 2019-01-19 1.70 96.06 0.98 0.95 97.71 0.58 0.03 ok
6J8I_C O60939 Sodium channel subunit beta-2 EM 3.20 2019-01-19 1.70 96.06 0.98 0.95 97.71 0.58 0.03 ok
6HMU_A P31947 14-3-3 protein sigma X-ray 1.20 2018-09-12 92.88 0.97 0.03 ok
6J81_A Q9Y5P4 LIPID-TRANSFER PROTEIN CERT X-ray 1.80 2019-01-18 0.00 94.66 0.99 0.97 98.23 0.72 0.03 ok
6M8S_A Q96CX2 BTB/POZ domain-containing protein KCTD12 X-ray 3.71 2018-08-22 75.81 0.96 0.03 ok
6NCE_A O00409 Forkhead box protein N3 X-ray 2.60 2018-12-11 43.50 93.32 0.97 0.95 98.03 0.78 0.03 ok
6J8E_C O60939 Sodium channel subunit beta-2 EM 3.00 2019-01-18 1.70 95.53 0.98 0.96 97.75 0.78 0.03 ok
6J0O_A Q9Y5P4 LIPID-TRANSFER PROTEIN CERT X-ray 1.80 2018-12-25 0.00 94.46 0.99 0.97 97.71 0.70 0.03 ok
6GHM_A P62136 Serine/threonine-protein phosphatase PP1-a X-ray 2.15 2018-05-08 91.25 0.97 0.03 ok
6E3L_E P38484 Interferon gamma receptor 2 X-ray 3.80 2018-07-14 83.75 0.97 0.03 ok
6QH4_A Q96PE7 Methylmalonyl-CoA epimerase, mitochondrial X-ray 1.92 2019-01-15 0.80 97.24 0.99 0.96 97.71 0.92 0.03 ok
6E3K_E P38484 Interferon gamma receptor 2 X-ray 3.25 2018-07-14 83.75 0.97 0.03 ok
6NO9_A P11309 Serine/threonine-protein kinase pim-1 X-ray 1.71 2019-01-15 0.00 97.04 0.99 0.99 98.26 0.50 0.02 ok
6HKN_A Q13164 Mitogen-activated protein kinase 7 X-ray 2.33 2018-09-07 65.06 0.97 0.02 ok
6GHM_C Q13625 Apoptosis-stimulating of p53 protein 2 X-ray 2.15 2018-05-08 58.97 0.96 0.02 ok
6HKM_A Q13164 Mitogen-activated protein kinase 7 X-ray 2.47 2018-09-07 65.06 0.97 0.02 ok
6E3L_A P01579 Interferon gamma X-ray 3.80 2018-07-14 85.31 0.98 0.02 ok
6E3K_A P01579 Interferon gamma X-ray 3.25 2018-07-14 85.31 0.98 0.02 ok
6QJE_A P51570 Galactokinase X-ray 2.40 2019-01-24 0.60 97.27 1.00 0.99 99.68 0.37 0.02 ok
6M8R_A Q68DU8 BTB/POZ domain-containing protein KCTD16 X-ray 3.20 2018-08-22 69.06 0.98 0.02 ok
6E3K_C P15260 Interferon gamma receptor 1 X-ray 3.25 2018-07-14 66.00 0.98 0.01 ok
5ZYG_A Q9Y5P4 LIPID-TRANSFER PROTEIN CERT X-ray 1.80 2018-05-25 77.00 0.98 0.01 ok
5ZYM_A Q9Y5P4 LIPID-TRANSFER PROTEIN CERT X-ray 1.90 2018-05-25 77.00 0.98 0.01 ok
5ZYL_A Q9Y5P4 LIPID-TRANSFER PROTEIN CERT X-ray 1.80 2018-05-25 77.00 0.99 0.01 ok
5ZYJ_A Q9Y5P4 LIPID-TRANSFER PROTEIN CERT X-ray 1.90 2018-05-25 77.00 0.99 0.01 ok
6E3L_C P15260 Interferon gamma receptor 1 X-ray 3.80 2018-07-14 66.00 0.98 0.01 ok
5ZYI_A Q9Y5P4 LIPID-TRANSFER PROTEIN CERT X-ray 1.90 2018-05-25 77.00 0.99 0.01 ok
6IF0_A Q9Y5P4 LIPID-TRANSFER PROTEIN CERT X-ray 1.80 2018-09-18 77.00 0.99 0.01 ok
6IEZ_A Q9Y5P4 LIPID-TRANSFER PROTEIN CERT X-ray 1.90 2018-09-18 77.00 0.99 0.01 ok
5ZYH_A Q9Y5P4 LIPID-TRANSFER PROTEIN CERT X-ray 1.95 2018-05-25 77.00 0.99 0.01 ok
5ZYK_A Q9Y5P4 LIPID-TRANSFER PROTEIN CERT X-ray 1.55 2018-05-25 77.00 0.99 0.01 ok
6ILH_A Q15046 Lysine-tRNA ligase X-ray 2.50 2018-10-18 90.50 0.99 0.01 ok
6ILD_A Q15046 Lysine--tRNA ligase X-ray 1.88 2018-10-17 90.50 0.99 0.01 ok
6M8S_C P62873 Guanine nucleotide-binding protein G(I)/G( X-ray 3.71 2018-08-22 97.06 1.00 0.00 ok
6MBO_A Q9H9B1 Histone-lysine N-methyltransferase EHMT1 X-ray 1.59 2018-08-30 63.91 0.99 0.00 ok
6ICV_A Q86TU7 Histone-lysine N-methyltransferase setd3 X-ray 2.15 2018-09-07 86.38 1.00 0.00 ok
6MBP_A Q9H9B1 Histone-lysine N-methyltransferase EHMT1 X-ray 1.95 2018-08-30 63.91 1.00 0.00 ok
6ICT_A Q86TU7 Histone-lysine N-methyltransferase setd3 X-ray 1.95 2018-09-07 86.38 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.