Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2019-05-22

92
structures analysed (54 full · 58.7%)
22.2%
confidently wrong
44.3%
novel sequences
00.0%
novel & wrong
0.962
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 2 of 92 structures (2.2%) are confidently wrong; median TM-score is 0.962.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.962 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6K1A_A Q9NVH0 Exonuclease 3'-5' domain-containing protei X-ray 2.60 2019-05-10 67.30 92.27 0.60 0.93 1.54 21.28 0.80 ok
6K1D_A Q9NVH0 Exonuclease 3'-5' domain-containing protei X-ray 3.00 2019-05-10 67.30 92.55 0.61 0.91 2.08 20.83 0.79 ok
6K1B_A Q9NVH0 Exonuclease 3'-5' domain-containing protei X-ray 2.60 2019-05-10 67.30 92.25 0.60 0.92 1.29 21.24 0.78 ok
6K1C_A Q9NVH0 Exonuclease 3'-5' domain-containing protei X-ray 2.45 2019-05-10 67.30 92.38 0.60 0.92 1.80 21.04 0.78 ok
6K1E_A Q9NVH0 Exonuclease 3'-5' domain-containing protei X-ray 2.90 2019-05-10 67.30 92.19 0.60 0.91 2.04 21.33 0.77 ok
6K19_A Q9NVH0 Exonuclease 3'-5' domain-containing protei X-ray 2.20 2019-05-10 67.30 92.30 0.61 0.92 2.32 21.45 0.77 ok
6K17_A Q9NVH0 Exonuclease 3'-5' domain-containing protei X-ray 1.60 2019-05-10 67.30 91.97 0.60 0.91 3.00 21.34 0.76 ok
6K18_A Q9NVH0 Exonuclease 3'-5' domain-containing protei X-ray 2.30 2019-05-10 67.30 91.98 0.61 0.92 3.27 21.28 0.74 ok
5ZTF_A P16615 Sarcoplasmic/endoplasmic reticulum calcium X-ray 3.45 2018-05-03 1.10 87.72 0.65 0.82 19.16 11.51 0.50 ok
6JJU_A P16615 Sarcoplasmic/endoplasmic reticulum calcium X-ray 3.20 2019-02-27 1.10 87.62 0.65 0.83 19.94 11.32 0.49 ok
6Q8I_C Q13123 Protein Red X-ray 3.17 2018-12-14 0.20 83.80 0.48 0.76 17.68 8.37 0.43 wrong
6NJD_A F5H747 Di-ubiquitin X-ray 2.05 2019-01-03 2.60 94.23 0.57 0.96 20.10 7.20 0.43 ok
6Q8F_A Q2TAY7 WD40 repeat-containing protein SMU1 X-ray 1.90 2018-12-14 0.00 79.56 0.62 0.83 20.81 12.45 0.42 ok
6Q8I_K Q13123 Protein Red X-ray 3.17 2018-12-14 0.40 84.01 0.47 0.77 18.75 7.92 0.41 wrong
6NYY_A Q9Y4W6 AFG3-like protein 2 EM 3.00 2019-02-12 47.80 90.14 0.78 0.91 40.41 5.05 0.26 ok
6OVC_A Q07820 Induced myeloid leukemia cell differentiat NMR 2019-05-07 0.00 87.63 0.81 0.68 48.78 6.96 0.20 ok
6Q8I_A Q2TAY7 WD40 repeat-containing protein SMU1 X-ray 3.17 2018-12-14 0.00 80.44 0.79 0.90 49.73 3.56 0.16 ok
5ZSW_A P98175 RNA-binding protein 10 NMR 2018-04-30 59.97 0.75 0.15 ok
6OT2_A Q8NET8 Transient receptor potential cation channe EM 4.10 2019-05-02 53.40 86.47 0.94 0.83 66.08 6.35 0.13 ok
6O58_A Q8NE86 Calcium uniporter protein, mitochondrial EM 3.80 2019-03-01 3.30 90.83 0.89 0.90 64.84 2.43 0.12 ok
6O5B_A Q8NE86 Calcium uniporter protein, mitochondrial EM 3.60 2019-03-01 3.30 90.83 0.89 0.89 64.93 2.38 0.12 ok
6OT5_A Q8NET8 Transient receptor potential cation channe EM 3.60 2019-05-02 53.40 86.63 0.94 0.85 66.57 6.12 0.12 ok
6QFL_A O14733 Dual specificity mitogen-activated protein X-ray 2.20 2019-01-10 0.00 88.99 0.89 0.86 70.47 2.81 0.11 ok
6QFR_A O14733 Dual specificity mitogen-activated protein X-ray 2.30 2019-01-10 0.00 90.48 0.90 0.91 71.47 2.36 0.11 ok
6QHR_A O14733 Dual specificity mitogen-activated protein X-ray 2.52 2019-01-17 0.00 89.02 0.90 0.87 71.94 2.73 0.11 ok
6QG7_A O14733 Dual specificity mitogen-activated protein X-ray 2.10 2019-01-10 0.00 89.10 0.90 0.89 73.49 2.76 0.10 ok
6QG4_A O14733 Dual specificity mitogen-activated protein X-ray 2.30 2019-01-10 0.00 90.25 0.91 0.90 73.62 2.41 0.10 ok
6QHO_A O14733 Dual specificity mitogen-activated protein X-ray 2.70 2019-01-17 0.00 89.78 0.91 0.89 74.55 2.37 0.10 ok
6QFT_A O14733 Dual specificity mitogen-activated protein X-ray 2.70 2019-01-10 0.00 89.64 0.91 0.89 74.64 2.34 0.10 ok
6Q8J_A Q2TAY7 WD40 repeat-containing protein SMU1 X-ray 1.80 2018-12-14 0.00 80.33 0.91 0.90 73.40 2.42 0.09 ok
6O8C_D Q86WV6 Stimulator of interferon genes protein X-ray 3.17 2019-03-09 2.70 45.45 0.25 0.83 50.00 3.23 0.09 ok
6NSS_A P04629 High affinity nerve growth factor receptor X-ray 1.97 2019-01-25 0.00 85.55 0.94 0.86 81.93 3.29 0.08 ok
6O58_B Q9H4I9 Essential MCU regulator, mitochondrial EM 3.80 2019-03-01 100.00 novel 86.54 0.73 0.94 78.06 1.48 0.08 ok
6O8B_D Q86WV6 Stimulator of interferon genes protein X-ray 3.40 2019-03-09 0.90 47.20 0.45 0.73 61.36 2.90 0.08 ok
6N1K_A P00439 Phenylalanine-4-hydroxylase X-ray 3.06 2018-11-08 7.40 91.61 0.96 0.92 86.28 1.66 0.07 ok
6O1D_C P04908 Histone H2A type 1-B/E EM 3.40 2019-02-19 0.00 96.71 0.93 0.96 86.92 1.55 0.07 ok
6O5B_B Q9H4I9 Essential MCU regulator, mitochondrial EM 3.60 2019-03-01 100.00 novel 86.54 0.79 0.94 83.16 1.27 0.07 ok
6E0P_C P04908 Histone H2A type 1-B/E EM 2.60 2018-07-06 90.75 0.93 0.06 ok
6E0C_C P04908 Histone H2A type 1-B/E EM 2.63 2018-07-06 90.75 0.93 0.06 ok
6NSP_A P04629 High affinity nerve growth factor receptor X-ray 2.31 2019-01-25 0.00 87.11 0.96 0.91 89.51 2.01 0.06 ok
6NPT_A P04629 High affinity nerve growth factor receptor X-ray 2.19 2019-01-18 0.00 87.22 0.96 0.91 89.32 2.12 0.06 ok
6HY7_A Q9UGM1 Neuronal acetylcholine receptor subunit al X-ray 2.26 2018-10-19 80.94 0.93 0.05 ok
6E4X_Y Q8TCD0 S5V2-29 light chain X-ray 2.25 2018-07-18 91.50 0.94 0.05 ok
6O8B_A Q9UHD2 Serine/threonine-protein kinase TBK1 X-ray 3.40 2019-03-09 0.80 93.20 0.98 0.93 92.50 1.34 0.05 ok
6NY4_A P52333 Tyrosine-protein kinase JAK3 X-ray 2.33 2019-02-11 0.00 92.06 0.97 0.95 92.24 1.09 0.05 ok
6NVQ_B Q8N300 Small vasohibin-binding protein X-ray 2.10 2019-02-05 100.00 novel 98.08 0.76 0.99 96.43 0.80 0.05 ok
6EEL_A Q9NZM1 Myoferlin X-ray 1.93 2018-08-14 79.38 0.94 0.04 ok
6NZU_A Q9Y697 Cysteine desulfurase, mitochondrial EM 3.20 2019-02-14 0.00 95.85 0.98 0.95 95.77 0.98 0.04 ok
6O1D_A P49450 Histone H3-like centromeric protein A EM 3.40 2019-02-19 1.30 92.04 0.96 0.93 95.45 1.35 0.04 ok
6O1D_B P62805 Histone H4 EM 3.40 2019-02-19 0.00 95.80 0.96 0.96 97.19 1.27 0.04 ok
6E56_I Q6PIL8 antibody H2214 light chain, K1642 X-ray 2.00 2018-07-19 92.12 0.96 0.04 ok
6NZU_D Q9H1K1 Iron-sulfur cluster assembly enzyme ISCU, EM 3.20 2019-02-14 0.90 95.06 0.98 0.93 96.95 0.66 0.03 ok
6O95_A Q9NWZ3 Interleukin-1 receptor-associated kinase 4 X-ray 1.77 2019-03-13 2.20 92.36 0.98 0.97 96.82 1.26 0.03 ok
6O8U_A Q9NWZ3 Interleukin-1 receptor-associated kinase 4 X-ray 1.80 2019-03-12 0.00 93.16 0.99 0.97 96.82 0.69 0.03 ok
6O9D_A Q9NWZ3 Interleukin-1 receptor-associated kinase 4 X-ray 2.51 2019-03-13 2.20 92.71 0.99 0.97 97.81 1.23 0.03 ok
6E0P_B P62805 Histone H4 EM 2.60 2018-07-06 89.81 0.97 0.03 ok
6NZU_B Q9HD34 LYR motif-containing protein 4 EM 3.20 2019-02-14 0.00 96.51 0.97 0.95 99.38 0.53 0.03 ok
6NZU_I Q16595 Frataxin, mitochondrial EM 3.20 2019-02-14 0.00 94.74 0.98 0.95 98.94 0.55 0.03 ok
6E0C_B P62805 Histone H4 EM 2.63 2018-07-06 89.81 0.97 0.03 ok
6E0P_A P49450 Histone H3-like centromeric protein A EM 2.60 2018-07-06 81.50 0.97 0.03 ok
6E0C_A P49450 Histone H3-like centromeric protein A EM 2.63 2018-07-06 81.50 0.97 0.03 ok
6O94_A Q9NWZ3 Interleukin-1 receptor-associated kinase 4 X-ray 1.98 2019-03-13 2.20 92.30 0.99 0.96 97.09 0.73 0.03 ok
6HKS_A P26045 Tyrosine-protein phosphatase non-receptor X-ray 2.19 2018-09-07 73.50 0.96 0.03 ok
6O1D_D P06899 Histone H2B type 1-J EM 3.40 2019-02-19 0.00 96.35 0.98 0.98 99.47 0.48 0.02 ok
6H1D_B Q9UI30 Multifunctional methyltransferase subunit X-ray 1.94 2018-07-11 92.12 0.97 0.02 ok
6NVQ_C Q7L8A9 Tubulinyl-Tyr carboxypeptidase 1 X-ray 2.10 2019-02-05 100.00 novel 96.18 0.99 0.99 99.08 0.45 0.02 ok
6H1E_B Q9UI30 Multifunctional methyltransferase subunit X-ray 1.90 2018-07-11 92.12 0.98 0.02 ok
6GHK_A P09874 Poly [ADP-ribose] polymerase 1 X-ray 2.28 2018-05-08 82.38 0.97 0.02 ok
6QS1_A P12821 Angiotensin-converting enzyme X-ray 1.80 2019-02-20 0.00 94.83 1.00 0.99 99.55 0.41 0.02 ok
6GGH_A P23458 Tyrosine-protein kinase JAK1 X-ray 1.70 2018-05-03 85.56 0.98 0.01 ok
6E0C_D P06899 Histone H2B type 1-J EM 2.63 2018-07-06 85.50 0.98 0.01 ok
6H1E_A Q9Y5N5 HemK methyltransferase family member 2 X-ray 1.90 2018-07-11 94.50 0.99 0.01 ok
6H1D_A Q9Y5N5 HemK methyltransferase family member 2 X-ray 1.94 2018-07-11 94.50 0.99 0.01 ok
6E0P_D P06899 Histone H2B type 1-J EM 2.60 2018-07-06 85.50 0.99 0.01 ok
6DGP_A P37231 Peroxisome proliferator-activated receptor X-ray 3.10 2018-05-17 76.12 0.98 0.01 ok
6DF5_A Q86T24 Transcriptional regulator Kaiso X-ray 1.82 2018-05-14 54.78 0.98 0.01 ok
6DGQ_A P37231 Peroxisome proliferator-activated receptor X-ray 2.45 2018-05-17 76.12 0.99 0.01 ok
6DGO_A P37231 Peroxisome proliferator-activated receptor X-ray 3.10 2018-05-17 76.12 0.99 0.01 ok
6DFC_A Q86T24 Transcriptional regulator Kaiso X-ray 1.85 2018-05-14 54.78 0.98 0.01 ok
6DH9_A P37231 Peroxisome proliferator-activated receptor X-ray 2.70 2018-05-18 76.12 0.99 0.01 ok
6DF8_A Q86T24 Transcriptional regulator Kaiso X-ray 2.54 2018-05-14 54.78 0.98 0.01 ok
6DFB_A Q86T24 Transcriptional regulator Kaiso X-ray 1.66 2018-05-14 54.78 0.98 0.01 ok
6DGR_A P37231 Peroxisome proliferator-activated receptor X-ray 2.15 2018-05-18 76.12 0.99 0.01 ok
6DGL_A P37231 Peroxisome proliferator-activated receptor X-ray 1.95 2018-05-17 76.12 0.99 0.01 ok
6DFA_A Q86T24 Transcriptional regulator Kaiso X-ray 1.91 2018-05-14 54.78 0.98 0.01 ok
6DF9_A Q86T24 Transcriptional regulator Kaiso X-ray 2.32 2018-05-14 54.78 0.99 0.01 ok
6GGC_A P04637 Cellular tumor antigen p53 X-ray 1.24 2018-05-03 75.06 0.99 0.01 ok
6GGB_A P04637 Cellular tumor antigen p53 X-ray 1.32 2018-05-03 75.06 0.99 0.01 ok
6GGA_A P04637 Cellular tumor antigen p53 X-ray 1.55 2018-05-03 75.06 0.99 0.01 ok
6GGD_A P04637 Cellular tumor antigen p53 X-ray 1.40 2018-05-03 75.06 0.99 0.01 ok
6GGF_A P04637 Cellular tumor antigen p53 X-ray 1.32 2018-05-03 75.06 0.99 0.01 ok
6GGE_A P04637 Cellular tumor antigen p53 X-ray 1.25 2018-05-03 75.06 0.99 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.