Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2019-08-14

75
structures analysed (59 full · 78.7%)
56.7%
confidently wrong
56.7%
novel sequences
00.0%
novel & wrong
0.942
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 5 of 75 structures (6.7%) are confidently wrong; median TM-score is 0.942.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.942 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6PE8_T P25942 Tumor necrosis factor receptor superfamily X-ray 2.84 2019-06-20 0.00 95.08 0.62 0.87 16.04 12.78 0.55 ok
6PY8_F P46531 Neurogenic locus notch homolog protein 1 X-ray 3.75 2019-07-29 0.00 80.13 0.89 0.85 11.81 16.41 0.51 ok
6KBO_B P05546 Heparin cofactor 2 NMR 2019-06-26 0.00 87.29 0.33 0.42 14.29 8.93 0.48 wrong
6KBV_B P05546 Heparin cofactor 2 NMR 2019-06-26 0.00 87.29 0.33 0.45 18.75 8.44 0.45 wrong
6H9J_D Q8NET8 Transient receptor potential cation channe X-ray 1.83 2018-08-04 13.70 92.65 0.33 0.65 28.41 6.44 0.38 wrong
6HBY_C Q13641 ARRPPLAELAALNLSGSRL 5T4 tumour epitope X-ray 1.95 2018-08-13 94.38 0.21 0.63 28.95 6.21 0.35 wrong
6SEF_V Q03188 Centromere protein C EM 3.70 2019-07-29 100.00 novel 48.17 0.22 0.58 19.44 7.89 0.22 ok
6SE6_V Q03188 Centromere protein C EM 3.50 2019-07-29 100.00 novel 48.17 0.23 0.58 20.83 7.81 0.22 ok
6SEE_V Q03188 Centromere protein C EM 4.20 2019-07-29 100.00 novel 48.17 0.23 0.62 23.61 6.73 0.20 ok
6OB1_C Q9UJX6 Anaphase-promoting complex subunit 2 NMR 2019-03-19 0.00 73.83 0.72 0.71 42.50 6.17 0.19 ok
6PE9_G P25942 Tumor necrosis factor receptor superfamily X-ray 3.13 2019-06-20 0.00 95.25 0.81 0.91 55.99 3.31 0.18 ok
6NRI_A P09874 Poly [ADP-ribose] polymerase 1 X-ray 2.20 2019-01-23 0.00 94.30 0.98 0.88 61.62 6.58 0.17 ok
6H3M_B P01308 Insulin X-ray 1.82 2018-07-19 0.00 48.56 0.35 0.50 41.38 5.39 0.14 ok
6QXU_A O95271 Poly [ADP-ribose] polymerase tankyrase-1 X-ray 1.20 2019-03-08 0.00 64.41 0.72 0.63 50.72 8.18 0.14 ok
6NRH_A P09874 Poly [ADP-ribose] polymerase 1 X-ray 1.50 2019-01-23 0.00 93.90 0.98 0.90 70.66 4.79 0.13 ok
6NRF_A P09874 Poly [ADP-ribose] polymerase 1 X-ray 2.00 2019-01-23 0.00 93.90 0.98 0.90 70.55 4.79 0.13 ok
6NRJ_A P09874 Poly [ADP-ribose] polymerase 1 X-ray 1.65 2019-01-23 0.00 93.90 0.98 0.90 70.76 4.79 0.13 ok
6NRG_A P09874 Poly [ADP-ribose] polymerase 1 X-ray 1.70 2019-01-23 0.00 93.90 0.98 0.90 71.29 4.78 0.13 ok
6H3M_A P01308 Insulin X-ray 1.82 2018-07-19 9.60 51.25 0.30 0.51 45.24 4.61 0.13 ok
6GL7_A Q99748 Neurturin EM 6.30 2018-05-23 79.19 0.85 0.12 ok
6O1Q_A O15259 Nephrocystin-1 NMR 2019-02-21 100.00 novel 80.80 0.79 0.84 65.00 3.32 0.12 ok
6JCS_R Q8IZA0 Dyslexia-associated protein KIAA0319-like EM 3.18 2019-01-30 41.10 81.55 0.78 0.74 70.10 2.52 0.11 ok
6GL7_E P07949 Proto-oncogene tyrosine-protein kinase rec EM 6.30 2018-05-23 78.81 0.87 0.10 ok
6K67_B P0DP25 Engineered calmodulin X-ray 1.95 2019-06-01 22.00 84.50 0.80 0.93 74.03 3.25 0.10 ok
6PY8_B Q7Z6K4 Notch-regulated ankyrin repeat-containing X-ray 3.75 2019-07-29 62.50 89.36 0.91 0.75 76.84 2.16 0.10 ok
6IWV_A P81877 Single-stranded DNA-binding protein 2 X-ray 1.52 2018-12-07 100.00 novel 90.33 0.88 0.92 76.89 2.63 0.10 ok
6SE0_D P62807 Histone H2B type 1-C/E/F/G/I EM 3.80 2019-07-29 0.00 93.36 0.85 0.92 79.47 2.23 0.09 ok
6SE0_C Q6FI13 Histone H2A type 2-A EM 3.80 2019-07-29 1.60 96.53 0.90 0.92 78.18 1.88 0.09 ok
6SE0_G Q6FI13 Histone H2A type 2-A EM 3.80 2019-07-29 1.60 96.54 0.91 0.91 81.25 1.72 0.08 ok
6OTN_A P06753 Tropomyosin alpha-3 chain X-ray 2.40 2019-05-03 6.90 96.68 0.94 0.93 82.72 1.62 0.08 ok
6SEE_D P62807 Histone H2B type 1-C/E/F/G/I EM 4.20 2019-07-29 0.00 94.56 0.87 0.91 83.97 1.66 0.08 ok
6MBM_A Q8N1T3 Unconventional myosin-Ih peptide NMR 2018-08-30 81.35 0.41 0.86 78.12 1.65 0.08 wrong
6SE6_D P62807 Histone H2B type 1-C/E/F/G/I EM 3.50 2019-07-29 0.00 94.56 0.88 0.94 84.24 1.63 0.08 ok
6SEF_D P62807 Histone H2B type 1-C/E/F/G/I EM 3.70 2019-07-29 0.00 94.56 0.88 0.92 84.51 1.66 0.08 ok
6ITU_B P05067 Amyloid beta A4 protein X-ray 2.17 2018-11-26 49.85 0.47 0.74 66.67 2.64 0.07 ok
6SDD_A P08581 Hepatocyte growth factor receptor X-ray 1.93 2019-07-26 0.40 84.46 0.93 0.87 82.93 2.23 0.07 ok
6SEG_D P62807 Histone H2B type 1-C/E/F/G/I EM 3.10 2019-07-30 0.00 94.56 0.90 0.95 87.77 1.50 0.07 ok
6SE6_B P62805 Histone H4 EM 3.50 2019-07-29 0.00 95.51 0.93 0.94 89.94 2.02 0.07 ok
6SDE_A P08581 Hepatocyte growth factor receptor X-ray 2.49 2019-07-26 0.00 84.01 0.93 0.87 84.61 2.30 0.07 ok
6PY8_C Q06330 Recombining binding protein suppressor of X-ray 3.75 2019-07-29 0.70 92.32 0.97 0.88 85.90 1.45 0.07 ok
6SE6_C Q6FI13 Histone H2A type 2-A EM 3.50 2019-07-29 1.60 97.55 0.95 0.92 90.59 1.54 0.07 ok
6MTV_A Q14160 Protein scribble homolog X-ray 2.60 2018-10-22 62.53 0.90 0.06 ok
6MTU_A Q14160 Protein scribble homolog X-ray 2.14 2018-10-22 62.53 0.90 0.06 ok
6SEE_C Q6FI13 Histone H2A type 2-A EM 4.20 2019-07-29 1.60 97.74 0.95 0.88 92.89 1.13 0.06 ok
6SDC_A P08581 Hepatocyte growth factor receptor X-ray 1.67 2019-07-26 0.40 83.54 0.96 0.89 88.64 1.85 0.05 ok
6SEE_A P49450 Histone H3-like centromeric protein A EM 4.20 2019-07-29 0.00 92.54 0.93 0.90 90.31 1.20 0.05 ok
6H9J_A Q9NWT6 Hypoxia-inducible factor 1-alpha inhibitor X-ray 1.83 2018-08-04 91.38 0.95 0.05 ok
6SD9_A P08581 Hepatocyte growth factor receptor X-ray 2.35 2019-07-26 0.00 85.71 0.97 0.92 90.57 1.54 0.05 ok
6SE0_B P62805 Histone H4 EM 3.80 2019-07-29 0.00 95.80 0.94 0.93 95.62 1.40 0.05 ok
6OMU_A Q06187 Tyrosine-protein kinase BTK X-ray 1.41 2019-04-19 0.00 90.77 0.98 0.95 94.65 1.91 0.05 ok
6SEF_C Q6FI13 Histone H2A type 2-A EM 3.70 2019-07-29 1.60 97.71 0.96 0.91 96.88 0.81 0.05 ok
6GL7_C O00451 GDNF family receptor alpha-2 EM 6.30 2018-05-23 75.00 0.94 0.04 ok
6SE0_A P49450 Histone H3-like centromeric protein A EM 3.80 2019-07-29 0.00 92.04 0.95 0.91 94.19 1.37 0.04 ok
6SEE_B P62805 Histone H4 EM 4.20 2019-07-29 0.00 95.80 0.95 0.94 97.19 1.09 0.04 ok
6HBY_B P01911 HLA class II histocompatibility antigen, D X-ray 1.95 2018-08-13 88.44 0.96 0.04 ok
6SEF_B P62805 Histone H4 EM 3.70 2019-07-29 0.00 96.49 0.96 0.95 96.15 0.97 0.04 ok
6SEF_A P49450 Histone H3-like centromeric protein A EM 3.70 2019-07-29 0.00 92.54 0.96 0.93 95.41 0.95 0.04 ok
6SE6_A P49450 Histone H3-like centromeric protein A EM 3.50 2019-07-29 0.00 92.54 0.97 0.94 95.41 0.87 0.03 ok
6SE4_A O60885 Bromodomain-containing protein 4 X-ray 1.38 2019-07-29 0.00 94.30 0.97 0.95 95.83 0.75 0.03 ok
6SEG_C Q6FI13 Histone H2A type 2-A EM 3.10 2019-07-30 1.60 97.71 0.98 0.97 99.48 0.53 0.03 ok
6HBY_D P01903 HLA class II histocompatibility antigen, D X-ray 1.95 2018-08-13 89.19 0.97 0.03 ok
6KDZ_A Q9Y233 cAMP and cAMP-inhibited cGMP 3',5'-cyclic X-ray 3.10 2019-07-03 0.00 93.82 0.99 0.97 98.61 0.79 0.03 ok
6KE0_A Q9Y233 cAMP and cAMP-inhibited cGMP 3',5'-cyclic X-ray 2.95 2019-07-03 0.00 93.82 0.99 0.97 98.53 0.77 0.03 ok
6KDX_A Q9Y233 cAMP and cAMP-inhibited cGMP 3',5'-cyclic X-ray 2.44 2019-07-03 0.00 93.82 0.99 0.97 98.61 0.77 0.03 ok
6ITU_A Q9UBP9 PTB domain-containing engulfment adapter p X-ray 2.17 2018-11-26 64.90 92.84 0.98 0.98 98.12 0.66 0.03 ok
6SEG_A P49450 Histone H3-like centromeric protein A EM 3.10 2019-07-30 0.00 93.65 0.98 0.96 98.16 0.62 0.03 ok
6SEG_B P62805 Histone H4 EM 3.10 2019-07-30 0.00 96.08 0.98 0.97 99.04 0.58 0.02 ok
6HBY_A P01903 HLA class II histocompatibility antigen, D X-ray 1.95 2018-08-13 89.19 0.97 0.02 ok
6AG7_U P00749 Urokinase-type plasminogen activator X-ray 1.90 2018-08-09 82.12 0.98 0.02 ok
6H64_A P17931 Galectin-3 X-ray 1.80 2018-07-26 73.81 0.98 0.01 ok
6ECJ_A P99999 Cytochrome c X-ray 2.70 2018-08-08 97.94 0.99 0.01 ok
6H6U_A P02794 Ferritin heavy chain X-ray 2.00 2018-07-30 95.31 1.00 0.00 ok
6H6T_A P02794 Ferritin heavy chain X-ray 1.90 2018-07-30 95.31 1.00 0.00 ok
6H6T_G P02794 Ferritin heavy chain X-ray 1.90 2018-07-30 95.31 1.00 0.00 ok
6IJL_A Q9H7B4 Histone-lysine N-methyltransferase SMYD3 X-ray 2.35 2018-10-10 97.31 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.