Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2018-11-14

115
structures analysed (20 full · 17.4%)
21.7%
confidently wrong
43.5%
novel sequences
00.0%
novel & wrong
0.926
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 2 of 115 structures (1.7%) are confidently wrong; median TM-score is 0.926.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.926 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6GK3_A P61769 Beta-2-microglobulin EM 3.98 2018-05-18 0.00 97.87 0.22 0.54 0.00 22.00 0.93 wrong
6AH0_w Q12874 Splicing factor 3A subunit 3 EM 5.70 2018-08-15 73.80 novel 86.82 0.58 0.44 0.28 32.15 0.85 ok
6AHD_w Q12874 Splicing factor 3A subunit 3 EM 3.80 2018-08-17 73.80 novel 86.87 0.60 0.43 0.41 30.80 0.85 ok
6AH0_N O94906 Pre-mRNA-processing factor 6 EM 5.70 2018-08-15 0.00 87.13 0.66 0.61 1.90 21.60 0.74 ok
6AHD_A Q6P2Q9 Pre-mRNA-processing-splicing factor 8 EM 3.80 2018-08-17 0.00 86.53 0.59 0.88 4.14 35.34 0.74 ok
6AH0_A Q6P2Q9 Pre-mRNA-processing-splicing factor 8 EM 5.70 2018-08-15 0.00 86.27 0.56 0.80 1.87 26.42 0.73 ok
6AHD_L Q8WWY3 U4/U6 small nuclear ribonucleoprotein Prp3 EM 3.80 2018-08-17 0.00 84.42 0.53 0.78 2.93 23.22 0.72 ok
6AHD_Y Q2TAY7 WD40 repeat-containing protein SMU1 EM 3.80 2018-08-17 0.00 85.13 0.67 0.73 5.96 22.01 0.69 ok
6AHD_9 O43290 U4/U6.U5 tri-snRNP-associated protein 1 EM 3.80 2018-08-17 0.00 79.76 0.47 0.81 3.64 26.72 0.69 wrong
6AH0_v Q15428 Splicing factor 3A subunit 2 EM 5.70 2018-08-15 71.90 novel 87.89 0.65 0.44 7.58 16.12 0.63 ok
6AHD_v Q15428 Splicing factor 3A subunit 2 EM 3.80 2018-08-17 71.90 novel 87.85 0.65 0.47 9.04 14.20 0.61 ok
6AHD_N O94906 Pre-mRNA-processing factor 6 EM 3.80 2018-08-17 0.00 83.52 0.62 0.65 22.15 18.50 0.42 ok
6AHD_u Q15459 Splicing factor 3A subunit 1 EM 3.80 2018-08-17 2.90 87.29 0.57 0.80 28.83 7.27 0.33 ok
6AH0_X Q9BUQ8 Probable ATP-dependent RNA helicase DDX23 EM 5.70 2018-08-15 77.62 0.71 0.23 ok
6AH0_5 Q9Y3B4 Splicing factor 3B subunit 6 EM 5.70 2018-08-15 90.12 0.75 0.22 ok
6AHD_5 Q9Y3B4 SF3b14a, Splicing factor 3B subunit 6 EM 3.80 2018-08-17 90.12 0.75 0.22 ok
6AH0_J O43395 U4/U6 small nuclear ribonucleoprotein Prp3 EM 5.70 2018-08-15 73.25 0.72 0.20 ok
6AH0_2 Q13435 Splicing factor 3B subunit 2 EM 5.70 2018-08-15 65.69 0.71 0.19 ok
6AHD_2 Q13435 SF3b145, Splicing factor 3B subunit 2 EM 3.80 2018-08-17 65.69 0.72 0.19 ok
6AHD_X O75554 WW domain-binding protein 4 EM 3.80 2018-08-17 65.88 0.74 0.17 ok
6AHD_S P62308 Small nuclear ribonucleoprotein G EM 3.80 2018-08-17 93.25 0.83 0.16 ok
6AH0_S P62308 Small nuclear ribonucleoprotein G EM 5.70 2018-08-15 93.25 0.83 0.16 ok
6AHD_1 O75533 Splicing factor 3B subunit 1 EM 3.80 2018-08-17 74.81 0.79 0.16 ok
6AH0_Q P62306 Small nuclear ribonucleoprotein F EM 5.70 2018-08-15 90.50 0.83 0.15 ok
6AH0_R P62304 Small nuclear ribonucleoprotein E EM 5.70 2018-08-15 90.75 0.83 0.15 ok
6AH0_1 O75533 Splicing factor 3B subunit 1 EM 5.70 2018-08-15 74.81 0.80 0.15 ok
6AH0_W Q53GS9 U4/U6.U5 tri-snRNP-associated protein 2 EM 5.70 2018-08-15 79.06 0.82 0.14 ok
6AH0_u Q15459 Splicing factor 3A subunit 1 EM 5.70 2018-08-15 66.94 0.79 0.14 ok
6AHD_0 P55081 Microfibrillar-associated protein 1 EM 3.80 2018-08-17 71.31 0.81 0.13 ok
6E99_B P61925 PKI peptide X-ray 1.88 2018-07-31 68.99 0.44 0.81 54.17 3.35 0.13 ok
6E9L_B P61925 PKI peptide X-ray 2.80 2018-08-01 68.99 0.43 0.80 54.17 3.27 0.13 ok
6AHD_K O43172 U4/U6 small nuclear ribonucleoprotein Prp4 EM 3.80 2018-08-17 82.06 0.85 0.12 ok
6AH0_6 Q7RTV0 PHD finger-like domain-containing protein EM 5.70 2018-08-15 89.88 0.88 0.11 ok
6AHD_6 Q7RTV0 PHD finger-like domain-containing protein EM 3.80 2018-08-17 89.88 0.88 0.11 ok
6AH0_t Q9Y4Y9 U6 snRNA-associated Sm-like protein LSm5 EM 5.70 2018-08-15 90.75 0.88 0.11 ok
6AHD_8 Q96NC0 Zinc finger matrin-type protein 2 EM 3.80 2018-08-17 0.00 78.28 0.67 0.80 64.73 2.23 0.10 ok
6AHD_J O43395 U4/U6 small nuclear ribonucleoprotein Prp3 EM 3.80 2018-08-17 73.25 0.87 0.10 ok
6AHD_x P62312 U6 snRNA-associated Sm-like protein LSm6 EM 3.80 2018-08-17 91.94 0.90 0.09 ok
6AHD_P P62316 Small nuclear ribonucleoprotein Sm D2 EM 3.80 2018-08-17 90.62 0.90 0.09 ok
6AH0_P P62316 Small nuclear ribonucleoprotein Sm D2 EM 5.70 2018-08-15 90.62 0.90 0.09 ok
6AHD_t Q9Y4Y9 U6 snRNA-associated Sm-like protein LSm5 EM 3.80 2018-08-17 90.75 0.90 0.09 ok
6AD9_B Q9UBK2 12-mer peptide from Peroxisome proliferato X-ray 2.20 2018-07-31 52.75 0.83 0.09 ok
6AHD_V P62314 Small nuclear ribonucleoprotein Sm D1 EM 3.80 2018-08-17 82.81 0.90 0.09 ok
6AH0_V P62314 Small nuclear ribonucleoprotein Sm D1 EM 5.70 2018-08-15 82.81 0.90 0.09 ok
6AH0_z O95777 U6 snRNA-associated Sm-like protein LSm8 EM 5.70 2018-08-15 95.44 0.91 0.08 ok
6AHD_D O75643 Brr2, U5 small nuclear ribonucleoprotein 2 EM 3.80 2018-08-17 82.75 0.90 0.08 ok
6AHD_q Q9Y333 U6 snRNA-associated Sm-like protein LSm2 EM 3.80 2018-08-17 94.81 0.91 0.08 ok
6AH0_q Q9Y333 U6 snRNA-associated Sm-like protein LSm2 EM 5.70 2018-08-15 94.81 0.91 0.08 ok
6AHD_z O95777 U6 snRNA-associated Sm-like protein LSm8 EM 3.80 2018-08-17 95.44 0.91 0.08 ok
6AH0_x P62312 U6 snRNA-associated Sm-like protein LSm6 EM 5.70 2018-08-15 91.94 0.91 0.08 ok
6AHD_T P62318 Small nuclear ribonucleoprotein Sm D3 EM 3.80 2018-08-17 82.81 0.91 0.07 ok
6AH0_T P62318 Small nuclear ribonucleoprotein Sm D3 EM 5.70 2018-08-15 82.81 0.91 0.07 ok
6GZS_B P0CG47 Polyubiquitin-B X-ray 1.90 2018-07-05 93.44 0.92 0.07 ok
6AH0_r P62310 U6 snRNA-associated Sm-like protein LSm3 EM 5.70 2018-08-15 89.19 0.92 0.07 ok
6AHD_7 Q9BWJ5 SF3b5, Splicing factor 3B subunit 5 EM 3.80 2018-08-17 91.62 0.93 0.07 ok
6AH0_7 Q9BWJ5 Splicing factor 3B subunit 5 EM 5.70 2018-08-15 91.62 0.93 0.07 ok
6AHD_r P62310 U6 snRNA-associated Sm-like protein LSm3 EM 3.80 2018-08-17 89.19 0.93 0.07 ok
6AHD_O P83876 Thioredoxin-like protein 4A EM 3.80 2018-08-17 88.56 0.94 0.06 ok
6MGP_X Q07011 Tumor necrosis factor receptor superfamily X-ray 2.13 2018-09-14 82.00 0.93 0.06 ok
6AH0_D O75643 U5 small nuclear ribonucleoprotein 200 kDa EM 5.70 2018-08-15 82.75 0.93 0.06 ok
6AHD_A0 Q9BZL1 Ubiquitin-like protein 5 EM 3.80 2018-08-17 91.69 0.94 0.06 ok
6AHD_s Q9Y4Z0 U6 snRNA-associated Sm-like protein LSm4 EM 3.80 2018-08-17 75.69 0.93 0.06 ok
6AH0_s Q9Y4Z0 U6 snRNA-associated Sm-like protein LSm4 EM 5.70 2018-08-15 75.69 0.93 0.06 ok
6AHD_Z Q8NAV1 Pre-mRNA-splicing factor 38A EM 3.80 2018-08-17 71.31 0.92 0.06 ok
6MZJ_D S6C4S0 VRC01GL heavy chain EM 4.80 2018-11-05 4.20 91.93 0.93 0.88 90.47 1.71 0.05 ok
6MYY_D S6C4S0 VRC01GL heavy chain EM 3.80 2018-11-02 4.20 91.93 0.93 0.88 90.47 1.71 0.05 ok
6AHD_3 Q15393 Splicing factor 3B subunit 3 EM 3.80 2018-08-17 92.25 0.94 0.05 ok
6AH0_3 Q15393 Splicing factor 3B subunit 3 EM 5.70 2018-08-15 92.25 0.94 0.05 ok
6AH0_U P14678 Small nuclear ribonucleoprotein-associated EM 5.70 2018-08-15 69.50 0.93 0.05 ok
6AH0_L Q8WWY3 U4/U6 small nuclear ribonucleoprotein Prp3 EM 5.70 2018-08-15 77.38 0.94 0.05 ok
6MZJ_C Q6PJF2 VRC01GL light chain EM 4.80 2018-11-05 0.00 96.33 0.96 0.88 95.00 1.33 0.05 ok
6MYY_C Q6PJF2 VRC01GL light chain EM 3.80 2018-11-02 0.00 96.33 0.96 0.88 95.00 1.33 0.05 ok
6AH0_4 Q15427 Splicing factor 3B subunit 4 EM 5.70 2018-08-15 73.19 0.94 0.04 ok
6AH0_O P83876 Thioredoxin-like protein 4A EM 5.70 2018-08-15 88.56 0.95 0.04 ok
6AHD_4 Q15427 SF3b49, Splicing factor 3B subunit 4 EM 3.80 2018-08-17 73.19 0.94 0.04 ok
6AH0_K O43172 U4/U6 small nuclear ribonucleoprotein Prp4 EM 5.70 2018-08-15 82.06 0.96 0.03 ok
6AHD_M P55769 NHP2-like protein 1 EM 3.80 2018-08-17 94.88 0.97 0.03 ok
6AHD_y Q9UK45 U6 snRNA-associated Sm-like protein LSm7 EM 3.80 2018-08-17 89.44 0.96 0.03 ok
6AH0_y Q9UK45 U6 snRNA-associated Sm-like protein LSm7 EM 5.70 2018-08-15 89.44 0.96 0.03 ok
6AHD_W O43447 Peptidyl-prolyl cis-trans isomerase H EM 3.80 2018-08-17 96.31 0.97 0.02 ok
6AD9_A P37231 Peroxisome proliferator-activated receptor X-ray 2.20 2018-07-31 76.12 0.97 0.02 ok
6HZM_A Q9UNQ0 ATP-binding cassette sub-family G member 2 EM 3.09 2018-10-23 85.25 0.97 0.02 ok
6DNA_A P17174 Aspartate aminotransferase, cytoplasmic X-ray 3.00 2018-06-06 96.38 0.98 0.02 ok
6AH0_C Q15029 116 kDa U5 small nuclear ribonucleoprotein EM 5.70 2018-08-15 89.94 0.98 0.02 ok
6AHD_C Q15029 116 kDa U5 small nuclear ribonucleoprotein EM 3.80 2018-08-17 89.94 0.98 0.02 ok
6DNB_A P17174 Aspartate aminotransferase, cytoplasmic X-ray 1.70 2018-06-06 96.38 0.98 0.02 ok
6E41_A P14902 Indoleamine 2,3-dioxygenase 1 X-ray 2.29 2018-07-16 93.06 0.98 0.02 ok
6E9W_A Q13464 Rho-associated protein kinase 1 X-ray 2.96 2018-08-01 76.12 0.98 0.02 ok
6AH0_M P55769 NHP2-like protein 1 EM 5.70 2018-08-15 94.88 0.98 0.02 ok
6MGP_A P41273 Tumor necrosis factor ligand superfamily m X-ray 2.13 2018-09-14 76.62 0.98 0.01 ok
6E43_A P14902 Indoleamine 2,3-dioxygenase 1 X-ray 1.71 2018-07-16 93.06 0.99 0.01 ok
6DND_A P17174 Aspartate aminotransferase, cytoplasmic X-ray 2.10 2018-06-06 96.38 0.99 0.01 ok
6E42_A P14902 Indoleamine 2,3-dioxygenase 1 X-ray 2.10 2018-07-16 93.06 0.99 0.01 ok
6E44_A P14902 Indoleamine 2,3-dioxygenase 1 X-ray 1.90 2018-07-16 93.06 0.99 0.01 ok
6AHD_p P08579 U2 small nuclear ribonucleoprotein B'' EM 3.80 2018-08-17 82.69 0.99 0.01 ok
6AH0_p P08579 U2 small nuclear ribonucleoprotein B'' EM 5.70 2018-08-15 82.69 0.99 0.01 ok
6E46_A P14902 Indoleamine 2,3-dioxygenase 1 X-ray 2.09 2018-07-16 93.06 0.99 0.01 ok
6E40_A P14902 Indoleamine 2,3-dioxygenase 1 X-ray 2.31 2018-07-16 93.06 0.99 0.01 ok
6ED6_A O75116 Rho-associated protein kinase 2 X-ray 2.86 2018-08-08 76.44 0.99 0.01 ok
6E45_A P14902 Indoleamine 2,3-dioxygenase 1 X-ray 2.00 2018-07-16 93.06 0.99 0.01 ok
6HVI_A Q16875 6-phosphofructo-2-kinase/fructose-2,6-bisp X-ray 1.96 2018-10-11 86.62 0.99 0.01 ok
6MIM_A P42568 Protein AF-9 X-ray 2.52 2018-09-19 61.84 0.99 0.01 ok
6HVH_A Q16875 6-phosphofructo-2-kinase/fructose-2,6-bisp X-ray 2.36 2018-10-11 86.62 0.99 0.01 ok
6HVJ_A Q16875 6-phosphofructo-2-kinase/fructose-2,6-bisp X-ray 2.28 2018-10-11 86.62 0.99 0.01 ok
6AHD_E Q96DI7 U5 small nuclear ribonucleoprotein 40 kDa EM 3.80 2018-08-17 85.25 0.99 0.01 ok
6AH0_E Q96DI7 U5 small nuclear ribonucleoprotein 40 kDa EM 5.70 2018-08-15 85.25 0.99 0.01 ok
6MIL_A P42568 Protein AF-9 X-ray 1.93 2018-09-19 61.84 0.99 0.00 ok
6HOY_A Q8N6T7 NAD-dependent protein deacetylase sirtuin- X-ray 1.70 2018-09-18 87.50 0.99 0.00 ok
6AHD_o P09661 U2 small nuclear ribonucleoprotein A' EM 3.80 2018-08-17 87.69 1.00 0.00 ok
6AH0_o P09661 U2 small nuclear ribonucleoprotein A' EM 5.70 2018-08-15 87.69 1.00 0.00 ok
6HMN_A Q86W56 Poly(ADP-ribose) glycohydrolase X-ray 2.87 2018-09-12 68.25 1.00 0.00 ok
6HMM_A Q86W56 Poly(ADP-ribose) glycohydrolase X-ray 1.90 2018-09-12 68.25 1.00 0.00 ok
6HML_A Q86W56 Poly(ADP-ribose) glycohydrolase X-ray 2.25 2018-09-12 68.25 1.00 0.00 ok
6HMK_A Q86W56 Poly(ADP-ribose) glycohydrolase X-ray 2.06 2018-09-12 68.25 1.00 0.00 ok
6E8K_B P14784 interleukin-2 receptor beta pTyr387 peptid X-ray 1.71 2018-07-30 64.62 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.