Live Stats, next update: Wed 09 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2020-05-06

97
structures analysed (53 full · 54.6%)
11.0%
confidently wrong
00.0%
novel sequences
00.0%
novel & wrong
0.978
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 1 of 97 structures (1.0%) are confidently wrong; median TM-score is 0.978.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.978 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6POG_B Q99435 Protein kinase C-binding protein NELL2 X-ray 2.75 2019-07-03 68.20 80.59 0.55 0.82 3.50 18.85 0.69 ok
6TR0_A P26368 Splicing factor U2AF 65 kDa subunit NMR 2019-12-17 0.00 86.52 0.46 0.77 5.49 15.77 0.69 wrong
6NTS_A P30153 Serine/threonine-protein phosphatase 2A 65 EM 3.63 2019-01-30 0.00 95.53 0.83 0.82 46.14 4.48 0.24 ok
6P5L_A Q93009 Ubiquitin carboxyl-terminal hydrolase 7 X-ray 3.30 2019-05-30 0.00 92.12 0.82 0.95 45.89 4.80 0.23 ok
6T90_C P04908 Histone H2A type 1-B/E EM 3.05 2019-10-25 0.00 96.12 0.90 0.91 65.14 5.14 0.15 ok
6JPE_A P22455 Fibroblast growth factor receptor 4 X-ray 1.60 2019-03-26 0.00 86.78 0.88 0.87 65.77 4.59 0.14 ok
6POL_B Q92832 Protein kinase C-binding protein NELL1 X-ray 1.80 2019-07-04 64.00 83.38 0.79 0.92 65.50 2.68 0.12 ok
6POK_A Q96MS0 Roundabout homolog 3 X-ray 1.80 2019-07-04 60.90 83.67 0.84 0.91 63.78 2.52 0.12 ok
6W3J_C Q8TEP8 Centrosomal protein of 192 kDa X-ray 4.38 2020-03-09 0.00 36.94 0.35 0.54 34.09 4.98 0.11 ok
6YOV_C P04908 Histone H2A type 1-B/E EM 3.42 2020-04-15 90.75 0.88 0.11 ok
6V9X_A O75762 Transient receptor potential cation channe EM 3.30 2019-12-16 81.94 0.87 0.10 ok
6NTS_B Q15172 Serine/threonine-protein phosphatase 2A 56 EM 3.63 2019-01-30 27.90 95.37 0.96 0.79 78.74 2.18 0.10 ok
6K0R_A Q9Y265 RuvB-like 1,RuvB-like 1 X-ray 2.50 2019-05-07 0.00 89.99 0.91 0.89 78.88 4.11 0.09 ok
6SQR_I P0CG48 Polyubiquitin-C X-ray 2.18 2019-09-04 0.00 89.83 0.91 0.90 79.93 2.63 0.09 ok
6K0R_D Q9Y230 RuvB-like 2,RuvB-like 2 X-ray 2.50 2019-05-07 0.00 90.32 0.95 0.93 78.05 1.64 0.08 ok
6SQS_C P62979 Ubiquitin-40S ribosomal protein S27a X-ray 1.83 2019-09-04 0.00 91.41 0.91 0.93 82.89 2.00 0.08 ok
6WNX_B P63208 S-phase kinase-associated protein 1 X-ray 2.50 2020-04-23 90.12 0.92 0.08 ok
6SQO_C P62979 Ubiquitin-40S ribosomal protein S27a X-ray 1.41 2019-09-04 0.00 91.41 0.91 0.94 83.88 2.00 0.07 ok
6SQR_C P62979 Ubiquitin-40S ribosomal protein S27a X-ray 2.18 2019-09-04 0.00 91.41 0.91 0.93 85.20 1.94 0.07 ok
6T93_C P04908 Histone H2A type 1-B/E EM 3.49 2019-10-25 0.00 96.78 0.92 0.94 85.65 1.36 0.07 ok
6O4P_A Q14626 Interleukin-11 receptor subunit alpha X-ray 3.43 2019-02-28 69.00 92.57 0.96 0.95 86.27 1.35 0.07 ok
6RA5_A Q9UKE5 TRAF2 and NCK-interacting protein kinase X-ray 2.90 2019-04-05 0.40 85.47 0.96 0.89 86.61 2.48 0.06 ok
6SQO_A Q00987 E3 ubiquitin-protein ligase Mdm2 X-ray 1.41 2019-09-04 0.00 89.35 0.90 0.92 89.11 1.50 0.06 ok
6POG_A Q96MS0 Roundabout homolog 3 X-ray 2.75 2019-07-03 43.00 85.82 0.93 0.92 90.59 1.67 0.06 ok
6V9Y_A O75762 Transient receptor potential cation channe EM 3.60 2019-12-16 81.94 0.94 0.05 ok
6V9W_A O75762 Transient receptor potential cation channe EM 3.10 2019-12-16 81.94 0.94 0.05 ok
6POL_A Q96MS0 Roundabout homolog 3 X-ray 1.80 2019-07-04 43.30 85.48 0.94 0.93 92.40 1.63 0.05 ok
6YOV_B P62805 Histone H4 EM 3.42 2020-04-15 89.81 0.95 0.05 ok
6NTS_C P67775 Serine/threonine-protein phosphatase 2A ca EM 3.63 2019-01-30 1.70 97.17 0.99 0.96 96.11 2.49 0.05 ok
6O4O_A P20809 Interleukin-11 X-ray 1.62 2019-02-28 0.00 87.44 0.95 0.92 91.86 1.41 0.04 ok
6T90_L P48431 Transcription factor SOX-2 EM 3.05 2019-10-25 3.60 96.14 0.94 0.97 94.93 0.82 0.04 ok
6YOV_L P48431 Transcription factor SOX-2 EM 3.42 2020-04-15 59.84 0.93 0.04 ok
6T93_B P62805 Histone H4 EM 3.49 2019-10-25 0.00 95.66 0.96 0.95 96.91 1.01 0.04 ok
6V9V_A O75762 Transient receptor potential cation channe EM 2.60 2019-12-16 81.94 0.95 0.04 ok
6SQR_B P62837 Ubiquitin-conjugating enzyme E2 D2 X-ray 2.18 2019-09-04 0.00 96.54 0.98 0.96 96.40 0.69 0.04 ok
6R6E_A P49759 Dual specificity protein kinase CLK1 X-ray 2.25 2019-03-27 0.30 96.43 0.99 0.96 95.64 0.74 0.04 ok
6SQO_B P62837 Ubiquitin-conjugating enzyme E2 D2 X-ray 1.41 2019-09-04 0.00 96.54 0.98 0.96 96.75 0.70 0.04 ok
6TWZ_A P31947 14-3-3 protein sigma X-ray 2.80 2020-01-13 0.00 95.80 0.97 0.96 96.65 0.95 0.04 ok
6YOV_D P06899 Histone H2B type 1-J EM 3.42 2020-04-15 85.50 0.96 0.03 ok
6R6X_A P49759 Dual specificity protein kinase CLK1 X-ray 2.05 2019-03-28 0.30 96.36 0.99 0.97 95.98 0.72 0.03 ok
6T93_D P06899 Histone H2B type 1-J EM 3.49 2019-10-25 0.00 96.35 0.97 0.97 96.81 0.75 0.03 ok
6SQS_B P62837 Ubiquitin-conjugating enzyme E2 D2 X-ray 1.83 2019-09-04 0.00 96.54 0.98 0.97 98.46 0.57 0.03 ok
6T90_B P62805 Histone H4 EM 3.05 2019-10-25 0.00 95.51 0.97 0.97 98.17 0.98 0.03 ok
6YOV_F P62805 Histone H4 EM 3.42 2020-04-15 89.81 0.97 0.03 ok
6T93_A P68431 Histone H3.1 EM 3.49 2019-10-25 0.00 96.70 0.98 0.98 98.44 0.51 0.03 ok
6W3I_A Q5VWP2 Terminal nucleotidyltransferase 5C X-ray 3.80 2020-03-09 87.25 0.97 0.03 ok
6W3J_B O00444 Serine/threonine-protein kinase PLK4 X-ray 4.38 2020-03-09 65.62 0.96 0.02 ok
6T90_E P68431 Histone H3.1 EM 3.05 2019-10-25 0.00 96.82 0.98 0.99 99.21 0.46 0.02 ok
6T90_D P06899 Histone H2B type 1-J EM 3.05 2019-10-25 0.00 96.73 0.98 0.98 98.92 0.56 0.02 ok
6YB4_AAA Q6PL18 ATPase family AAA domain-containing protei X-ray 1.85 2020-03-15 61.53 0.97 0.02 ok
6OUE_A P00918 Carbonic anhydrase 2 X-ray 1.42 2019-05-04 0.00 97.89 1.00 0.99 99.32 0.39 0.02 ok
6T90_A P68431 Histone H3.1 EM 3.05 2019-10-25 0.00 96.91 0.99 0.99 99.73 0.35 0.02 ok
6W36_A Q5VWP2 Terminal nucleotidyltransferase 5C X-ray 2.85 2020-03-09 87.25 0.98 0.02 ok
6OUB_A P00918 Carbonic anhydrase 2 X-ray 1.42 2019-05-04 0.00 97.89 1.00 0.99 99.32 0.38 0.02 ok
6OUD_A P00918 Carbonic anhydrase 2 X-ray 1.26 2019-05-04 0.00 97.89 1.00 0.99 99.42 0.37 0.02 ok
6OTO_A P00918 Carbonic anhydrase 2 X-ray 1.50 2019-05-03 0.00 97.89 1.00 0.99 99.32 0.37 0.02 ok
6OUH_A P00918 Carbonic anhydrase 2 X-ray 1.45 2019-05-04 0.00 97.89 1.00 0.99 99.42 0.37 0.02 ok
6OTI_A P00918 Carbonic anhydrase 2 X-ray 2.00 2019-05-03 0.00 97.89 1.00 0.99 99.71 0.35 0.02 ok
6OTP_A P00918 Carbonic anhydrase 2 X-ray 1.47 2019-05-03 0.00 97.89 1.00 0.99 99.32 0.36 0.02 ok
6W3J_A Q5VWP2 Terminal nucleotidyltransferase 5C X-ray 4.38 2020-03-09 87.25 0.98 0.02 ok
6W38_B O00444 Serine/threonine-protein kinase PLK4 X-ray 4.48 2020-03-09 65.62 0.97 0.02 ok
6OUJ_A P00918 Carbonic anhydrase 2 X-ray 1.47 2019-05-04 0.00 97.89 1.00 0.99 99.51 0.36 0.02 ok
6OUK_A P00918 Carbonic anhydrase 2 X-ray 1.50 2019-05-04 0.00 97.89 1.00 0.99 99.51 0.35 0.02 ok
6OUM_A P00918 Carbonic anhydrase 2 X-ray 1.56 2019-05-04 0.00 97.89 1.00 0.99 99.81 0.34 0.02 ok
6VLU_A P03951 Coagulation factor XIa light chain X-ray 1.60 2020-01-27 86.88 0.98 0.02 ok
6OTM_A P00918 Carbonic anhydrase 2 X-ray 1.31 2019-05-03 0.00 97.89 1.00 0.99 99.71 0.34 0.02 ok
6OTQ_A P00918 Carbonic anhydrase 2 X-ray 1.47 2019-05-03 0.00 97.89 1.00 0.99 99.61 0.34 0.02 ok
6OUF_A P00918 Carbonic anhydrase 2 X-ray 1.36 2019-05-04 0.00 97.89 1.00 0.99 99.71 0.33 0.02 ok
6OTK_A P00918 Carbonic anhydrase 2 X-ray 1.12 2019-05-03 0.00 97.89 1.00 0.99 99.81 0.32 0.02 ok
6W38_A Q5VWP2 Terminal nucleotidyltransferase 5C X-ray 4.48 2020-03-09 87.25 0.98 0.02 ok
6OUI_A P00918 Carbonic anhydrase 2 X-ray 1.53 2019-05-04 0.00 97.89 1.00 0.99 99.90 0.31 0.02 ok
6VIY_A P25440 Bromodomain-containing protein 2 X-ray 1.90 2020-01-14 64.06 0.97 0.02 ok
6VLV_A P03951 Coagulation factor XIa light chain X-ray 1.72 2020-01-27 86.88 0.98 0.02 ok
6VBN_A P48775 Tryptophan 2,3-dioxygenase X-ray 3.18 2019-12-19 90.06 0.98 0.02 ok
6YQO_A O60885 Bromodomain-containing protein 4 X-ray 1.07 2020-04-17 55.31 0.97 0.02 ok
6YQN_A O60885 Bromodomain-containing protein 4 X-ray 1.05 2020-04-17 55.31 0.97 0.01 ok
6VIX_A O60885 Bromodomain-containing protein 4 X-ray 2.12 2020-01-14 55.31 0.97 0.01 ok
6YOV_E P68431 Histone H3.1 EM 3.42 2020-04-15 86.06 0.98 0.01 ok
6W3I_B O00444 Serine/threonine-protein kinase PLK4 X-ray 3.80 2020-03-09 65.62 0.98 0.01 ok
6YOV_A P68431 Histone H3.1 EM 3.42 2020-04-15 86.06 0.99 0.01 ok
6V7F_A P05089 Arginase-1 X-ray 2.02 2019-12-08 97.00 0.99 0.01 ok
6V7D_A P05089 Arginase-1 X-ray 1.82 2019-12-08 97.00 0.99 0.01 ok
6YNH_B P04406 Glyceraldehyde-3-phosphate dehydrogenase X-ray 2.62 2020-04-13 98.12 0.99 0.01 ok
6V7C_A P05089 Arginase-1 X-ray 1.80 2019-12-08 97.00 0.99 0.01 ok
6V7E_A P05089 Arginase-1 X-ray 1.99 2019-12-08 97.00 0.99 0.01 ok
6YUW_A Q6P988 Palmitoleoyl-protein carboxylesterase NOTU X-ray 1.94 2020-04-27 83.94 0.99 0.01 ok
6VIZ_A O60885 Bromodomain-containing protein 4 X-ray 2.39 2020-01-14 55.31 0.99 0.01 ok
6VIW_A O60885 Bromodomain-containing protein 4 X-ray 2.43 2020-01-14 55.31 0.99 0.01 ok
6YV4_A Q6P988 Palmitoleoyl-protein carboxylesterase NOTU X-ray 2.00 2020-04-27 83.94 0.99 0.01 ok
6VRE_A Q99683 Mitogen-activated protein kinase kinase ki X-ray 2.29 2020-02-07 72.88 0.99 0.01 ok
6YNF_A P04406 Glyceraldehyde-3-phosphate dehydrogenase X-ray 2.39 2020-04-13 98.12 0.99 0.01 ok
6YND_A P04406 Glyceraldehyde-3-phosphate dehydrogenase X-ray 1.52 2020-04-13 98.12 1.00 0.00 ok
6WNX_A Q9UKB1 F-box/WD repeat-containing protein 11 X-ray 2.50 2020-04-23 85.25 0.99 0.00 ok
6YUY_A Q6P988 Palmitoleoyl-protein carboxylesterase NOTU X-ray 2.00 2020-04-27 83.94 1.00 0.00 ok
6YNE_A P04406 Glyceraldehyde-3-phosphate dehydrogenase X-ray 1.85 2020-04-13 98.12 1.00 0.00 ok
6WBZ_A Q92769 Histone deacetylase 2 X-ray 1.32 2020-03-28 85.56 1.00 0.00 ok
6WBW_A Q92769 Histone deacetylase 2 X-ray 1.46 2020-03-27 85.56 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.