Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2022-11-16

103
structures analysed (10 full · 9.7%)
32.9%
confidently wrong
21.9%
novel sequences
00.0%
novel & wrong
0.951
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 3 of 103 structures (2.9%) are confidently wrong; median TM-score is 0.951.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.951 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
8D30_A P35606 Coatomer subunit beta' X-ray 2.40 2022-05-31 0.60 92.37 0.66 0.94 4.22 14.01 0.74 ok
8EP1_E P0DP23 Calmodulin-1 EM 5.40 2022-10-04 0.00 86.64 0.46 0.75 6.69 12.79 0.64 wrong
8EOW_E P0DP23 Calmodulin-1 EM 3.90 2022-10-04 0.00 86.64 0.46 0.75 6.69 12.65 0.63 wrong
8EP0_E P0DP23 Calmodulin-1 EM 4.90 2022-10-04 0.00 86.64 0.46 0.77 7.39 12.61 0.63 wrong
8ALY_A Q9H2K2 Poly [ADP-ribose] polymerase tankyrase-2 EM 2.98 2022-08-01 83.81 0.73 0.23 ok
7ZF1_B Q9BXW9 Fanconi anemia group D2 protein EM 4.14 2022-03-31 76.75 0.75 0.19 ok
7WMV_B Q13113 PDZK1-interacting protein 1 EM 3.20 2022-01-17 64.75 0.73 0.17 ok
8B7I_A P07900 HSP90AA1 protein NMR 2022-09-30 85.19 0.80 0.17 ok
7U23_E P08069 Insulin-like growth factor 1 receptor EM 4.60 2022-02-22 78.00 0.81 0.15 ok
8DYP_A O60931 Cystinosin X-ray 3.40 2022-08-04 89.44 0.85 0.14 ok
8B7J_A P07900 HSP90AA1 protein NMR 2022-09-30 85.19 0.85 0.13 ok
7Q5V_B Q99814 Endothelial PAS domain-containing protein X-ray 1.17 2021-11-04 100.00 novel 48.62 0.22 0.75 41.25 4.26 0.12 ok
7Q5X_B Q99814 Endothelial PAS domain-containing protein X-ray 1.21 2021-11-04 100.00 novel 49.03 0.23 0.72 42.11 4.07 0.12 ok
7YZB_A O75593 Forkhead box protein H1 X-ray 1.47 2022-02-19 61.75 0.84 0.10 ok
7TD5_D P68431 THR-LYS-ALA-ALA-ARG-MET-SER-ALA-PRO-SER X-ray 2.99 2021-12-30 58.62 0.39 0.79 60.00 2.60 0.09 ok
7TD5_E P68431 THR-LYS-ALA-ALA-ARG-M3L-SER-ALA-PRO-ALA X-ray 2.99 2021-12-30 58.62 0.35 0.79 60.00 2.34 0.09 ok
7ZF1_C P62987 Ubiquitin-60S ribosomal protein L40 EM 4.14 2022-03-31 93.50 0.91 0.09 ok
7YBX_A P22455 Fibroblast growth factor receptor 4 X-ray 2.23 2022-06-30 73.62 0.90 0.08 ok
7Q44_B Q9P2H5 Deubiquitinase USP35 peptide X-ray 2.20 2021-10-29 36.82 0.40 0.53 55.00 3.37 0.08 ok
7YBP_A P22455 Fibroblast growth factor receptor 4 X-ray 2.24 2022-06-29 73.62 0.90 0.07 ok
7YC1_A P22455 Fibroblast growth factor receptor 4 X-ray 2.54 2022-06-30 73.62 0.90 0.07 ok
7YC3_A P22455 Fibroblast growth factor receptor 4 X-ray 1.99 2022-06-30 73.62 0.90 0.07 ok
7YBO_A P22455 Fibroblast growth factor receptor 4 X-ray 2.31 2022-06-29 73.62 0.90 0.07 ok
7ZWW_A P41182 B-cell lymphoma 6 protein X-ray 1.67 2022-05-19 52.06 0.87 0.07 ok
7Q42_B Q9UIF8 Bromodomain adjacent to zinc finger domain X-ray 1.95 2021-10-29 34.73 0.45 0.49 50.00 3.16 0.07 ok
7ZWT_A P41182 B-cell lymphoma 6 protein X-ray 1.94 2022-05-19 52.06 0.87 0.07 ok
7YOZ_B P62805 Histone H4 EM 4.30 2022-08-02 89.81 0.93 0.07 ok
7Q3O_C P47902 Homeobox protein CDX-1 X-ray 2.78 2021-10-28 66.69 0.90 0.07 ok
7ZWQ_A P41182 B-cell lymphoma 6 protein X-ray 1.65 2022-05-19 52.06 0.87 0.07 ok
8DVB_A P03372 Estrogen receptor X-ray 2.19 2022-07-28 66.44 0.90 0.07 ok
7ZW1_A P23942 Peripherin-2 EM 3.70 2022-05-17 87.00 0.93 0.06 ok
7ZWS_A P41182 B-cell lymphoma 6 protein X-ray 1.53 2022-05-19 52.06 0.90 0.05 ok
7ZWY_A P41182 B-cell lymphoma 6 protein X-ray 1.65 2022-05-19 52.06 0.90 0.05 ok
7ZWP_A P41182 B-cell lymphoma 6 protein X-ray 1.85 2022-05-19 52.06 0.90 0.05 ok
7ZWZ_A P41182 B-cell lymphoma 6 protein X-ray 1.40 2022-05-19 52.06 0.90 0.05 ok
7ZWU_A P41182 B-cell lymphoma 6 protein X-ray 1.56 2022-05-19 52.06 0.90 0.05 ok
7ZWO_A P41182 B-cell lymphoma 6 protein X-ray 1.39 2022-05-19 52.06 0.90 0.05 ok
7X58_B P62805 Histone H4 EM 3.93 2022-03-04 89.81 0.94 0.05 ok
7ZWX_A P41182 B-cell lymphoma 6 protein X-ray 1.38 2022-05-19 52.06 0.90 0.05 ok
8DUB_A P03372 Estrogen receptor X-ray 1.84 2022-07-27 66.44 0.92 0.05 ok
7YOZ_A P68431 Histone H3.1 EM 4.30 2022-08-02 86.06 0.94 0.05 ok
7VON_A P01023 Alpha-2-macroglobulin EM 5.20 2021-10-14 81.50 0.94 0.05 ok
8BA6_A Q13451 Peptidyl-prolyl cis-trans isomerase FKBP5 X-ray 1.10 2022-10-11 92.50 0.95 0.05 ok
8DVU_A O95786 Antiviral innate immune response receptor EM 2.90 2022-07-29 85.19 0.95 0.05 ok
8D5C_D P01730 T-cell surface glycoprotein CD4 EM 3.90 2022-06-04 85.25 0.95 0.04 ok
7ZWN_A P41182 B-cell lymphoma 6 protein X-ray 2.05 2022-05-19 52.06 0.91 0.04 ok
7ZWR_A P41182 B-cell lymphoma 6 protein X-ray 1.47 2022-05-19 52.06 0.91 0.04 ok
7ZWV_A P41182 B-cell lymphoma 6 protein X-ray 1.52 2022-05-19 52.06 0.92 0.04 ok
7X57_B P62805 Histone H4 EM 3.63 2022-03-04 89.81 0.95 0.04 ok
7R0L_A Q13451 Peptidyl-prolyl cis-trans isomerase FKBP5 X-ray 1.10 2022-02-02 92.50 0.95 0.04 ok
7YZE_A Q9Y261 Hepatocyte nuclear factor 3-beta X-ray 1.99 2022-02-19 56.69 0.93 0.04 ok
7VY4_A O75832 26S proteasome non-ATPase regulatory subun X-ray 2.22 2021-11-13 95.38 0.96 0.04 ok
7VXW_A O75832 26S proteasome non-ATPase regulatory subun X-ray 2.22 2021-11-13 95.38 0.96 0.04 ok
7VY7_A O75832 26S proteasome non-ATPase regulatory subun X-ray 2.23 2021-11-13 95.38 0.96 0.04 ok
7YZF_C Q9Y261 Hepatocyte nuclear factor 3-beta X-ray 2.18 2022-02-19 56.69 0.93 0.04 ok
8BFS_A Q8IU85 Calcium/calmodulin-dependent protein kinas X-ray 1.95 2022-10-26 75.69 0.95 0.04 ok
7VXV_A O75832 26S proteasome non-ATPase regulatory subun X-ray 2.23 2021-11-13 95.38 0.96 0.04 ok
7Q7E_A O94768 Serine/threonine-protein kinase 17B X-ray 2.85 2021-11-09 81.19 0.96 0.03 ok
7Q7D_A O94768 Serine/threonine-protein kinase 17B X-ray 2.60 2021-11-09 81.19 0.96 0.03 ok
7TD5_C Q15022 Polycomb protein SUZ12 X-ray 2.99 2021-12-30 71.00 0.96 0.03 ok
7ZW1_B Q03395 Rod outer segment membrane protein 1 EM 3.70 2022-05-17 86.25 0.96 0.03 ok
7ZF1_A Q9NVI1 Fanconi anemia group I protein EM 4.14 2022-03-31 83.25 0.96 0.03 ok
8EGI_A P69905 Hemoglobin subunit alpha X-ray 2.30 2022-09-12 98.06 0.97 0.03 ok
8D43_B P14314 Glucosidase 2 subunit beta EM 2.88 2022-06-01 84.12 0.97 0.03 ok
7Q4N_C Q99626 Homeobox protein CDX-2 X-ray 3.20 2021-11-01 61.62 0.95 0.03 ok
7PZR_A O00411 DNA-directed RNA polymerase, mitochondrial EM 3.00 2021-10-13 83.44 0.97 0.03 ok
8EGI_B P68871 Hemoglobin subunit beta X-ray 2.30 2022-09-12 97.19 0.97 0.03 ok
7R58_A Q9HCN6 Platelet glycoprotein VI X-ray 1.90 2022-02-10 76.06 0.97 0.03 ok
7TD5_A Q92800 Histone-lysine N-methyltransferase EZH1 X-ray 2.99 2021-12-30 74.56 0.97 0.02 ok
7Q7C_A O94768 Serine/threonine-protein kinase 17B X-ray 2.85 2021-11-09 81.19 0.97 0.02 ok
8BK0_A P29317 Ephrin type-A receptor 2 X-ray 1.70 2022-11-08 82.25 0.97 0.02 ok
7WMV_A P13866 Sodium/glucose cotransporter 1 EM 3.20 2022-01-17 84.38 0.98 0.02 ok
8E2M_A Q06187 Tyrosine-protein kinase BTK X-ray 1.90 2022-08-15 84.44 0.98 0.02 ok
7X58_A P68431 Histone H3.1 EM 3.93 2022-03-04 86.06 0.98 0.02 ok
7TD5_B O75530 Polycomb protein EED X-ray 2.99 2021-12-30 86.50 0.98 0.02 ok
7Q5V_A Q9GZT9 Egl nine homolog 1 X-ray 1.17 2021-11-04 71.88 0.98 0.02 ok
7WH5_A Q16740 ATP-dependent Clp protease proteolytic sub X-ray 2.13 2021-12-29 82.31 0.98 0.02 ok
7X57_A P68431 Histone H3.1 EM 3.63 2022-03-04 86.06 0.98 0.01 ok
7WVJ_A O15455 Toll-like receptor 3 EM 3.26 2022-02-10 90.62 0.98 0.01 ok
7WV3_A O15455 Toll-like receptor 3 EM 2.26 2022-02-09 90.62 0.99 0.01 ok
7WVE_A O15455 Toll-like receptor 3 EM 3.11 2022-02-10 90.62 0.99 0.01 ok
7WV4_A O15455 Toll-like receptor 3 EM 3.35 2022-02-09 90.62 0.99 0.01 ok
8D44_A P05062 Fructose-bisphosphate aldolase B EM 2.80 2022-06-01 96.00 0.99 0.01 ok
7WVF_A O15455 Toll-like receptor 3 EM 3.91 2022-02-10 90.62 0.99 0.01 ok
7WV5_A O15455 Toll-like receptor 3 EM 3.10 2022-02-09 90.62 0.99 0.01 ok
8DVS_A O95786 Antiviral innate immune response receptor EM 3.00 2022-07-29 85.19 0.99 0.01 ok
7Q5X_A Q9GZT9 Egl nine homolog 1 X-ray 1.21 2021-11-04 71.88 0.99 0.01 ok
8BAJ_A Q13451 Peptidyl-prolyl cis-trans isomerase FKBP5 X-ray 1.20 2022-10-11 92.50 0.99 0.01 ok
8DNS_O P04406 Glyceraldehyde-3-phosphate dehydrogenase EM 3.22 2022-07-11 98.12 0.99 0.01 ok
7SS1_A Q9BV86 N-terminal Xaa-Pro-Lys N-methyltransferase X-ray 2.40 2021-11-09 97.56 0.99 0.01 ok
8DNO_A P00352 Retinal dehydrogenase 1 EM 3.40 2022-07-11 97.81 0.99 0.01 ok
7Q3I_AAA P02766 Transthyretin X-ray 1.55 2021-10-27 88.00 0.99 0.00 ok
8DNM_A Q16555 Dihydropyrimidinase-related protein 2 EM 2.76 2022-07-11 90.25 1.00 0.00 ok
8DNP_A P02794 Ferritin heavy chain EM 2.69 2022-07-11 95.31 1.00 0.00 ok
7Q1P_A P06276 Cholinesterase X-ray 2.35 2021-10-20 93.38 1.00 0.00 ok
8D46_A P00352 Retinal dehydrogenase 1 EM 2.84 2022-06-01 97.81 1.00 0.00 ok
7Q1O_A P06276 Cholinesterase X-ray 2.65 2021-10-20 93.38 1.00 0.00 ok
8D45_A Q93088 Betaine--homocysteine S-methyltransferase EM 2.62 2022-06-01 92.62 1.00 0.00 ok
8D43_A Q14697 Neutral alpha-glucosidase AB EM 2.88 2022-06-01 92.94 1.00 0.00 ok
7Q1M_A P06276 Cholinesterase X-ray 2.79 2021-10-20 93.38 1.00 0.00 ok
7Q1N_A P06276 Cholinesterase X-ray 2.35 2021-10-20 93.38 1.00 0.00 ok
8DNU_A P15104 Glutamine synthetase EM 2.73 2022-07-11 97.50 1.00 0.00 ok
7STC_A P55064 Aquaporin-5 X-ray 2.25 2021-11-12 94.31 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.