Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2020-01-29

92
structures analysed (77 full · 83.7%)
11.1%
confidently wrong
55.4%
novel sequences
00.0%
novel & wrong
0.961
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 1 of 92 structures (1.1%) are confidently wrong; median TM-score is 0.961.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.961 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6NQ3_B Q15022 Polycomb protein SUZ12 X-ray 2.89 2019-01-19 0.00 87.39 0.58 0.74 8.42 15.66 0.61 ok
6JAT_B P63267 Actin, gamma-enteric smooth muscle X-ray 2.71 2019-01-25 0.00 96.56 0.23 0.64 23.44 7.68 0.45 wrong
6JAS_A P02787 Serotransferrin X-ray 2.50 2019-01-25 0.00 95.10 0.82 0.93 33.84 6.25 0.34 ok
6QCB_A P07339 Cathepsin D X-ray 1.55 2018-12-27 0.00 85.36 0.95 0.85 43.81 7.29 0.24 ok
6QBH_A P07339 Cathepsin D X-ray 1.85 2018-12-21 0.00 85.36 0.95 0.85 43.56 7.29 0.24 ok
6QBG_A P07339 Cathepsin D X-ray 1.80 2018-12-21 0.00 85.19 0.95 0.84 44.39 7.38 0.23 ok
6XT9_J A8MTZ0 BBSome-interacting protein 1 EM 3.80 2020-01-15 32.60 92.61 0.62 0.93 54.55 4.32 0.18 ok
6XT9_A Q8NFJ9 Bardet-Biedl syndrome 1 protein EM 3.80 2020-01-15 89.44 0.80 0.18 ok
6E7I_A Q10471 Polypeptide N-acetylgalactosaminyltransfer X-ray 1.80 2018-07-26 89.81 0.80 0.18 ok
6KBB_B Q16778 Histone H2B type 2-E X-ray 2.37 2019-06-24 0.00 93.38 0.82 0.91 60.53 4.53 0.16 ok
6KR8_A P07550 beta 2 adrenergic receptor NMR 2019-08-21 5.00 90.91 0.89 0.79 62.82 4.51 0.15 ok
6UDK_A S6B2B6 10-1074 Fab Heavy Chain EM 3.90 2019-09-19 0.00 87.44 0.83 0.77 62.40 3.87 0.13 ok
6OEO_N P09429 High mobility group protein B1 EM 3.69 2019-03-27 0.00 91.69 0.65 0.71 67.59 2.25 0.12 ok
6UDJ_A S6B2B6 10-1074 Fab Heavy Chain EM 2.50 2019-09-19 0.00 87.44 0.86 0.84 66.80 3.89 0.12 ok
6NQ3_C Q5T6S3 PHD finger protein 19 X-ray 2.89 2019-01-19 100.00 novel 68.28 0.63 0.88 57.55 3.83 0.12 ok
6UDK_B Q8N355 10-1074 Fab Light Chain EM 3.90 2019-09-19 0.00 93.57 0.81 0.72 74.04 2.59 0.12 ok
6XT9_I Q3SYG4 Protein PTHB1 EM 3.80 2020-01-15 85.06 0.86 0.11 ok
6TXS_AAA P26038 Moesin X-ray 2.20 2020-01-14 0.00 94.34 0.93 0.95 72.21 2.15 0.11 ok
6OEN_H P09429 High mobility group protein B1 EM 4.30 2019-03-27 0.00 91.69 0.70 0.77 70.00 1.98 0.11 ok
6XT9_D Q96RK4 Bardet-Biedl syndrome 4 protein EM 3.80 2020-01-15 77.69 0.87 0.10 ok
6OEM_H P09429 High mobility group protein B1 EM 3.60 2019-03-27 0.00 91.69 0.73 0.79 74.55 1.79 0.10 ok
6UDJ_B Q8N355 10-1074 Fab Light Chain EM 2.50 2019-09-19 0.00 93.57 0.84 0.80 81.25 2.50 0.10 ok
6UDK_D S6C4S0 1-55 Fab Heavy Chain EM 3.90 2019-09-19 27.10 91.53 0.84 0.77 78.89 2.48 0.10 ok
6T9L_O P0CG48 Polyubiquitin-C EM 3.60 2019-10-28 0.00 89.83 0.87 0.84 76.97 2.62 0.09 ok
6HW2_B Q13185 Chromobox protein homolog 3 X-ray 1.94 2018-10-11 75.38 0.89 0.09 ok
6SDF_A P62993 Growth factor receptor-bound protein 2 X-ray 2.50 2019-07-26 1.80 87.91 0.87 0.92 79.17 2.04 0.08 ok
6NQT_A Q10471 Polypeptide N-acetylgalactosaminyltransfer X-ray 3.05 2019-01-21 0.60 96.10 0.97 0.97 81.41 1.50 0.08 ok
6NAS_N Q93015 N-alpha-acetyltransferase 80 X-ray 2.90 2018-12-06 61.00 91.71 0.92 0.92 86.94 4.37 0.08 ok
6PX9_A Q14790 Caspase-8 X-ray 2.88 2019-07-25 1.50 91.77 0.96 0.88 83.49 3.65 0.08 ok
6NBW_N Q93015 N-alpha-acetyltransferase 80 X-ray 2.50 2018-12-10 61.00 92.48 0.94 0.94 83.53 3.94 0.07 ok
6KBB_A P20671 Histone H2A type 1-D X-ray 2.37 2019-06-24 1.10 97.77 0.90 0.92 87.21 1.71 0.07 ok
6TXQ_AAA P26038 Moesin X-ray 1.73 2020-01-14 0.00 94.54 0.96 0.95 87.27 1.44 0.07 ok
6NQ3_D Q92833 Protein Jumonji X-ray 2.89 2019-01-19 72.87 0.55 0.91 79.41 1.73 0.07 ok
5QU9_A P63000 Ras-related C3 botulinum toxin substrate 1 X-ray 2.00 2019-12-13 0.60 96.56 0.94 0.90 88.14 1.71 0.07 ok
6PYX_A A8K7I4 cDNA FLJ56608, highly similar to Homo sapi X-ray 2.60 2019-07-31 100.00 novel 93.62 0.95 0.88 90.49 1.78 0.06 ok
6UDK_E Q6PJF2 1-55 Fab Light Chain EM 3.90 2019-09-19 14.00 95.87 0.93 0.81 88.43 1.15 0.06 ok
6PYO_A A8K7I4 cDNA FLJ56608, highly similar to Homo sapi X-ray 2.00 2019-07-30 100.00 novel 93.64 0.95 0.89 90.99 1.83 0.06 ok
6XT9_H A0A0C4DGY3 Tetratricopeptide repeat domain 8 isoform EM 3.80 2020-01-15 89.38 0.93 0.06 ok
6JOZ_A P04439 HLA class I histocompatibility antigen, A- X-ray 1.35 2019-03-25 0.00 96.88 0.97 0.98 89.14 1.12 0.06 ok
6VAK_A Q9HA72 Calcium homeostasis modulator protein 2 EM 3.48 2019-12-17 81.12 0.93 0.06 ok
6H0Z_A Q6B0I6 Lysine-specific demethylase 4D X-ray 1.34 2018-07-10 73.06 0.92 0.06 ok
6H10_A Q6B0I6 Lysine-specific demethylase 4D X-ray 1.10 2018-07-10 73.06 0.92 0.06 ok
6H0W_A Q6B0I6 Lysine-specific demethylase 4D X-ray 1.23 2018-07-10 73.06 0.92 0.06 ok
6H0Y_A Q6B0I6 Lysine-specific demethylase 4D X-ray 1.21 2018-07-10 73.06 0.92 0.06 ok
6H0X_A Q6B0I6 Lysine-specific demethylase 4D X-ray 1.64 2018-07-10 73.06 0.92 0.06 ok
6H11_A Q6B0I6 Lysine-specific demethylase 4D X-ray 1.52 2018-07-10 73.06 0.92 0.06 ok
6VAI_A Q9HA72 Calcium homeostasis modulator protein 2 EM 3.68 2019-12-17 81.12 0.93 0.05 ok
6NBW_A P60709 Actin, cytoplasmic 1 X-ray 2.50 2018-12-10 0.00 95.96 0.99 0.97 95.98 0.87 0.04 ok
6RIR_C Q969X0 RILP-like protein 2 X-ray 1.77 2019-04-25 100.00 novel 92.88 0.81 0.96 96.88 0.81 0.04 ok
6UDJ_E Q6PIL8 1-18 Fab Light Chain EM 2.50 2019-09-19 15.90 94.86 0.96 0.93 95.14 1.04 0.04 ok
6SPW_A P68400 Casein kinase II subunit alpha X-ray 1.60 2019-09-03 0.00 97.26 0.99 0.97 94.95 0.83 0.04 ok
6JAT_A Q86TU7 Histone-lysine N-methyltransferase setd3 X-ray 2.71 2019-01-25 0.00 97.73 0.99 0.99 95.79 0.71 0.04 ok
6T2D_A Q00987 E3 ubiquitin-protein ligase Mdm2 X-ray 1.80 2019-10-08 0.00 94.72 0.96 0.92 98.24 0.84 0.04 ok
6NQ3_A Q09028 Histone-binding protein RBBP4 X-ray 2.89 2019-01-19 0.00 96.56 0.99 0.96 96.00 1.05 0.04 ok
5QU9_B O60229 Kalirin X-ray 2.00 2019-12-13 0.00 90.33 0.98 0.95 96.37 0.89 0.04 ok
6QE1_A Q16539 Mitogen-activated protein kinase 14 X-ray 1.85 2019-01-03 0.00 93.30 0.98 0.94 95.66 1.04 0.04 ok
6QDZ_A Q16539 Mitogen-activated protein kinase 14 X-ray 1.73 2019-01-03 0.00 93.31 0.98 0.94 95.72 1.07 0.04 ok
6NSL_A P29597 Non-receptor tyrosine-protein kinase TYK2 X-ray 2.15 2019-01-25 0.00 90.03 0.98 0.95 96.22 0.85 0.03 ok
6QBH_B P07339 Cathepsin D X-ray 1.85 2018-12-21 0.00 92.83 0.98 0.96 95.75 0.79 0.03 ok
6JBU_B Q9NZU0 Leucine-rich repeat transmembrane protein X-ray 1.85 2019-01-26 0.00 96.42 0.99 0.98 98.52 0.62 0.03 ok
6QBG_B P07339 Cathepsin D X-ray 1.80 2018-12-21 0.00 92.83 0.98 0.96 95.85 0.80 0.03 ok
6JP3_A P04439 HLA class I histocompatibility antigen, A- X-ray 1.66 2019-03-25 0.00 96.88 0.99 0.98 98.36 0.67 0.03 ok
6QCB_B P07339 Cathepsin D X-ray 1.55 2018-12-27 0.00 92.83 0.98 0.96 95.64 0.78 0.03 ok
6QDU_A P31947 14-3-3 protein sigma X-ray 1.63 2019-01-02 0.00 95.96 0.97 0.97 97.36 1.43 0.03 ok
6RKP_A P27338 Amine oxidase [flavin-containing] B X-ray 1.70 2019-04-30 0.00 96.75 0.99 0.98 98.75 0.57 0.03 ok
6RKB_A P27338 Amine oxidase [flavin-containing] B X-ray 2.30 2019-04-30 0.00 96.75 0.99 0.98 98.60 0.58 0.03 ok
6T2E_A Q00987 E3 ubiquitin-protein ligase Mdm2 X-ray 2.40 2019-10-08 0.00 94.72 0.97 0.96 97.94 0.69 0.03 ok
6JOZ_B P61769 Beta-2-microglobulin X-ray 1.35 2019-03-25 0.00 97.00 0.98 0.98 99.24 0.54 0.03 ok
6QDR_A P31947 14-3-3 protein sigma X-ray 1.61 2019-01-02 0.00 95.92 0.97 0.98 97.59 0.83 0.03 ok
6RLE_A P27338 Amine oxidase [flavin-containing] B X-ray 2.30 2019-05-02 0.00 96.75 1.00 0.98 98.85 0.54 0.03 ok
6SPX_A P68400 Casein kinase II subunit alpha X-ray 1.99 2019-09-03 0.00 97.18 0.99 0.97 96.88 0.90 0.03 ok
6QDT_A P31947 14-3-3 protein sigma X-ray 1.70 2019-01-02 0.00 95.88 0.97 0.98 97.93 0.59 0.03 ok
6T2F_A Q00987 E3 ubiquitin-protein ligase Mdm2 X-ray 2.09 2019-10-08 0.00 94.72 0.97 0.96 98.53 0.68 0.03 ok
6RIR_A P61006 Ras-related protein Rab-8A X-ray 1.77 2019-04-25 0.60 93.46 0.99 0.97 97.98 0.58 0.03 ok
6NBW_P P07737 Profilin-1 X-ray 2.50 2018-12-10 0.00 96.19 0.98 0.96 97.46 0.59 0.03 ok
5QTY_A P03951 Coagulation factor XI X-ray 1.89 2019-11-13 0.00 87.43 0.98 0.96 98.21 1.47 0.03 ok
6NAS_P P07737 Profilin-1 X-ray 2.90 2018-12-06 0.00 96.19 0.98 0.96 97.64 0.58 0.03 ok
6QDS_A P31947 14-3-3 protein sigma X-ray 1.72 2019-01-02 0.00 95.87 0.97 0.98 98.47 0.55 0.03 ok
5QTX_A P03951 Coagulation factor XI X-ray 2.07 2019-11-13 0.00 87.43 0.98 0.96 98.00 1.46 0.03 ok
5QTW_A P03951 Coagulation factor XI X-ray 2.12 2019-11-13 0.00 87.43 0.98 0.96 98.00 1.46 0.03 ok
5QTV_A P03951 Coagulation factor XI X-ray 2.20 2019-11-13 0.00 87.43 0.98 0.96 98.11 1.47 0.03 ok
6JP3_B P61769 Beta-2-microglobulin X-ray 1.66 2019-03-25 0.00 97.00 0.98 0.98 98.74 0.54 0.03 ok
6TKV_B Q9BYC5 Alpha-(1,6)-fucosyltransferase X-ray 1.95 2019-11-29 3.30 97.25 1.00 0.99 99.12 0.83 0.03 ok
6ONY_A P25440 Bromodomain-containing protein 2 X-ray 1.98 2019-04-22 4.60 95.93 0.99 0.99 99.56 0.39 0.02 ok
6U5E_A P62937 Peptidyl-prolyl cis-trans isomerase A X-ray 1.56 2019-08-27 0.00 98.32 1.00 0.99 99.85 0.34 0.02 ok
6TKV_A Q9BYC5 Alpha-(1,6)-fucosyltransferase X-ray 1.95 2019-11-29 0.00 96.90 1.00 1.00 99.73 0.36 0.02 ok
6U5D_A P62937 Peptidyl-prolyl cis-trans isomerase A X-ray 1.65 2019-08-27 0.00 98.32 1.00 1.00 99.85 0.33 0.02 ok
6U5C_A P62937 Peptidyl-prolyl cis-trans isomerase A X-ray 1.62 2019-08-27 0.00 98.32 1.00 0.99 99.85 0.33 0.02 ok
6U5G_A P62937 Peptidyl-prolyl cis-trans isomerase A EM 2.50 2019-08-27 0.00 98.32 1.00 0.99 100.00 0.31 0.02 ok
6QCK_A Q9BPX1 17-beta-hydroxysteroid dehydrogenase 14 X-ray 1.68 2018-12-28 0.00 97.76 0.99 0.99 99.03 0.76 0.02 ok
6KAJ_A Q9H9S5 Fukutin-related protein X-ray 2.22 2019-06-23 100.00 novel 96.84 1.00 0.99 99.50 0.35 0.02 ok
6VDB_A Q9BYW2 Histone-lysine N-methyltransferase SETD2 X-ray 2.30 2019-12-24 43.34 0.99 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.