Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2019-09-18

80
structures analysed (53 full · 66.2%)
45.0%
confidently wrong
33.8%
novel sequences
11.2%
novel & wrong
0.973
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 4 of 80 structures (5.0%) are confidently wrong; median TM-score is 0.973.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.973 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6MFA_A P02751 Fibronectin X-ray 1.75 2018-09-10 0.00 76.80 0.51 0.82 0.00 30.66 0.76 ok
6PBX_B P0DP23 Calmodulin-1 EM 4.00 2019-06-14 0.00 86.76 0.48 0.83 8.75 12.41 0.61 wrong
6PBY_B P0DP23 Calmodulin-1 EM 3.67 2019-06-14 0.00 86.64 0.47 0.80 9.51 12.54 0.59 wrong
6PAI_E Q9BW61 DET1- and DDB1-associated protein 1 X-ray 2.90 2019-06-11 100.00 novel 74.01 0.30 0.75 6.88 15.65 0.58 wrong
6MFO_A Q96QU1 Protocadherin-15 X-ray 3.15 2018-09-11 3.50 77.17 0.61 0.86 10.29 11.71 0.51 ok
6PM9_E O60502 O-GlcNAcase stalk domain X-ray 2.86 2019-07-01 0.00 90.66 0.82 0.89 29.46 11.26 0.37 ok
6HKP_S Q13625 Apoptosis-stimulating of p53 protein 2 X-ray 1.90 2018-09-07 0.00 95.95 0.38 0.68 30.36 5.93 0.36 wrong
6JN2_A P55197 Protein AF-10 X-ray 3.60 2019-03-13 0.00 80.57 0.52 0.91 25.75 6.63 0.32 ok
6PAI_A Q16531 DNA damage-binding protein 1 X-ray 2.90 2019-06-11 0.00 93.09 0.93 0.95 52.78 3.35 0.18 ok
6R2U_A P25311 Zinc-alpha-2-glycoprotein X-ray 2.49 2019-03-18 0.00 97.21 0.83 0.97 55.06 3.12 0.18 ok
6MGA_A Q08174 Protocadherin-1 X-ray 3.15 2018-09-13 76.19 0.85 0.11 ok
6HK9_A Q9BXU0 Testis-expressed protein 12 X-ray 1.45 2018-09-06 79.75 0.86 0.11 ok
6PAY_A O75874 Isocitrate dehydrogenase [NADP] cytoplasmi X-ray 2.20 2019-06-12 0.00 96.14 0.96 0.96 78.36 1.61 0.09 ok
6JN2_B Q8TEK3 Histone-lysine N-methyltransferase, H3 lys X-ray 3.60 2019-03-13 100.00 novel 89.58 0.79 0.93 77.24 1.65 0.09 ok
6N33_A P07333 Macrophage colony-stimulating factor 1 rec X-ray 2.25 2018-11-14 0.00 81.36 0.91 0.86 76.88 4.63 0.08 ok
6O5E_A P04004 Vitronectin X-ray 1.90 2019-03-01 69.00 92.87 0.92 0.86 83.20 2.28 0.08 ok
6INV_A P22897 Macrophage mannose receptor 1 X-ray 3.30 2018-10-27 82.06 0.90 0.08 ok
6IEU_C P68431 ALA-ARG-THR-LYS-GLN-THR-ALA-ARG-LYS-SER-TH X-ray 1.79 2018-09-17 62.57 0.37 0.93 70.00 2.24 0.08 ok
6INN_A P22897 Macrophage mannose receptor 1 X-ray 3.00 2018-10-26 82.06 0.90 0.08 ok
6INU_A P22897 Macrophage mannose receptor 1 X-ray 2.65 2018-10-27 82.06 0.91 0.08 ok
6SJM_B Q15596 Nuclear receptor coactivator 2 X-ray 2.52 2019-08-13 64.10 0.49 0.81 69.23 2.31 0.07 ok
6N3W_A P49773 Histidine triad nucleotide-binding protein X-ray 1.75 2018-11-16 0.00 97.16 0.96 0.95 90.22 2.54 0.07 ok
6N3Y_A P49773 Histidine triad nucleotide-binding protein X-ray 1.80 2018-11-16 0.00 97.16 0.96 0.95 90.43 2.52 0.07 ok
6N3V_A P49773 Histidine triad nucleotide-binding protein X-ray 1.45 2018-11-16 0.00 97.16 0.96 0.95 90.22 2.52 0.07 ok
6N3X_A P49773 Histidine triad nucleotide-binding protein X-ray 1.10 2018-11-16 0.00 97.16 0.96 0.95 90.22 2.54 0.07 ok
6MGN_A P15923 Transcription factor E2-alpha X-ray 1.90 2018-09-14 51.09 0.87 0.07 ok
6KMS_A Q9UI30 Multifunctional methyltransferase subunit X-ray 3.20 2019-08-01 67.00 93.09 0.92 0.92 87.50 1.26 0.06 ok
6INO_A P22897 Macrophage mannose receptor 1 X-ray 3.05 2018-10-26 82.06 0.92 0.06 ok
6IOE_A P22897 Macrophage mannose receptor 1 X-ray 2.90 2018-10-30 82.06 0.92 0.06 ok
6SRH_A Q04771 Activin receptor type-1 X-ray 1.25 2019-09-05 0.00 94.53 0.95 0.91 89.41 2.25 0.06 ok
6OBN_A P62136 Serine/threonine-protein phosphatase PP1-a X-ray 2.70 2019-03-21 0.00 96.43 0.97 0.93 92.87 2.12 0.05 ok
6OBP_A P62136 Serine/threonine-protein phosphatase PP1-a X-ray 2.70 2019-03-21 0.00 96.43 0.97 0.93 92.79 1.98 0.05 ok
6HKP_A Q9NWT6 Hypoxia-inducible factor 1-alpha inhibitor X-ray 1.90 2018-09-07 91.38 0.95 0.05 ok
6IE3_A Q13686 Nucleic acid dioxygenase ALKBH1 X-ray 1.97 2018-09-13 86.00 0.95 0.04 ok
6KMR_A Q9UI30 Multifunctional methyltransferase subunit X-ray 2.00 2019-08-01 67.00 92.41 0.95 0.94 94.76 0.92 0.04 ok
6P9G_A P45974 Ubiquitin carboxyl-terminal hydrolase 5 X-ray 2.10 2019-06-10 0.00 85.12 0.95 0.92 93.59 1.00 0.04 ok
6S90_A Q06187 Tyrosine-protein kinase BTK X-ray 1.82 2019-07-11 0.00 91.37 0.98 0.95 93.42 0.99 0.04 ok
6PAI_D Q14498 RNA-binding protein 39 X-ray 2.90 2019-06-11 0.00 86.54 0.94 0.93 94.06 0.97 0.04 ok
6HH1_A P10721 Mast/stem cell growth factor receptor Kit, X-ray 2.25 2018-08-24 78.19 0.95 0.04 ok
6PAI_C Q66K64 DDB1- and CUL4-associated factor 15 X-ray 2.90 2019-06-11 100.00 novel 92.53 0.99 0.95 95.76 0.96 0.03 ok
6PM9_A O60502 O-GlcNAcase TIM-barrel domain X-ray 2.86 2019-07-01 0.00 95.14 0.99 0.96 97.57 1.19 0.03 ok
6PX0_A Q9NZN9 Aryl-hydrocarbon-interacting protein-like X-ray 1.55 2019-07-24 45.50 95.24 0.99 0.97 99.07 0.58 0.03 ok
6KMS_C Q9Y5N5 Methyltransferase N6AMT1 X-ray 3.20 2019-08-01 65.70 95.35 0.99 0.95 98.33 0.71 0.03 ok
6J2H_B P61769 Beta-2-microglobulin X-ray 2.30 2019-01-01 0.00 96.48 0.98 0.97 98.51 0.65 0.03 ok
6J2E_B P61769 Beta-2-microglobulin X-ray 2.10 2019-01-01 0.00 97.00 0.98 0.98 98.99 0.50 0.03 ok
6J2I_B P61769 Beta-2-microglobulin X-ray 2.30 2019-01-01 0.00 97.00 0.98 0.98 99.24 0.50 0.03 ok
6OBQ_A P62136 Serine/threonine-protein phosphatase PP1-a X-ray 1.84 2019-03-21 0.40 97.41 0.99 0.97 98.04 0.79 0.03 ok
6K05_A P25440 Bromodomain-containing protein 2 X-ray 1.94 2019-05-05 0.00 96.25 0.98 0.97 98.84 0.52 0.03 ok
6J2G_B P61769 Beta-2-microglobulin X-ray 2.41 2019-01-01 0.00 97.00 0.98 0.99 99.75 0.45 0.03 ok
5QQP_A P03951 Coagulation factor XI X-ray 2.08 2019-05-20 0.00 87.43 0.98 0.96 98.00 1.47 0.03 ok
6Q9T_A P00918 Carbonic anhydrase 2 X-ray 2.68 2018-12-18 0.00 98.11 0.99 0.96 98.42 0.52 0.03 ok
5QQO_A P03951 Coagulation factor XI X-ray 2.00 2019-05-20 0.00 87.43 0.98 0.96 98.00 1.47 0.03 ok
6SJM_A P19793 Retinoic acid receptor RXR-alpha X-ray 2.52 2019-08-13 0.00 94.07 0.99 0.98 99.53 0.47 0.03 ok
6J2J_B P61769 Beta-2-microglobulin X-ray 2.50 2019-01-01 0.00 97.00 0.98 0.98 99.49 0.46 0.03 ok
6HK2_B P68871 Hemoglobin subunit beta X-ray 1.55 2018-09-05 97.19 0.97 0.03 ok
6KMR_B Q9Y5N5 Methyltransferase N6AMT1 X-ray 2.00 2019-08-01 65.70 95.48 0.99 0.96 98.34 0.54 0.03 ok
6OBR_A P62136 Serine/threonine-protein phosphatase PP1-a X-ray 1.50 2019-03-21 0.40 97.41 0.99 0.98 98.29 0.69 0.02 ok
6OBU_A P62136 Serine/threonine-protein phosphatase PP1-a X-ray 1.95 2019-03-21 0.40 97.41 0.99 0.98 98.38 0.71 0.02 ok
6MEV_A Q6NYC1 Bifunctional arginine demethylase and lysy X-ray 2.60 2018-09-07 87.31 0.97 0.02 ok
6J4A_A P02794 Ferritin heavy chain X-ray 3.99 2019-01-08 0.00 98.10 0.99 0.98 100.00 0.38 0.02 ok
6IEX_A A0A499S0B6 MHC class I antigen X-ray 2.31 2018-09-17 86.50 0.97 0.02 ok
6IE2_A Q13686 Nucleic acid dioxygenase ALKBH1 X-ray 2.80 2018-09-13 86.00 0.97 0.02 ok
6OBN_C Q15435 Protein phosphatase 1 regulatory subunit 7 X-ray 2.70 2019-03-21 65.00 98.08 1.00 0.99 99.65 0.37 0.02 ok
6OBS_A P62136 Serine/threonine-protein phosphatase PP1-a X-ray 1.80 2019-03-21 0.40 97.41 1.00 0.99 99.40 0.43 0.02 ok
6R4V_A O95749 Geranylgeranyl pyrophosphate synthase X-ray 2.20 2019-03-24 0.40 95.83 1.00 0.99 99.31 0.42 0.02 ok
6IEU_A O15016 Tripartite motif-containing protein 66 X-ray 1.79 2018-09-17 54.44 0.97 0.02 ok
6K04_A P25440 Bromodomain-containing protein 2 X-ray 1.25 2019-05-05 0.00 96.28 0.99 0.99 99.77 0.34 0.02 ok
6HK2_A P69905 Hemoglobin subunit alpha X-ray 1.55 2018-09-05 98.06 0.98 0.02 ok
6IEX_B P61769 Beta-2-microglobulin X-ray 2.31 2018-09-17 94.06 0.98 0.02 ok
6AG3_U P00749 Urokinase-type plasminogen activator X-ray 2.48 2018-08-09 82.12 0.98 0.02 ok
6OBP_C Q15435 Protein phosphatase 1 regulatory subunit 7 X-ray 2.70 2019-03-21 65.00 98.15 1.00 0.99 99.30 0.43 0.02 ok
6AG9_U P00749 Urokinase-type plasminogen activator X-ray 1.63 2018-08-09 82.12 0.98 0.02 ok
6AG2_U P00749 Urokinase-type plasminogen activator X-ray 1.77 2018-08-09 82.12 0.98 0.02 ok
6GQ3_A P08243 Asparagine synthetase [glutamine-hydrolyzi X-ray 1.85 2018-06-07 94.25 0.99 0.01 ok
6OIA_A P04181 Ornithine aminotransferase, mitochondrial X-ray 1.78 2019-04-09 0.00 98.48 1.00 1.00 99.94 0.22 0.01 ok
6IET_A O15016 Tripartite motif-containing protein 66 X-ray 2.10 2018-09-17 54.44 0.98 0.01 ok
6H3R_A B7Z5N5 Mothers against decapentaplegic homolog X-ray 2.75 2018-07-19 68.44 0.99 0.01 ok
6I3C_A P21964 Catechol O-methyltransferase X-ray 1.34 2018-11-05 93.94 0.99 0.01 ok
6I3D_A P21964 Catechol O-methyltransferase X-ray 1.45 2018-11-05 93.94 0.99 0.01 ok
6HZX_A P00918 Carbonic anhydrase 2 X-ray 2.91 2018-10-24 97.38 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.