Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2021-01-20

113
structures analysed (14 full · 12.4%)
00.0%
confidently wrong
32.7%
novel sequences
00.0%
novel & wrong
0.966
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 0 of 113 structures (0.0%) are confidently wrong; median TM-score is 0.966.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.966 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7JIC_B P60033 CD81 antigen EM 3.80 2020-07-23 2.60 88.07 0.57 0.62 19.12 9.48 0.45 ok
7AS4_3 Q96CW5 Gamma-tubulin complex component 3 EM 4.13 2020-10-26 73.69 0.58 0.31 ok
6M49_B Q12770 Sterol regulatory element-binding protein EM 3.70 2020-03-06 72.10 novel 76.04 0.75 0.69 38.97 10.75 0.26 ok
7JY5_A P55072 Transitional endoplasmic reticulum ATPase EM 2.89 2020-08-28 82.56 0.71 0.24 ok
6XJA_A P01876 Immunoglobulin heavy constant alpha 1 EM 4.00 2020-06-23 81.88 0.74 0.21 ok
7AS4_4 Q96RT7 Gamma-tubulin complex component 6 EM 4.13 2020-10-26 59.56 0.66 0.20 ok
7K0C_A P01871 Immunoglobulin heavy constant mu EM 3.30 2020-09-04 85.44 0.79 0.18 ok
6XR0_M P08582 Melanotransferrin X-ray 3.06 2020-07-10 89.38 0.82 0.16 ok
7LCI_R P43220 Glucagon-like peptide 1 receptor EM 2.90 2021-01-11 81.50 0.82 0.15 ok
7LCJ_R P43220 Glucagon-like peptide 1 receptor EM 2.82 2021-01-11 81.50 0.82 0.14 ok
7LCK_R P43220 Glucagon-like peptide 1 receptor EM 3.24 2021-01-11 81.50 0.83 0.14 ok
7C7W_C Q15648 Mediator of RNA polymerase II transcriptio X-ray 1.90 2020-05-26 50.12 0.72 0.14 ok
7BBL_E Q9NWZ8 Gem-associated protein 8 X-ray 1.52 2020-12-17 68.62 0.82 0.12 ok
6LR2_A Q9H6S0 YTH domain containing protein 2 (YTHDC2) NMR 2020-01-15 0.00 85.39 0.93 0.87 64.72 4.19 0.12 ok
7LCI_A P63092 Guanine nucleotide-binding protein G(s) su EM 2.90 2021-01-11 91.31 0.89 0.10 ok
7AHZ_CCC P0CG47 Polyubiquitin-B X-ray 1.82 2020-09-25 93.44 0.90 0.09 ok
6XKB_F P24928 S2,S5p-CTD peptide X-ray 1.60 2020-06-26 100.00 novel 33.88 0.34 0.62 41.07 4.02 0.09 ok
6M6E_A Q9NSA1 Fibroblast growth factor 21 NMR 2020-03-14 57.50 89.28 0.88 0.82 78.71 2.41 0.09 ok
6YUP_D P82251 b(0,+)-type amino acid transporter 1 EM 2.90 2020-04-27 85.44 0.90 0.08 ok
7AI1_CCC P0CG47 Polyubiquitin-B X-ray 2.07 2020-09-25 93.44 0.91 0.08 ok
7AI0_CCC P0CG47 Polyubiquitin-B X-ray 1.56 2020-09-25 93.44 0.91 0.08 ok
7C7V_C Q15648 Mediator of RNA polymerase II transcriptio X-ray 2.00 2020-05-26 50.12 0.84 0.08 ok
6VBI_A O76074 cGMP-specific 3',5'-cyclic phosphodiestera X-ray 2.30 2019-12-18 82.00 0.90 0.08 ok
6M49_A Q9Y5U4 Insulin-induced gene 2 protein EM 3.70 2020-03-06 100.00 novel 83.31 0.91 0.80 79.26 2.25 0.08 ok
6YV1_A P82251 b(0,+)-type amino acid transporter 1 EM 3.40 2020-04-27 85.44 0.91 0.07 ok
7K0C_D P01591 Immunoglobulin J chain EM 3.30 2020-09-04 87.06 0.91 0.07 ok
6M6F_A Q9NSA1 Fibroblast growth factor 21 NMR 2020-03-14 48.20 89.28 0.88 0.82 83.59 2.23 0.07 ok
6ZOQ_A P03372 Estrogen receptor X-ray 1.80 2020-07-07 66.44 0.89 0.07 ok
6ZOS_A P03372 Estrogen receptor X-ray 2.00 2020-07-07 66.44 0.89 0.07 ok
7LCI_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.90 2021-01-11 89.56 0.92 0.07 ok
7LBL_A Q6PYX1 Ig gamma-1 chain C region X-ray 2.13 2021-01-08 88.69 0.92 0.07 ok
6ZOR_A P03372 Estrogen receptor X-ray 1.97 2020-07-07 66.44 0.90 0.07 ok
7AI1_AAA Q00987 E3 ubiquitin-protein ligase Mdm2 X-ray 2.07 2020-09-25 62.59 0.89 0.07 ok
7AI0_AAA Q00987 E3 ubiquitin-protein ligase Mdm2 X-ray 1.56 2020-09-25 62.59 0.90 0.07 ok
6LOH_A O15033 Apoptosis-resistant E3 ubiquitin protein l X-ray 3.21 2020-01-05 64.10 89.69 0.97 0.92 86.66 1.37 0.06 ok
7DRW_H Q9UL46 Proteasome activator complex subunit 2 EM 4.20 2020-12-29 91.81 0.94 0.06 ok
7AS4_I Q9UGJ1 Gamma-tubulin complex component 4 EM 4.13 2020-10-26 82.00 0.94 0.05 ok
7AS4_5 Q08AG7 Mitotic-spindle organizing protein 1 EM 4.13 2020-10-26 92.19 0.94 0.05 ok
6LHR_A Q99536 Synaptic vesicle membrane protein VAT-1 ho X-ray 2.62 2019-12-09 53.40 96.59 0.97 0.94 92.42 1.44 0.05 ok
7DRW_I Q06323 Proteasome activator complex subunit 1 EM 4.20 2020-12-29 90.75 0.94 0.05 ok
6YWZ_A Q9Y566 SH3 and multiple ankyrin repeat domains pr X-ray 2.12 2020-04-30 47.44 0.90 0.05 ok
6LQX_A Q92793 CREB-binding protein X-ray 2.46 2020-01-14 0.00 94.97 0.96 0.94 94.57 1.16 0.05 ok
6YX1_A Q9Y566 SH3 and multiple ankyrin repeat domains pr X-ray 1.80 2020-04-30 47.44 0.90 0.05 ok
7DR6_B Q06323 Proteasome activator complex subunit 1 EM 4.10 2020-12-26 90.75 0.95 0.04 ok
7DR6_A Q9UL46 Proteasome activator complex subunit 2 EM 4.10 2020-12-26 91.81 0.95 0.04 ok
7AS4_A Q9BSJ2 Gamma-tubulin complex component 2 EM 4.13 2020-10-26 75.62 0.94 0.04 ok
7B2X_A Q9H816 5' exonuclease Apollo X-ray 3.10 2020-11-28 74.81 0.94 0.04 ok
7B9B_A Q9H816 5' exonuclease Apollo X-ray 2.80 2020-12-14 74.81 0.95 0.04 ok
7AS4_J Q96RT8 Gamma-tubulin complex component 5 EM 4.13 2020-10-26 69.19 0.94 0.04 ok
7AS4_7 P60709 Actin, cytoplasmic 1 EM 4.13 2020-10-26 95.19 0.96 0.04 ok
6YX2_A Q9Y566 SH3 and multiple ankyrin repeat domains pr X-ray 1.62 2020-04-30 47.44 0.93 0.04 ok
6M5W_A P34896 Serine hydroxymethyltransferase, cytosolic X-ray 3.10 2020-03-11 0.00 97.63 0.99 0.96 96.92 1.82 0.03 ok
7CCU_A P53355 Death-associated protein kinase 1 X-ray 1.65 2020-06-18 82.56 0.96 0.03 ok
7CCW_A P53355 Death-associated protein kinase 1 X-ray 1.40 2020-06-18 82.56 0.96 0.03 ok
7CCV_A P53355 Death-associated protein kinase 1 X-ray 1.75 2020-06-18 82.56 0.96 0.03 ok
7JIC_A P15391 B-lymphocyte antigen CD19 EM 3.80 2020-07-23 62.22 0.95 0.03 ok
7AS4_1 P23258 Tubulin gamma-1 chain EM 4.13 2020-10-26 91.62 0.97 0.03 ok
6YX0_A Q9Y566 SH3 and multiple ankyrin repeat domains pr X-ray 1.57 2020-04-30 47.44 0.93 0.03 ok
7DF7_A P58546 Myotrophin X-ray 2.30 2020-11-06 88.25 0.96 0.03 ok
6VQN_A Q9NZQ7 Programmed cell death 1 ligand 1 X-ray 2.49 2020-02-05 88.25 0.97 0.03 ok
6T36_A P26045 Tyrosine-protein phosphatase non-receptor X-ray 1.86 2019-10-10 0.00 82.95 0.97 0.95 97.85 0.64 0.03 ok
7AI0_BBB P62837 Ubiquitin-conjugating enzyme E2 D2 X-ray 1.56 2020-09-25 96.50 0.97 0.03 ok
7KVI_A P08684 Cytochrome P450 3A4 X-ray 2.55 2020-11-28 92.38 0.97 0.02 ok
7JU2_A P41212 Transcription factor ETV6 X-ray 1.85 2020-08-19 61.81 0.96 0.02 ok
7KGP_A Q861F7 MHC class I antigen X-ray 1.40 2020-10-18 88.19 0.98 0.02 ok
7K0C_C P01833 Polymeric immunoglobulin receptor EM 3.30 2020-09-04 76.69 0.97 0.02 ok
7KVM_A P08684 Cytochrome P450 3A4 X-ray 2.75 2020-11-28 92.38 0.98 0.02 ok
7KVP_A P08684 Cytochrome P450 3A4 X-ray 2.75 2020-11-28 92.38 0.98 0.02 ok
7KGQ_A Q861F7 MHC class I antigen X-ray 1.34 2020-10-18 88.19 0.98 0.02 ok
6VM7_B P61769 Beta-2-microglobulin X-ray 2.41 2020-01-27 94.06 0.98 0.02 ok
7KGT_A Q861F7 MHC class I antigen X-ray 1.90 2020-10-18 88.19 0.98 0.02 ok
6LII_A Q99536 Synaptic vesicle membrane protein VAT-1 ho X-ray 2.30 2019-12-11 53.40 96.44 1.00 0.99 99.35 0.43 0.02 ok
6VMA_A A0A140T913 MHC class I antigen, A-2 alpha chain X-ray 2.75 2020-01-27 84.62 0.98 0.02 ok
7KGO_A Q861F7 MHC class I antigen X-ray 2.15 2020-10-18 88.19 0.98 0.02 ok
6M5O_A P34897 Serine hydroxymethyltransferase, mitochond X-ray 2.30 2020-03-11 0.00 97.86 0.99 0.99 98.97 0.42 0.02 ok
6VM9_B P61769 Beta-2-microglobulin X-ray 2.90 2020-01-27 94.06 0.98 0.02 ok
7BBL_A Q8WXD5 Gem-associated protein 6 X-ray 1.52 2020-12-17 86.69 0.98 0.02 ok
7KGS_A Q861F7 MHC class I antigen X-ray 1.58 2020-10-18 88.19 0.98 0.02 ok
6VM9_A A0A140T913 MHC class I antigen, A-2 alpha chain X-ray 2.90 2020-01-27 84.62 0.98 0.02 ok
6VMC_A A0A140T913 MHC class I antigen, A-2 alpha chain X-ray 2.85 2020-01-27 84.62 0.98 0.02 ok
7CC7_A Q96TC7 Regulator of microtubule dynamics protein X-ray 1.45 2020-06-16 72.19 0.98 0.02 ok
7KGR_A Q861F7 MHC class I antigen X-ray 1.55 2020-10-18 88.19 0.98 0.02 ok
7AI1_BBB P62837 Ubiquitin-conjugating enzyme E2 D2 X-ray 2.07 2020-09-25 96.50 0.98 0.02 ok
6VMC_B P61769 Beta-2-microglobulin X-ray 2.85 2020-01-27 94.06 0.98 0.02 ok
6YUZ_A Q07837 Neutral and basic amino acid transport pro EM 2.80 2020-04-27 87.06 0.98 0.02 ok
6YUP_A Q07837 Neutral and basic amino acid transport pro EM 2.90 2020-04-27 87.06 0.98 0.02 ok
6VMA_B P61769 Beta-2-microglobulin X-ray 2.75 2020-01-27 94.06 0.99 0.01 ok
7JY4_A Q9UM73 ALK tyrosine kinase receptor X-ray 2.42 2020-08-28 68.19 0.98 0.01 ok
7JYR_A Q9UM73 ALK tyrosine kinase receptor X-ray 2.32 2020-08-31 68.19 0.98 0.01 ok
7KGR_B P61769 Beta-2-microglobulin X-ray 1.55 2020-10-18 94.06 0.99 0.01 ok
7KVJ_A P08684 Cytochrome P450 3A4 X-ray 2.65 2020-11-28 92.38 0.99 0.01 ok
7JYS_A Q9UM73 ALK tyrosine kinase receptor X-ray 2.22 2020-08-31 68.19 0.98 0.01 ok
7JYT_A Q9UM73 ALK tyrosine kinase receptor X-ray 2.00 2020-08-31 68.19 0.98 0.01 ok
7KGS_B P61769 Beta-2-microglobulin X-ray 1.58 2020-10-18 94.06 0.99 0.01 ok
7KGQ_B P61769 Beta-2-microglobulin X-ray 1.34 2020-10-18 94.06 0.99 0.01 ok
7KGT_B P61769 Beta-2-microglobulin X-ray 1.90 2020-10-18 94.06 0.99 0.01 ok
6YE1_A P21589 5'-nucleotidase X-ray 2.66 2020-03-23 91.88 0.99 0.01 ok
7KVO_A P08684 Cytochrome P450 3A4 X-ray 2.65 2020-11-28 92.38 0.99 0.01 ok
7KGP_B P61769 Beta-2-microglobulin X-ray 1.40 2020-10-18 94.06 0.99 0.01 ok
7KVK_A P08684 Cytochrome P450 3A4 X-ray 2.55 2020-11-28 92.38 0.99 0.01 ok
6YE2_A P21589 5'-nucleotidase X-ray 2.44 2020-03-23 91.88 0.99 0.01 ok
7LCI_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.90 2021-01-11 97.06 0.99 0.01 ok
7KVS_A P08684 Cytochrome P450 3A4 X-ray 2.50 2020-11-28 92.38 0.99 0.01 ok
7KVH_A P08684 Cytochrome P450 3A4 X-ray 2.79 2020-11-28 92.38 0.99 0.01 ok
7KGO_B P61769 Beta-2-microglobulin X-ray 2.15 2020-10-18 94.06 0.99 0.01 ok
7KVQ_A P08684 Cytochrome P450 3A4 X-ray 2.75 2020-11-28 92.38 0.99 0.01 ok
6VM7_A A0A140T913 MHC class I antigen, A-2 alpha chain X-ray 2.41 2020-01-27 84.62 0.99 0.01 ok
7KVN_A P08684 Cytochrome P450 3A4 X-ray 2.70 2020-11-28 92.38 0.99 0.01 ok
6XKB_A O95104 SR-related and CTD-associated factor 4 X-ray 1.60 2020-06-26 53.94 0.99 0.01 ok
6W5B_A P07320 Gamma-crystallin D X-ray 1.15 2020-03-12 96.44 0.99 0.01 ok
6WCY_A P07320 Gamma-crystallin D X-ray 1.20 2020-03-31 96.44 0.99 0.01 ok
7BBL_B Q9H840 Gem-associated protein 7 X-ray 1.52 2020-12-17 80.25 0.99 0.00 ok
7A1F_A Q9H816 5' exonuclease Apollo X-ray 1.80 2020-08-12 74.81 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.