Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2024-07-17

71
structures analysed (13 full · 18.3%)
68.5%
confidently wrong
11.4%
novel sequences
11.4%
novel & wrong
0.949
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 6 of 71 structures (8.5%) are confidently wrong; median TM-score is 0.949.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.949 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
9BA4_A Q02246 Contactin-2 EM 3.54 2024-04-03 0.00 89.47 0.51 0.87 1.52 28.55 0.85 ok
9IJP_B P37840 Alpha-synuclein EM 3.10 2024-06-25 0.00 83.53 0.26 0.32 0.79 21.10 0.79 wrong
9FYP_I P37840 Alpha-synuclein EM 2.23 2024-07-03 0.00 84.39 0.21 0.29 1.95 22.60 0.77 wrong
8UDZ_A P01137 Transforming growth factor beta-1 proprote X-ray 2.21 2023-09-29 0.90 87.79 0.68 0.79 4.67 21.75 0.69 ok
8K3J_A Q02246 Contactin-2 EM 3.30 2023-07-16 0.00 90.37 0.64 0.91 14.16 15.25 0.58 ok
9CKV_B P05556 Integrin beta-1 EM 3.19 2024-07-09 0.30 92.92 0.66 0.86 13.37 9.92 0.54 ok
9BA5_A Q02246 Contactin-2 EM 3.51 2024-04-03 0.00 90.47 0.68 0.90 16.62 13.14 0.53 ok
8Y8B_C O15393 Transmembrane protease serine 2 EM 3.01 2024-02-06 79.38 0.72 0.22 ok
8TG9_C P01160 Atrial natriuretic peptide EM 3.08 2023-07-12 0.00 60.56 0.15 0.56 39.29 4.72 0.17 ok
8K3Z_D P48061 Stromal cell-derived factor 1 EM 2.81 2023-07-17 83.25 0.80 0.17 ok
8K3Z_C P63096 Guanine nucleotide-binding protein G(i) su EM 2.81 2023-07-17 93.75 0.82 0.17 ok
8K1Y_A P02768 Albumin X-ray 2.15 2023-07-11 92.69 0.84 0.15 ok
9CK0_B Q15653 NF-kappa-B inhibitor beta X-ray 2.60 2024-07-08 76.38 0.83 0.13 ok
8XPU_B Q01650 Large neutral amino acids transporter smal EM 3.30 2024-01-04 85.88 0.87 0.11 ok
8OST_B Q9H9Z2 Protein lin-28 homolog A EM 3.69 2023-04-20 5.80 89.20 0.61 0.84 71.43 2.21 0.11 ok
9CA0_A O95985 DNA topoisomerase 3-beta-1 EM 3.48 2024-06-16 90.25 0.89 0.10 ok
8J8L_B Q01650 Large neutral amino acids transporter smal EM 3.56 2023-05-02 85.88 0.89 0.10 ok
9CJA_A Q9Y462 Zinc finger protein 711 NMR 2024-07-05 100.00 novel 73.65 0.46 0.76 70.37 2.52 0.09 wrong
9C9Y_B Q9H7E2 Tudor domain-containing protein 3 EM 3.35 2024-06-16 0.00 94.63 0.41 0.84 83.82 2.05 0.09 wrong
9CA1_A O95985 DNA topoisomerase 3-beta-1 EM 3.26 2024-06-16 90.25 0.91 0.08 ok
9C9Y_A O95985 DNA topoisomerase 3-beta-1 EM 3.35 2024-06-16 90.25 0.91 0.08 ok
8XOM_A O15439 ATP-binding cassette sub-family C member 4 EM 3.05 2024-01-01 83.06 0.90 0.08 ok
8TRV_A P29317 Ephrin type-A receptor 2 X-ray 3.25 2023-08-10 82.25 0.90 0.08 ok
8XOL_A O15439 ATP-binding cassette sub-family C member 4 EM 3.02 2024-01-01 83.06 0.91 0.08 ok
9CA0_B Q9H7E2 Tudor domain-containing protein 3 EM 3.48 2024-06-16 0.00 94.63 0.40 0.87 89.34 1.61 0.07 wrong
8K3Z_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.81 2023-07-17 89.56 0.92 0.07 ok
8K3Z_A P61073 C-X-C chemokine receptor type 4 EM 2.81 2023-07-17 82.25 0.92 0.07 ok
9CA1_B Q9H7E2 Tudor domain-containing protein 3 EM 3.26 2024-06-16 0.00 94.63 0.41 0.89 89.71 1.46 0.07 wrong
8UAN_A Q96SZ5 2-aminoethanethiol dioxygenase X-ray 1.99 2023-09-21 86.12 0.94 0.05 ok
8XSJ_A Q9BYF1 Angiotensin-converting enzyme 2 EM 2.61 2024-01-09 90.69 0.94 0.05 ok
8U9J_A Q96SZ5 2-aminoethanethiol dioxygenase X-ray 2.02 2023-09-19 86.12 0.94 0.05 ok
8XSF_A Q9BYF1 Angiotensin-converting enzyme 2 EM 2.16 2024-01-09 90.69 0.95 0.05 ok
9FMM_A Q9BYF1 Angiotensin-converting enzyme 2 X-ray 2.50 2024-06-06 90.69 0.95 0.04 ok
8Y88_I O15393 Transmembrane protease serine 2 EM 3.03 2024-02-06 79.38 0.95 0.04 ok
8Y87_T O15393 Transmembrane protease serine 2 EM 3.26 2024-02-06 79.38 0.95 0.04 ok
8Y89_G O15393 Transmembrane protease serine 2 EM 3.32 2024-02-06 79.38 0.95 0.04 ok
8Y8A_G O15393 Transmembrane protease serine 2 EM 3.19 2024-02-06 79.38 0.95 0.04 ok
8OST_A Q5TAX3 Terminal uridylyltransferase 4 EM 3.69 2023-04-20 62.88 0.94 0.04 ok
8Y7X_x O15393 Transmembrane protease serine 2 EM 3.09 2024-02-05 79.38 0.95 0.04 ok
8Y7Y_T O15393 Transmembrane protease serine 2 EM 3.24 2024-02-05 79.38 0.96 0.03 ok
8TGT_C P04003 C4b-binding protein alpha chain X-ray 2.50 2023-07-13 81.75 0.97 0.03 ok
8VYL_B P68871 Hemoglobin subunit beta X-ray 2.02 2024-02-08 97.19 0.97 0.02 ok
8XPU_A P08195 Isoform 5 of Amino acid transporter heavy EM 3.30 2024-01-04 78.69 0.97 0.02 ok
8J8L_A P08195 4F2 cell-surface antigen heavy chain EM 3.56 2023-05-02 78.69 0.97 0.02 ok
8V3O_A Q8NDL9 Cytosolic carboxypeptidase-like protein 5 X-ray 2.30 2023-11-28 69.81 0.97 0.02 ok
8V7Z_A P13569 Cystic fibrosis transmembrane conductance EM 3.40 2023-12-04 75.62 0.97 0.02 ok
8V81_A P13569 Cystic fibrosis transmembrane conductance EM 3.60 2023-12-04 75.62 0.97 0.02 ok
8V3P_A Q8NDL9 Cytosolic carboxypeptidase-like protein 5 X-ray 2.36 2023-11-28 69.81 0.97 0.02 ok
8V3M_A Q8NDL9 Cytosolic carboxypeptidase-like protein 5 X-ray 1.80 2023-11-28 69.81 0.97 0.02 ok
8TG9_A P16066 Atrial natriuretic peptide receptor 1 EM 3.08 2023-07-12 84.62 0.98 0.02 ok
8TGA_A P16066 Atrial natriuretic peptide receptor 1 EM 3.65 2023-07-12 84.62 0.98 0.02 ok
9CK0_A P37231 Peroxisome proliferator-activated receptor X-ray 2.60 2024-07-08 76.12 0.98 0.02 ok
8V3N_A Q8NDL9 Cytosolic carboxypeptidase-like protein 5 X-ray 2.30 2023-11-28 69.81 0.98 0.02 ok
8VYL_A P69905 Hemoglobin subunit alpha X-ray 2.02 2024-02-08 98.06 0.99 0.01 ok
8WLZ_D Q9BYF1 Processed angiotensin-converting enzyme 2 EM 4.45 2023-10-01 90.69 0.99 0.01 ok
9CKV_A P08648 Integrin alpha-5 EM 3.19 2024-07-09 85.25 0.99 0.01 ok
8WV5_A P02741 C-reactive protein(1-205) EM 3.50 2023-10-23 94.12 0.99 0.01 ok
8K2E_A Q96MU7 YTH domain-containing protein 1 X-ray 1.60 2023-07-12 60.34 0.99 0.01 ok
8K3A_A P00441 Superoxide dismutase [Cu-Zn] X-ray 2.74 2023-07-14 97.94 0.99 0.01 ok
8V4K_E Q8NDL9 Cytosolic carboxypeptidase-like protein 5 EM 3.10 2023-11-29 69.81 0.99 0.01 ok
8V3Q_A Q8NDL9 Cytosolic carboxypeptidase-like protein 5 EM 3.10 2023-11-28 69.81 0.99 0.01 ok
8V4M_E Q8NDL9 Cytosolic carboxypeptidase-like protein 5 EM 3.00 2023-11-29 69.81 0.99 0.01 ok
8Y6F_A P02794 Ferritin X-ray 2.01 2024-02-02 95.31 0.99 0.01 ok
8V3S_A Q8NDL9 Cytosolic carboxypeptidase-like protein 5 EM 3.60 2023-11-28 69.81 0.99 0.01 ok
8V4L_E Q8NDL9 Cytosolic carboxypeptidase-like protein 5 EM 2.90 2023-11-29 69.81 0.99 0.01 ok
8V3R_A Q8NDL9 Cytosolic carboxypeptidase-like protein 5 EM 3.40 2023-11-28 69.81 0.99 0.01 ok
8K3Z_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.81 2023-07-17 97.06 0.99 0.01 ok
8WV4_A P02741 C-reactive protein(1-205) EM 3.30 2023-10-23 94.12 0.99 0.01 ok
8K33_A P00441 Superoxide dismutase [Cu-Zn] X-ray 2.13 2023-07-14 97.94 0.99 0.01 ok
8K3L_A P00441 Superoxide dismutase [Cu-Zn] X-ray 2.30 2023-07-16 97.94 1.00 0.00 ok
7MU6_A Q99683 Mitogen-activated protein kinase kinase ki X-ray 2.17 2021-05-14 72.88 0.99 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.