Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2021-08-25

121
structures analysed (4 full · 3.3%)
10.8%
confidently wrong
00.0%
novel sequences
00.0%
novel & wrong
0.963
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 1 of 121 structures (0.8%) are confidently wrong; median TM-score is 0.963.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.963 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7NXD_A P08648 Integrin alpha-5 EM 4.60 2021-03-18 0.00 90.01 0.67 0.83 7.43 18.68 0.72 ok
7L7S_H P10809 60 kDa heat shock protein, mitochondrial EM 3.50 2020-12-30 0.20 92.01 0.66 0.84 19.13 12.71 0.52 ok
7A1S_B Q9H2K2 TANKYRASE-2 X-ray 2.01 2020-08-13 5.00 97.44 0.43 0.77 23.53 6.64 0.41 wrong
7NXD_B P05556 Integrin beta-1 EM 4.60 2021-03-18 85.88 0.71 0.25 ok
7NT7_A Q15399 Toll-like receptor 1 NMR 2021-03-09 87.19 0.72 0.24 ok
7L7I_C Q13451 Peptidyl-prolyl cis-trans isomerase FKBP5 EM 3.30 2020-12-28 92.50 0.79 0.20 ok
7CSQ_B Q15628 Tumor necrosis factor receptor type 1-asso NMR 2020-08-16 83.25 0.78 0.19 ok
7MDO_A P55072 Transitional endoplasmic reticulum ATPase EM 4.12 2021-04-05 82.56 0.79 0.18 ok
7MDM_A P55072 Transitional endoplasmic reticulum ATPase EM 4.86 2021-04-05 82.56 0.80 0.17 ok
7EZH_A P63096 Guanine nucleotide-binding protein G(i) su EM 3.20 2021-06-01 93.75 0.82 0.17 ok
7N5T_A O95365 Zinc finger and BTB domain-containing prot X-ray 2.90 2021-06-06 55.78 0.71 0.16 ok
7N5S_A O95365 Zinc finger and BTB domain-containing prot X-ray 2.86 2021-06-06 55.78 0.72 0.16 ok
7NIU_A P21439 Isoform 2 of Phosphatidylcholine transloca EM 4.20 2021-02-14 83.25 0.82 0.15 ok
7CSQ_A P08138 Tumor necrosis factor receptor superfamily NMR 2020-08-16 75.88 0.81 0.14 ok
7NIV_A P21439 Isoform 2 of Phosphatidylcholine transloca EM 3.60 2021-02-14 83.25 0.86 0.12 ok
7EZM_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.90 2021-06-01 89.56 0.88 0.11 ok
7NFB_C Q15596 Nuclear receptor coactivator 2 X-ray 1.33 2021-02-05 47.59 0.78 0.11 ok
7NIW_A P21439 Phosphatidylcholine translocator ABCB4 EM 3.80 2021-02-14 83.25 0.88 0.10 ok
7NUX_A Q15399 Toll-like receptor 1 X-ray 2.47 2021-03-15 87.19 0.89 0.10 ok
7NUW_A Q15399 Toll-like receptor 1 X-ray 1.90 2021-03-15 87.19 0.90 0.09 ok
7EKL_A Q9NP58 ATP-binding cassette sub-family B member 6 EM 3.50 2021-04-05 83.06 0.89 0.09 ok
7EZK_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.10 2021-06-01 89.56 0.90 0.09 ok
7EKM_A Q9NP58 ATP-binding cassette sub-family B member 6 EM 3.60 2021-04-05 83.06 0.90 0.09 ok
7LGW_A P58743 Prestin EM 2.70 2021-01-21 83.69 0.90 0.08 ok
7LGU_A P58743 Prestin EM 2.30 2021-01-21 83.69 0.90 0.08 ok
7A1O_A Q9NWT6 Hypoxia-inducible factor 1-alpha inhibitor X-ray 2.21 2020-08-13 91.38 0.92 0.07 ok
7NEL_C Q15596 Nuclear receptor coactivator 2 X-ray 1.45 2021-02-04 63.92 0.61 0.76 72.92 2.15 0.07 ok
7EZH_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2021-06-01 89.56 0.92 0.07 ok
7A2N_A P06241 Tyrosine-protein kinase Fyn X-ray 1.40 2020-08-18 80.81 0.92 0.07 ok
7A2V_A P06241 Tyrosine-protein kinase Fyn X-ray 1.81 2020-08-18 80.81 0.92 0.07 ok
7EZM_D P32238 Cholecystokinin receptor type A EM 2.90 2021-06-01 77.69 0.92 0.06 ok
7A2U_A P06241 Tyrosine-protein kinase Fyn X-ray 1.70 2020-08-18 80.81 0.93 0.06 ok
7CRG_A P02545 Prelamin-A/C X-ray 1.80 2020-08-13 76.38 0.92 0.06 ok
7LH2_A P58743 Prestin EM 3.43 2021-01-21 83.69 0.93 0.06 ok
7LH3_A P58743 Prestin EM 4.30 2021-01-21 83.69 0.93 0.06 ok
7EZK_D P32238 Cholecystokinin receptor type A EM 3.10 2021-06-01 77.69 0.93 0.05 ok
7A2X_A P06241 Tyrosine-protein kinase Fyn X-ray 0.92 2020-08-18 80.81 0.93 0.05 ok
7EZH_D P32238 Cholecystokinin receptor type A EM 3.20 2021-06-01 77.69 0.93 0.05 ok
7NDO_A P03372 Estrogen receptor X-ray 1.60 2021-02-02 66.44 0.92 0.05 ok
7A2W_A P06241 Tyrosine-protein kinase Fyn X-ray 0.99 2020-08-18 80.81 0.94 0.05 ok
7A1Q_A Q9NWT6 Hypoxia-inducible factor 1-alpha inhibitor X-ray 1.75 2020-08-13 91.38 0.95 0.05 ok
7A1P_A Q9NWT6 Hypoxia-inducible factor 1-alpha inhibitor X-ray 1.76 2020-08-13 91.38 0.95 0.05 ok
7A2Z_A P06241 Tyrosine-protein kinase Fyn X-ray 1.14 2020-08-18 80.81 0.94 0.05 ok
7A2Y_A P06241 Tyrosine-protein kinase Fyn X-ray 0.97 2020-08-18 80.81 0.94 0.05 ok
7MYH_B P0CG47 Ubiquitin variant UbV.k.2 X-ray 2.39 2021-05-21 93.44 0.95 0.05 ok
7A2S_A P06241 Tyrosine-protein kinase Fyn X-ray 1.02 2020-08-18 80.81 0.94 0.05 ok
7A2R_A P06241 Tyrosine-protein kinase Fyn X-ray 1.05 2020-08-18 80.81 0.94 0.05 ok
7CT1_A Q96L92 Fusion protein Sorting nexin-27 and DLF mo X-ray 1.95 2020-08-17 83.62 0.95 0.04 ok
7A1S_A Q9NWT6 Hypoxia-inducible factor 1-alpha inhibitor X-ray 2.01 2020-08-13 91.38 0.95 0.04 ok
7A2M_A P06241 Tyrosine-protein kinase Fyn X-ray 1.50 2020-08-18 80.81 0.95 0.04 ok
7A1J_A Q9NWT6 Hypoxia-inducible factor 1-alpha inhibitor X-ray 1.90 2020-08-13 91.38 0.95 0.04 ok
7A1L_A Q9NWT6 Hypoxia-inducible factor 1-alpha inhibitor X-ray 2.29 2020-08-13 91.38 0.95 0.04 ok
7A1M_A Q9NWT6 Hypoxia-inducible factor 1-alpha inhibitor X-ray 2.18 2020-08-13 91.38 0.96 0.04 ok
7A2J_A P06241 Tyrosine-protein kinase Fyn X-ray 1.50 2020-08-18 80.81 0.95 0.04 ok
7A1K_A Q9NWT6 Hypoxia-inducible factor 1-alpha inhibitor X-ray 1.99 2020-08-13 91.38 0.96 0.04 ok
7A2L_A P06241 Tyrosine-protein kinase Fyn X-ray 1.90 2020-08-18 80.81 0.95 0.04 ok
7A2K_A P06241 Tyrosine-protein kinase Fyn X-ray 1.50 2020-08-18 80.81 0.95 0.04 ok
7A2T_A P06241 Tyrosine-protein kinase Fyn X-ray 1.22 2020-08-18 80.81 0.96 0.03 ok
7MYF_B P0CG47 Ubiquitin variant UbV.k.1 X-ray 3.00 2021-05-21 93.44 0.97 0.03 ok
6XZ1_C P0CG47 Polyubiquitin-B X-ray 2.30 2020-01-31 93.44 0.97 0.03 ok
7A2O_A P06241 Tyrosine-protein kinase Fyn X-ray 0.94 2020-08-18 80.81 0.96 0.03 ok
7MYF_C P0CG48 Ubiquitin X-ray 3.00 2021-05-21 88.62 0.97 0.03 ok
7A1N_A Q9NWT6 Hypoxia-inducible factor 1-alpha inhibitor X-ray 2.01 2020-08-13 91.38 0.97 0.03 ok
7JSP_A P21675 Transcription initiation factor TFIID subu X-ray 1.70 2020-08-15 61.84 0.96 0.03 ok
7A2Q_A P06241 Tyrosine-protein kinase Fyn X-ray 0.94 2020-08-18 80.81 0.97 0.03 ok
7RTK_B Q9HD34 LYR motif-containing protein 4 X-ray 2.50 2021-08-13 93.12 0.97 0.03 ok
7A1V_A Q9Y5A9 YTH domain-containing family protein 2 X-ray 2.20 2020-08-14 59.50 0.96 0.03 ok
7EU2_A A0A5H2UU57 MHC class I antigen X-ray 2.80 2021-05-15 85.50 0.97 0.03 ok
7A2P_A P06241 Tyrosine-protein kinase Fyn X-ray 0.90 2020-08-18 80.81 0.97 0.02 ok
7L7I_E Q15185 Prostaglandin E synthase 3 EM 3.30 2020-12-28 85.44 0.97 0.02 ok
7FDG_A Q9BYF1 Angiotensin-converting enzyme 2 EM 3.69 2021-07-16 90.69 0.97 0.02 ok
7JTC_A P21675 Transcription initiation factor TFIID subu X-ray 2.05 2020-08-17 61.84 0.96 0.02 ok
7MYF_A P61086 Ubiquitin-conjugating enzyme E2 K X-ray 3.00 2021-05-21 96.69 0.98 0.02 ok
7EU2_B P61769 Beta-2-microglobulin X-ray 2.80 2021-05-15 94.06 0.98 0.02 ok
7F4W_A D9UAY1 MHC class I antigen X-ray 2.90 2021-06-21 89.50 0.98 0.02 ok
6VTO_A P47929 Galectin-7 X-ray 1.69 2020-02-13 96.62 0.98 0.02 ok
7L7J_C Q15185 Prostaglandin E synthase 3 EM 3.10 2020-12-28 85.44 0.98 0.02 ok
7FDH_A Q9BYF1 Angiotensin-converting enzyme 2 EM 3.72 2021-07-16 90.69 0.98 0.02 ok
7F4W_B P61769 Beta-2-microglobulin X-ray 2.90 2021-06-21 94.06 0.98 0.02 ok
7FDI_A Q9BYF1 Angiotensin-converting enzyme 2 EM 3.12 2021-07-16 90.69 0.98 0.02 ok
7CUX_A Q08AF3 Schlafen family member 5 X-ray 3.29 2020-08-25 87.56 0.98 0.02 ok
6VTS_A P47929 Galectin-7 X-ray 1.90 2020-02-13 96.62 0.98 0.02 ok
7AP7_A P61626 Lysozyme C X-ray 1.15 2020-10-16 94.06 0.98 0.02 ok
7NFB_A P03372 Estrogen receptor X-ray 1.33 2021-02-05 66.44 0.98 0.02 ok
6VTP_A P47929 Galectin-7 X-ray 2.30 2020-02-13 96.62 0.99 0.01 ok
7L97_A Q96FJ0 AMSH-like protease X-ray 2.01 2021-01-02 83.12 0.98 0.01 ok
7L7I_A P07900 Heat shock protein HSP 90-alpha EM 3.30 2020-12-28 85.19 0.98 0.01 ok
7JKY_A O60885 Bromodomain-containing protein 4 X-ray 1.16 2020-07-29 55.31 0.97 0.01 ok
6VTQ_A P47929 Galectin-7 X-ray 1.95 2020-02-13 96.62 0.99 0.01 ok
7L7J_A P07900 Heat shock protein HSP 90-alpha EM 3.10 2020-12-28 85.19 0.98 0.01 ok
7JKW_A O60885 Bromodomain-containing protein 4 X-ray 1.20 2020-07-29 55.31 0.98 0.01 ok
7NEL_A P03372 Estrogen receptor X-ray 1.45 2021-02-04 66.44 0.98 0.01 ok
7D8B_A P06730 Eukaryotic translation initiation factor 4 X-ray 2.46 2020-10-07 90.94 0.99 0.01 ok
7BJY_A Q58F21 Isoform 2 of Bromodomain testis-specific p X-ray 2.22 2021-01-14 62.44 0.98 0.01 ok
7RTK_D Q9H1K1 Iron-sulfur cluster assembly enzyme ISCU, X-ray 2.50 2021-08-13 85.19 0.99 0.01 ok
7N2A_A O75469 Isoform 1C of Nuclear receptor subfamily 1 X-ray 2.26 2021-05-28 85.50 0.99 0.01 ok
7A6Y_A P61981 14-3-3 protein gamma X-ray 2.50 2020-08-27 94.19 0.99 0.01 ok
7RIU_A O75469 Isoform 1C of Nuclear receptor subfamily 1 X-ray 2.05 2021-07-20 85.50 0.99 0.01 ok
7RIV_A O75469 Isoform 1C of Nuclear receptor subfamily 1 X-ray 2.20 2021-07-20 85.50 0.99 0.01 ok
7EZK_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.10 2021-06-01 97.06 0.99 0.01 ok
7MYH_A P61086 Ubiquitin-conjugating enzyme E2 K X-ray 2.39 2021-05-21 96.69 0.99 0.01 ok
7EZM_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.90 2021-06-01 97.06 0.99 0.01 ok
7DRV_A Q9BYF1 Angiotensin-converting enzyme 2 X-ray 3.09 2020-12-29 90.69 0.99 0.01 ok
7EZH_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2021-06-01 97.06 0.99 0.01 ok
7A6R_A P61981 14-3-3 protein gamma X-ray 2.70 2020-08-26 94.19 0.99 0.01 ok
7RIO_A O75469 Isoform 1C of Nuclear receptor subfamily 1 X-ray 2.48 2021-07-20 85.50 0.99 0.01 ok
6VTR_A P47929 Galectin-7 X-ray 2.30 2020-02-13 96.62 0.99 0.01 ok
7MU3_A P00918 Carbonic anhydrase 2 X-ray 1.35 2021-05-14 97.38 0.99 0.01 ok
7RG5_A O00629 Importin subunit alpha-3 X-ray 2.15 2021-07-14 86.06 0.99 0.01 ok
7LS4_A Q9Y6A2 Cholesterol 24-hydroxylase X-ray 2.05 2021-02-17 94.75 0.99 0.01 ok
7LRL_A Q9Y6A2 Cholesterol 24-hydroxylase X-ray 2.00 2021-02-16 94.75 0.99 0.01 ok
7LS3_A Q9Y6A2 Cholesterol 24-hydroxylase X-ray 2.15 2021-02-17 94.75 0.99 0.01 ok
7JKZ_A O60885 Bromodomain-containing protein 4 X-ray 2.49 2020-07-29 55.31 0.99 0.01 ok
7LOM_A P04181 Ornithine aminotransferase, mitochondrial X-ray 2.10 2021-02-10 94.06 0.99 0.01 ok
7LON_A P04181 Ornithine aminotransferase, mitochondrial X-ray 1.95 2021-02-10 94.06 1.00 0.00 ok
7RTK_A Q9Y697 Cysteine desulfurase, mitochondrial X-ray 2.50 2021-08-13 88.75 1.00 0.00 ok
7LNM_B P04181 Ornithine aminotransferase, mitochondrial X-ray 2.00 2021-02-07 94.06 1.00 0.00 ok
7D9P_A P22303 Acetylcholinesterase X-ray 2.85 2020-10-14 92.94 1.00 0.00 ok
7D9O_A P22303 Acetylcholinesterase X-ray 2.45 2020-10-14 92.94 1.00 0.00 ok
7D9Q_A P22303 Acetylcholinesterase X-ray 2.66 2020-10-14 92.94 1.00 0.00 ok
7P8W_A P04040 Catalase EM 2.20 2021-07-23 95.81 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.