Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2022-04-20

113
structures analysed (13 full · 11.5%)
32.7%
confidently wrong
87.1%
novel sequences
10.9%
novel & wrong
0.945
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 3 of 113 structures (2.7%) are confidently wrong; median TM-score is 0.945.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.945 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7WJI_B Q9P2D8 Protein unc-79 homolog EM 4.50 2022-01-06 100.00 novel 79.93 0.42 0.70 0.00 72.95 0.80 wrong
7VB2_A P30050 60S ribosomal protein L12 NMR 2021-08-30 0.00 70.93 0.35 0.58 0.15 24.47 0.67 wrong
7Q62_A A8K2U0 Alpha-2-macroglobulin-like protein 1 EM 3.18 2021-11-05 75.50 novel 83.90 0.68 0.81 4.15 14.54 0.65 ok
7Q61_A A8K2U0 Alpha-2-macroglobulin-like protein 1 EM 2.88 2021-11-05 75.50 novel 84.23 0.68 0.82 4.83 14.33 0.65 ok
7Q60_A A8K2U0 Alpha-2-macroglobulin-like protein 1 EM 3.13 2021-11-05 75.50 novel 84.19 0.68 0.80 5.61 14.21 0.63 ok
7WJI_A Q8N2C7 Protein unc-80 homolog EM 4.50 2022-01-06 100.00 novel 80.54 0.64 0.74 10.38 14.73 0.53 ok
7Q1F_P Q9HC77 Centromere protein J X-ray 2.35 2021-10-19 12.70 59.51 0.37 0.68 11.50 13.78 0.41 ok
7WJI_E P0DP23 Calmodulin-1 EM 4.50 2022-01-06 0.00 87.20 0.45 0.68 25.99 7.05 0.37 wrong
7TRC_F Q9NPE3 H/ACA ribonucleoprotein complex subunit 3 EM 3.30 2022-01-28 94.50 0.72 0.27 ok
7QQN_B Q8NET8 Transient receptor potential cation channe X-ray 2.45 2022-01-10 76.50 0.76 0.19 ok
7WQ4_L P22466 Galanin EM 2.60 2022-01-24 100.00 novel 68.59 0.46 0.69 42.31 4.20 0.18 ok
7M0G_A Q9Y281 Cofilin-2 NMR 2021-03-10 88.44 0.80 0.18 ok
7WQ3_A P63096 Guanine nucleotide-binding protein G(i) su EM 2.70 2022-01-24 93.75 0.82 0.17 ok
7WQ3_L P22466 Galanin EM 2.70 2022-01-24 100.00 novel 66.98 0.43 0.62 43.75 4.14 0.17 ok
7SCG_A P63096 Guanine nucleotide-binding protein G(i) su EM 3.00 2021-09-28 93.75 0.82 0.17 ok
7SBF_A P63096 Guanine nucleotide-binding protein G(i) su EM 2.90 2021-09-24 93.75 0.82 0.16 ok
7AMG_A Q16552 Interleukin-17A X-ray 3.18 2020-10-08 84.31 0.81 0.16 ok
7TRF_F P62807 Histone H2B type 1-C/E/F/G/I EM 3.70 2022-01-28 88.12 0.82 0.16 ok
7V1M_C P62805 Histone H4 X-ray 2.83 2021-08-04 89.81 0.83 0.16 ok
7WJI_D B1AL88 Transmembrane protein FAM155A EM 4.50 2022-01-06 61.22 0.78 0.14 ok
7VPW_A Q92973 Transportin-1 X-ray 3.76 2021-10-18 92.44 0.86 0.13 ok
7O7L_A P01023 Alpha-2-macroglobulin EM 4.50 2021-04-13 81.50 0.85 0.12 ok
7WQ4_A P63092 Engineered Guanine nucleotide-binding prot EM 2.60 2022-01-24 91.31 0.86 0.12 ok
7QCS_A Q8N3R9 Protein PALS1 X-ray 2.80 2021-11-25 77.19 0.84 0.12 ok
7N3T_A P04629 High affinity nerve growth factor receptor X-ray 1.84 2021-06-01 78.25 0.85 0.12 ok
7AMA_A Q16552 Interleukin-17A X-ray 2.48 2020-10-08 84.31 0.86 0.12 ok
7V1L_B P49321 Isoform 2 of Nuclear autoantigenic sperm p X-ray 2.85 2021-08-04 57.28 0.81 0.11 ok
7X2U_A P48764 Sodium/hydrogen exchanger 3 EM 3.20 2022-02-26 65.94 0.83 0.11 ok
7V1K_A P49321 Isoform 2 of Nuclear autoantigenic sperm p X-ray 3.29 2021-08-04 57.28 0.81 0.11 ok
7W57_C Q5H8A3 Neuromedin-S EM 3.20 2021-11-29 100.00 novel 59.88 0.34 0.73 54.55 2.83 0.10 ok
7SCG_C P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.00 2021-09-28 89.56 0.89 0.10 ok
7XD1_D O60814 Histone H2B type 1-K EM 3.20 2022-03-26 87.81 0.88 0.10 ok
7XCR_D O60814 Histone H2B type 1-K EM 2.57 2022-03-25 87.81 0.89 0.10 ok
7TRF_E Q9BTM1 Histone H2A EM 3.70 2022-01-28 91.19 0.89 0.10 ok
7QCR_A P55196 Afadin X-ray 2.28 2021-11-25 63.22 0.85 0.10 ok
7XCT_D O60814 Histone H2B type 1-K EM 2.72 2022-03-25 87.81 0.90 0.09 ok
7XCT_L P0CG47 Ubiquitin EM 2.72 2022-03-25 93.44 0.91 0.09 ok
7V1M_A P84243 Histone H3.3 X-ray 2.83 2021-08-04 85.94 0.91 0.08 ok
7TRE_C Q96AP0 Adrenocortical dysplasia protein homolog EM 3.50 2022-01-28 62.34 0.89 0.07 ok
7QQL_D Q15418 Ribosomal protein S6 kinase alpha-1 X-ray 2.44 2022-01-10 76.69 0.91 0.07 ok
7WQ4_R O43603 Galanin receptor type 2 EM 2.60 2022-01-24 77.94 0.92 0.07 ok
7WQ3_R P47211 Galanin receptor type 1 EM 2.70 2022-01-24 83.81 0.92 0.06 ok
7Q5Z_A A8K2U0 Alpha-2-macroglobulin-like protein 1 EM 3.25 2021-11-05 80.50 0.92 0.06 ok
7WJI_C Q8IZF0 Sodium leak channel non-selective protein, EM 4.50 2022-01-06 76.69 0.92 0.06 ok
7XD0_C P04908 Histone H2A EM 3.48 2022-03-26 90.75 0.93 0.06 ok
7XCT_C P04908 Histone H2A EM 2.72 2022-03-25 90.75 0.94 0.06 ok
7XCR_L P0CG47 Ubiquitin EM 2.57 2022-03-25 93.44 0.94 0.06 ok
7XD1_C P04908 Histone H2A type 1-B/E EM 3.20 2022-03-26 90.75 0.94 0.06 ok
7TRC_D Q9NY12 H/ACA ribonucleoprotein complex subunit 1 EM 3.30 2022-01-28 63.19 0.91 0.06 ok
7XCR_C P04908 Histone H2A EM 2.57 2022-03-25 90.75 0.94 0.06 ok
7X2U_C Q99653 Calcineurin B homologous protein 1 EM 3.20 2022-02-26 89.19 0.94 0.05 ok
7TRF_A O14746 Telomerase reverse transcriptase EM 3.70 2022-01-28 80.19 0.94 0.05 ok
7TRD_A O14746 Telomerase reverse transcriptase EM 3.30 2022-01-28 80.19 0.94 0.05 ok
7O70_A P01116 GTPase KRas X-ray 1.18 2021-04-12 91.50 0.94 0.05 ok
7TRE_A O14746 Telomerase reverse transcriptase EM 3.50 2022-01-28 80.19 0.94 0.05 ok
7SBF_C P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.90 2021-09-24 89.56 0.95 0.05 ok
7PC7_E P60484 Phosphatidylinositol 3,4,5-trisphosphate 3 X-ray 2.10 2021-08-03 38.12 0.48 0.83 67.50 1.99 0.05 ok
7OO7_A P01116 GTPase KRas X-ray 1.48 2021-05-26 91.50 0.95 0.05 ok
7Q1Y_A A8K2U0 Alpha-2-macroglobulin-like protein 1 X-ray 4.40 2021-10-22 80.50 0.95 0.04 ok
7W57_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2021-11-29 89.56 0.96 0.04 ok
7V1L_V P84243 H3 alpha3 helix peptide X-ray 2.85 2021-08-04 0.00 95.27 0.58 0.92 94.64 0.78 0.04 ok
7TRC_C O60832 H/ACA ribonucleoprotein complex subunit DK EM 3.30 2022-01-28 79.44 0.95 0.04 ok
7W02_A Q99758 Phospholipid-transporting ATPase ABCA3 EM 3.30 2021-11-17 80.81 0.95 0.04 ok
7W55_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.80 2021-11-29 89.56 0.96 0.04 ok
7W53_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2021-11-29 89.56 0.96 0.04 ok
7SD0_A Q9UQ13 Leucine-rich repeat protein SHOC-2 EM 2.95 2021-09-29 87.50 0.96 0.03 ok
7MHD_A P49327 Fatty acid synthase X-ray 2.03 2021-04-15 85.44 0.96 0.03 ok
7TRC_E Q9NX24 H/ACA ribonucleoprotein complex subunit 2 EM 3.30 2022-01-28 80.06 0.96 0.03 ok
7QCT_A Q8N448 Ligand of Numb protein X 2 X-ray 3.20 2021-11-25 74.62 0.96 0.03 ok
7P0V_A Q15459 Isoform 2 of Splicing factor 3A subunit 1 X-ray 1.56 2021-06-30 66.94 0.96 0.03 ok
7XD0_B P62805 Histone H4 EM 3.48 2022-03-26 89.81 0.97 0.03 ok
7ZG4_A Q9Y5A9 YTH domain-containing family protein 2 X-ray 2.01 2022-04-01 59.50 0.95 0.03 ok
7WVM_E Q15116 Programmed cell death protein 1 X-ray 3.40 2022-02-10 74.12 0.96 0.03 ok
7W56_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.90 2021-11-29 89.56 0.97 0.03 ok
7ER2_A P00533 Epidermal growth factor receptor X-ray 2.66 2021-05-05 75.94 0.97 0.03 ok
7XCT_A Q71DI3 Histone domain-containing protein EM 2.72 2022-03-25 86.00 0.97 0.02 ok
7MHE_AAA P49327 Fatty acid synthase X-ray 2.80 2021-04-15 85.44 0.97 0.02 ok
7SD0_B O14807 Ras-related protein M-Ras EM 2.95 2021-09-29 86.38 0.97 0.02 ok
7XCT_B P62805 Histone H4 EM 2.72 2022-03-25 89.81 0.97 0.02 ok
7AL7_A O95998 Interleukin-18-binding protein X-ray 1.80 2020-10-05 79.06 0.97 0.02 ok
7XCR_B P62805 Histone H4 EM 2.57 2022-03-25 89.81 0.98 0.02 ok
7PZD_G Q96P20 NACHT, LRR and PYD domains-containing prot EM 3.60 2021-10-12 81.06 0.97 0.02 ok
7XCT_K Q8TEK3 Histone-lysine N-methyltransferase, H3 lys EM 2.72 2022-03-25 52.50 0.97 0.02 ok
7TRC_K Q9BUR4 Telomerase Cajal body protein 1 EM 3.30 2022-01-28 73.00 0.98 0.02 ok
7XD0_A Q71DI3 Histone domain-containing protein EM 3.48 2022-03-26 86.00 0.98 0.02 ok
7XCR_K Q8TEK3 Histone-lysine N-methyltransferase, H3 lys EM 2.57 2022-03-25 52.50 0.97 0.02 ok
7N2M_A P09884 DNA polymerase alpha catalytic subunit X-ray 2.90 2021-05-29 75.81 0.98 0.02 ok
7V1M_G P49321 Isoform 2 of Nuclear autoantigenic sperm p X-ray 2.83 2021-08-04 57.28 0.97 0.02 ok
7XD1_A P68431 Histone H3 EM 3.20 2022-03-26 86.06 0.98 0.02 ok
7Q3F_A O60885 Bromodomain-containing protein 4 X-ray 1.21 2021-10-27 55.31 0.97 0.02 ok
7XD1_B P62805 Histone H4 EM 3.20 2022-03-26 89.81 0.98 0.01 ok
7V1M_D Q9NVP2 Histone chaperone ASF1B X-ray 2.83 2021-08-04 84.56 0.98 0.01 ok
7W56_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.90 2021-11-29 97.06 0.99 0.01 ok
7OV0_A P11172 Uridine 5'-monophosphate synthase X-ray 0.95 2021-06-14 92.12 0.99 0.01 ok
7SD0_C P36873 Serine/threonine-protein phosphatase PP1-g EM 2.95 2021-09-29 92.69 0.99 0.01 ok
7QXY_A P09958 Furin X-ray 1.48 2022-01-27 84.75 0.99 0.01 ok
7QY0_A P09958 Furin X-ray 1.54 2022-01-27 84.75 0.99 0.01 ok
7QY1_A P09958 Furin X-ray 1.45 2022-01-27 84.75 0.99 0.01 ok
7QY2_A P09958 Furin X-ray 1.55 2022-01-27 84.75 0.99 0.01 ok
7ALE_A P22234 Multifunctional protein ADE2 X-ray 2.95 2020-10-06 95.81 0.99 0.01 ok
7SCG_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.00 2021-09-28 97.06 0.99 0.01 ok
7QK9_A P47895 Aldehyde dehydrogenase family 1 member A3 X-ray 1.78 2021-12-17 95.62 0.99 0.01 ok
7QK7_A P47895 Aldehyde dehydrogenase family 1 member A3 X-ray 2.29 2021-12-17 95.62 0.99 0.01 ok
7Q5O_A P25440 Bromodomain-containing protein 2 X-ray 1.52 2021-11-04 64.06 0.99 0.01 ok
7QK8_A P47895 Aldehyde dehydrogenase family 1 member A3 X-ray 1.89 2021-12-17 95.62 0.99 0.01 ok
7PWY_A Q8TDX5 2-amino-3-carboxymuconate-6-semialdehyde d X-ray 2.50 2021-10-07 97.69 0.99 0.01 ok
7W55_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.80 2021-11-29 97.06 0.99 0.01 ok
7W57_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2021-11-29 97.06 0.99 0.01 ok
7W53_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2021-11-29 97.06 1.00 0.00 ok
7OUZ_A P11172 Uridine 5'-monophosphate synthase X-ray 0.90 2021-06-14 92.12 0.99 0.00 ok
7SBF_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.90 2021-09-24 97.06 1.00 0.00 ok
7SD1_A Q9UQ13 Leucine-rich repeat protein SHOC-2 X-ray 3.19 2021-09-29 87.50 1.00 0.00 ok
7OTU_A P11172 Isoform 2 of Uridine 5'-monophosphate synt X-ray 0.95 2021-06-10 92.12 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.