Live Stats, next update: Wed 09 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2023-01-18

115
structures analysed (23 full · 20.0%)
65.2%
confidently wrong
87.0%
novel sequences
21.7%
novel & wrong
0.954
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 6 of 115 structures (5.2%) are confidently wrong; median TM-score is 0.954.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.954 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7ZCH_A Q9Y3E7 Charged multivesicular body protein 3 EM 3.60 2022-03-28 0.00 89.90 0.53 0.79 0.16 35.49 0.88 ok
7ZCG_A Q9Y3E7 Charged multivesicular body protein 3 EM 3.30 2022-03-28 0.00 89.90 0.53 0.79 0.16 35.80 0.88 ok
8DWU_A O43791 Speckle-type POZ protein EM 3.40 2022-08-02 0.70 92.22 0.57 0.85 2.99 21.70 0.83 ok
8EB0_A Q9NWF9 E3 ubiquitin-protein ligase RNF216 X-ray 3.03 2022-08-30 75.80 novel 85.77 0.47 0.81 0.29 24.01 0.81 wrong
7WMM_A P37840 Alpha-synuclein EM 2.60 2022-01-15 0.00 84.74 0.30 0.30 0.82 21.96 0.80 wrong
7XJX_A P37840 Alpha-synuclein EM 2.70 2022-04-18 0.00 83.53 0.30 0.34 0.79 21.56 0.79 wrong
7ZCG_B O43633 Charged multivesicular body protein 2a EM 3.30 2022-03-28 100.00 novel 84.02 0.65 0.91 0.17 26.34 0.77 ok
7ZCH_B O43633 Charged multivesicular body protein 2a EM 3.60 2022-03-28 100.00 novel 84.02 0.65 0.90 0.00 26.14 0.77 ok
8DWT_A O43791 Speckle-type POZ protein EM 6.20 2022-08-02 0.70 93.16 0.55 0.83 12.14 15.61 0.63 ok
7TWD_A Q6PD74 Alpha- and gamma-adaptin-binding protein p X-ray 2.11 2022-02-07 100.00 novel 83.81 0.47 0.90 6.82 14.20 0.60 wrong
8BVL_A Q9BYM8 RanBP-type and C3HC4-type zinc finger-cont X-ray 2.24 2022-12-04 100.00 novel 86.48 0.58 0.75 15.69 9.81 0.49 ok
8DWV_A O43791 Speckle-type POZ protein EM 3.60 2022-08-02 0.70 92.50 0.66 0.83 32.08 8.60 0.40 ok
8DWS_A O43791 Speckle-type POZ protein EM 3.73 2022-08-02 1.00 92.50 0.66 0.83 31.66 8.56 0.39 ok
7YKW_A P10997 Islet amyloid polypeptide EM 3.60 2022-07-25 0.00 73.43 0.27 0.49 18.52 9.35 0.39 wrong
8BFZ_A P05067 Amyloid-beta precursor protein EM 2.80 2022-10-27 2.40 54.66 0.29 0.42 17.74 10.18 0.33 ok
8BG0_A P05067 Amyloid-beta precursor protein EM 1.99 2022-10-27 2.50 52.44 0.21 0.45 20.69 9.94 0.30 ok
8GNJ_A Q6SZW1 NAD(+) hydrolase SARM1 EM 3.78 2022-08-24 85.69 0.70 0.26 ok
8GNI_A Q6SZW1 NAD(+) hydrolase SARM1 EM 3.74 2022-08-24 85.69 0.70 0.25 ok
7UCX_B Q14114 Cyclized CR1 peptide X-ray 1.72 2022-03-17 82.22 0.35 0.49 33.93 5.02 0.25 wrong
8GQ5_A Q6SZW1 NAD(+) hydrolase SARM1 EM 2.70 2022-08-29 85.69 0.71 0.25 ok
7TB9_A Q6PRD7 CEMP1-p1 NMR 2021-12-21 100.00 novel 35.53 0.23 0.28 12.50 11.58 0.22 ok
8AEU_A Q00987 E3 ubiquitin-protein ligase Mdm2 X-ray 2.00 2022-07-13 62.59 0.70 0.19 ok
7Z88_B P12956 X-ray repair cross-complementing protein 6 EM 3.33 2022-03-16 84.44 0.78 0.18 ok
7Z88_C P13010 X-ray repair cross-complementing protein 5 EM 3.33 2022-03-16 83.12 0.78 0.18 ok
7Z87_B P12956 X-ray repair cross-complementing protein 6 EM 2.91 2022-03-16 84.44 0.78 0.18 ok
7Z87_C P13010 X-ray repair cross-complementing protein 5 EM 2.91 2022-03-16 83.12 0.78 0.18 ok
8BOO_A P04279 Semenogelin-1 NMR 2022-11-15 100.00 novel 28.89 0.11 0.27 15.22 9.48 0.16 ok
8BRC_A P02787 Serotransferrin X-ray 3.17 2022-11-22 93.12 0.83 0.16 ok
7XHF_C Q14694 USP10/6-21 X-ray 2.68 2022-04-08 41.79 0.25 0.53 25.00 6.25 0.16 ok
7QOT_C P01042 Kininogen-1 light chain X-ray 3.24 2021-12-28 100.00 novel 38.17 0.24 0.81 29.00 6.93 0.15 ok
8EAZ_A Q9BYM8 RanBP-type and C3HC4-type zinc finger-cont X-ray 3.08 2022-08-30 84.00 0.83 0.14 ok
7WLF_A P02768 Serum albumin X-ray 2.40 2022-01-13 92.69 0.85 0.14 ok
8HDO_A P63092 Chimeric miniGs EM 2.87 2022-11-05 91.31 0.86 0.13 ok
8HDP_A P63092 Chimeric miniGs EM 3.20 2022-11-05 91.31 0.87 0.12 ok
8EB0_C P0CG48 Ubiquitin X-ray 3.03 2022-08-30 88.62 0.88 0.11 ok
8HDP_R P29275 Adenosine A2b receptor EM 3.20 2022-11-05 88.12 0.88 0.10 ok
8F8Z_A O75151 Lysine-specific demethylase PHF2 X-ray 3.30 2022-11-22 61.41 0.83 0.10 ok
8F8Y_A O75151 Lysine-specific demethylase PHF2 X-ray 3.06 2022-11-22 61.41 0.83 0.10 ok
8BVZ_A P04279 Alpha-inhibin-31 NMR 2022-12-06 28.89 0.14 0.47 36.84 5.08 0.09 ok
8HDO_R P29275 Adenosine A2b receptor EM 2.87 2022-11-05 88.12 0.90 0.09 ok
8E3Q_C O95639 Cleavage and polyadenylation specificity f EM 2.68 2022-08-17 75.94 0.90 0.08 ok
7UDQ_A Q8NI60 Atypical kinase COQ8A, mitochondrial X-ray 1.90 2022-03-20 69.62 0.91 0.06 ok
8HDP_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2022-11-05 89.56 0.93 0.06 ok
8HDO_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.87 2022-11-05 89.56 0.94 0.06 ok
7XHG_A Q13283 Ras GTPase-activating protein-binding prot X-ray 2.46 2022-04-08 66.81 0.92 0.05 ok
8EAZ_E P0CG48 Ubiquitin X-ray 3.08 2022-08-30 88.62 0.95 0.05 ok
8E3I_C O95639 Cleavage and polyadenylation specificity f EM 2.53 2022-08-17 75.94 0.94 0.05 ok
8H78_A P08253 Matrix metalloproteinase-2 X-ray 2.40 2022-10-19 89.75 0.95 0.04 ok
7X8F_A Q03111 Protein ENL X-ray 2.44 2022-03-12 64.69 0.94 0.04 ok
7X8Q_A Q9ULW2 Frizzled-10 X-ray 2.65 2022-03-14 80.62 0.95 0.04 ok
7QOT_A P03951 Coagulation factor XIa heavy chain X-ray 3.24 2021-12-28 86.88 0.95 0.04 ok
7UDP_A Q8NI60 Atypical kinase COQ8A, mitochondrial X-ray 2.01 2022-03-20 69.62 0.94 0.04 ok
7Y43_A Q92794 Histone acetyltransferase KAT6A X-ray 1.50 2022-06-13 48.66 0.92 0.04 ok
7X8G_A Q03111 Protein ENL X-ray 1.91 2022-03-12 64.69 0.94 0.04 ok
7ZTL_B P04198 N-myc proto-oncogene protein X-ray 1.90 2022-05-11 1.70 52.79 0.60 0.84 86.11 1.45 0.04 ok
7X8B_A Q03111 Protein ENL X-ray 2.30 2022-03-11 64.69 0.95 0.03 ok
8EOM_A Q12888 TP53-binding protein 1 X-ray 1.70 2022-10-03 43.94 0.92 0.03 ok
8H7A_A Q92794 Histone acetyltransferase KAT6A X-ray 1.92 2022-10-19 48.66 0.93 0.03 ok
8F0W_A Q12888 TP53-binding protein 1 X-ray 1.52 2022-11-04 43.94 0.93 0.03 ok
8GXB_C P09012 U1 small nuclear ribonucleoprotein A X-ray 2.15 2022-09-19 79.50 0.96 0.03 ok
7USI_A P25440 Bromodomain-containing protein 2 X-ray 2.50 2022-04-25 64.06 0.96 0.03 ok
7QUI_A Q9NYZ4 Sialic acid-binding Ig-like lectin 8 X-ray 3.35 2022-01-18 73.81 0.96 0.03 ok
8EAZ_C P68036 Ubiquitin-conjugating enzyme E2 L3 X-ray 3.08 2022-08-30 95.56 0.97 0.03 ok
8GXC_C P09012 U1 small nuclear ribonucleoprotein A X-ray 2.50 2022-09-19 79.50 0.97 0.03 ok
7QQD_A Q14938 Nuclear factor 1 X-type X-ray 2.70 2022-01-07 61.62 0.96 0.03 ok
8EB0_B P68036 Ubiquitin-conjugating enzyme E2 L3 X-ray 3.03 2022-08-30 95.56 0.97 0.02 ok
8B5Y_A Q06124 Tyrosine-protein phosphatase non-receptor X-ray 1.83 2022-09-25 85.94 0.97 0.02 ok
7QQE_A Q14938 Nuclear factor 1 X-type X-ray 3.50 2022-01-07 61.62 0.96 0.02 ok
7XC5_A Q9H078 Isoform 2 of Caseinolytic peptidase B prot X-ray 2.10 2022-03-23 71.75 0.97 0.02 ok
7USK_A O60885 Bromodomain-containing protein 4 X-ray 1.22 2022-04-25 55.31 0.96 0.02 ok
7QRA_A P48730 Casein kinase I isoform delta X-ray 2.40 2022-01-10 81.00 0.98 0.02 ok
7QR9_A P48730 Casein kinase I isoform delta X-ray 2.30 2022-01-10 81.00 0.98 0.02 ok
7THS_A P00747 Plasminogen X-ray 1.80 2022-01-12 82.81 0.98 0.02 ok
7USH_A P25440 Bromodomain-containing protein 2 X-ray 1.27 2022-04-25 64.06 0.97 0.02 ok
7YIM_A P02771 Alpha-fetoprotein EM 2.60 2022-07-17 88.94 0.98 0.02 ok
8HUB_A Q01433 AMP deaminase 2 X-ray 3.25 2022-12-23 80.69 0.98 0.02 ok
8GPZ_A O60885 Bromodomain-containing protein 4 X-ray 1.53 2022-08-27 55.31 0.97 0.02 ok
7QNS_AA O60911 Cathepsin L2 X-ray 1.40 2021-12-22 92.94 0.98 0.02 ok
7USG_A P25440 Bromodomain-containing protein 2 X-ray 1.20 2022-04-25 64.06 0.98 0.02 ok
7QU6_A Q9NYZ4 Sialic acid-binding Ig-like lectin 8 X-ray 2.34 2022-01-17 73.81 0.98 0.02 ok
7YQ9_A O60885 Bromodomain-containing protein 4 X-ray 1.50 2022-08-05 55.31 0.97 0.02 ok
7YMG_A O60885 Bromodomain-containing protein 4 X-ray 1.40 2022-07-28 55.31 0.97 0.01 ok
8GQ0_A O60885 Bromodomain-containing protein 4 X-ray 1.44 2022-08-27 55.31 0.97 0.01 ok
7USJ_A O60885 Bromodomain-containing protein 4 X-ray 2.08 2022-04-25 55.31 0.98 0.01 ok
7QRB_A P48730 Casein kinase I isoform delta X-ray 2.60 2022-01-10 81.00 0.98 0.01 ok
7XHF_A Q13283 Ras GTPase-activating protein-binding prot X-ray 2.68 2022-04-08 66.81 0.98 0.01 ok
7QO2_AA O60911 Cathepsin L2 X-ray 1.77 2021-12-23 92.94 0.99 0.01 ok
7X88_A Q03111 Protein ENL X-ray 2.25 2022-03-11 64.69 0.98 0.01 ok
7ZTL_A O14965 Aurora kinase A X-ray 1.90 2022-05-11 75.06 0.99 0.01 ok
8E3Q_A Q10570 Cleavage and polyadenylation specificity f EM 2.68 2022-08-17 82.44 0.99 0.01 ok
7QOX_A P03952 Plasma kallikrein heavy chain X-ray 2.32 2021-12-29 87.88 0.99 0.01 ok
8BZJ_A Q9Y6E0 Serine/threonine-protein kinase 24 X-ray 2.52 2022-12-14 77.62 0.99 0.01 ok
8E3I_A Q10570 Cleavage and polyadenylation specificity f EM 2.53 2022-08-17 82.44 0.99 0.01 ok
7X4H_A P68400 Casein Kinase 2 subunit alpha X-ray 1.77 2022-03-02 88.94 0.99 0.01 ok
8BZI_A Q9Y6E0 Serine/threonine-protein kinase 24 X-ray 1.72 2022-12-14 77.62 0.99 0.01 ok
8HDP_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.20 2022-11-05 97.06 0.99 0.01 ok
8BSN_A O94925 Glutaminase kidney isoform, mitochondrial X-ray 2.49 2022-11-25 80.19 0.99 0.01 ok
8HU6_A Q01433 AMP deaminase 2 X-ray 2.33 2022-12-22 80.69 0.99 0.01 ok
7XYH_A P19784 Casein kinase II subunit alpha' X-ray 2.04 2022-06-01 94.12 0.99 0.01 ok
7QOB_AAA P00915 Carbonic anhydrase 1 X-ray 1.80 2021-12-23 96.81 0.99 0.01 ok
8B29_A P00918 Carbonic anhydrase 2 X-ray 1.70 2022-09-13 97.38 0.99 0.01 ok
8HDO_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.87 2022-11-05 97.06 0.99 0.01 ok
7QNV_AAA P00918 Carbonic anhydrase 2 X-ray 1.28 2021-12-22 97.38 0.99 0.01 ok
7U9I_A Q86X55 Histone-arginine methyltransferase CARM1 X-ray 2.00 2022-03-10 78.25 0.99 0.00 ok
7OYP_A P00918 Carbonic anhydrase 2 X-ray 1.05 2021-06-24 97.38 1.00 0.00 ok
8BSL_A O94925 Glutaminase kidney isoform, mitochondrial X-ray 2.38 2022-11-25 80.19 0.99 0.00 ok
7OYO_A P00918 Carbonic anhydrase 2 X-ray 1.03 2021-06-24 97.38 1.00 0.00 ok
7OYR_A P00918 Carbonic anhydrase 2 X-ray 1.15 2021-06-24 97.38 1.00 0.00 ok
7OYM_A P00918 Carbonic anhydrase 2 X-ray 0.98 2021-06-24 97.38 1.00 0.00 ok
7OYQ_A P00918 Carbonic anhydrase 2 X-ray 1.15 2021-06-24 97.38 1.00 0.00 ok
7OYN_A P00918 Carbonic anhydrase 2 X-ray 0.98 2021-06-24 97.38 1.00 0.00 ok
8BSK_A O94925 Glutaminase kidney isoform, mitochondrial X-ray 2.10 2022-11-25 80.19 1.00 0.00 ok
8BSM_A O94925 Glutaminase kidney isoform, mitochondrial X-ray 2.78 2022-11-25 80.19 1.00 0.00 ok
8E3Q_B Q9C0J8 pre-mRNA 3' end processing protein WDR33 EM 2.68 2022-08-17 55.41 1.00 0.00 ok
8E3I_B Q9C0J8 pre-mRNA 3' end processing protein WDR33 EM 2.53 2022-08-17 55.41 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.