Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2022-08-10

85
structures analysed (7 full · 8.2%)
00.0%
confidently wrong
11.2%
novel sequences
00.0%
novel & wrong
0.965
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 0 of 85 structures (0.0%) are confidently wrong; median TM-score is 0.965.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.965 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7VR8_A P43004 Excitatory amino acid transporter 2 EM 3.58 2021-10-22 38.80 89.92 0.62 0.82 9.14 10.58 0.58 ok
7VR7_A P43004 Excitatory amino acid transporter 2 EM 3.49 2021-10-22 38.80 89.92 0.63 0.83 9.20 10.52 0.57 ok
7DTI_A P61218 DNA-directed RNA polymerases I, II, and II NMR 2021-01-05 0.00 78.42 0.59 0.67 8.07 14.78 0.52 ok
7R1D_B Q96GY3 Protein lin-37 homolog EM 3.50 2022-02-02 100.00 novel 74.28 0.51 0.68 23.66 9.03 0.31 ok
8DJH_B P29590 PML 4SD X-ray 1.77 2022-06-30 13.80 31.28 0.20 0.34 3.75 12.82 0.24 ok
8DJI_B P29590 Protein PML X-ray 1.97 2022-06-30 0.00 28.40 0.27 0.44 0.00 13.54 0.23 ok
7WRQ_B P17936 Insulin-like growth factor-binding protein EM 3.60 2022-01-27 48.90 83.90 0.65 0.71 41.47 5.49 0.23 ok
7QVM_A P09471 Guanine nucleotide-binding protein G(o) su EM 3.25 2022-01-21 94.50 0.77 0.22 ok
7P9W_B Q9BXH1 Bcl-2-binding component 3, isoforms 1/2 X-ray 2.00 2021-07-28 59.19 0.70 0.18 ok
7T9M_R P16473 Thyrotropin receptor EM 3.10 2021-12-19 74.00 0.78 0.17 ok
7WRQ_C P05019 Isoform 3 of Insulin-like growth factor I EM 3.60 2022-01-27 59.53 0.75 0.15 ok
7XKF_A P63092 Guanine nucleotide-binding protein G(s) su EM 2.40 2022-04-19 91.31 0.86 0.13 ok
7XKD_A P63092 Guanine nucleotide-binding protein G(s) su EM 2.40 2022-04-19 91.31 0.86 0.13 ok
7UKN_A Q16531 DNA damage-binding protein 1 X-ray 2.90 2022-04-01 92.00 0.88 0.11 ok
7R1D_C Q5TKA1 Protein lin-9 homolog EM 3.50 2022-02-02 70.81 0.85 0.11 ok
8DJH_A P63165 Small ubiquitin-related modifier 1 X-ray 1.77 2022-06-30 78.31 0.87 0.10 ok
7WRQ_A P35858 Insulin-like growth factor-binding protein EM 3.60 2022-01-27 90.56 0.89 0.10 ok
7Y39_A Q8TCF1 AN1-type zinc finger protein 1 X-ray 1.88 2022-06-10 83.12 0.88 0.10 ok
7DTI_B P32780 General transcription factor IIH subunit 1 NMR 2021-01-05 73.88 0.88 0.09 ok
7XVE_B Q07699 Sodium channel subunit beta-1 EM 2.70 2022-05-21 87.06 0.90 0.09 ok
7XVF_B Q07699 Sodium channel subunit beta-1 EM 2.80 2022-05-22 87.06 0.90 0.09 ok
8A4B_A Q6BDI9 Rab15 effector protein X-ray 2.80 2022-06-10 80.56 0.90 0.08 ok
7QVM_R P30559 Oxytocin receptor EM 3.25 2022-01-21 78.62 0.90 0.08 ok
8A4C_A Q6BDI9 Rab15 effector protein X-ray 2.75 2022-06-10 80.56 0.91 0.08 ok
8A4A_A Q6BDI9 Rab15 effector protein X-ray 2.52 2022-06-10 80.56 0.91 0.07 ok
7QVM_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.25 2022-01-21 89.56 0.92 0.07 ok
7XKD_R Q8CJ12 Adhesion G-protein coupled receptor G2 EM 2.40 2022-04-19 62.31 0.89 0.07 ok
7XKF_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.40 2022-04-19 89.56 0.93 0.07 ok
7XKD_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.40 2022-04-19 89.56 0.93 0.07 ok
7XKE_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.90 2022-04-19 89.56 0.94 0.05 ok
7NBB_B P0CG47 Polyubiquitin-B X-ray 1.55 2021-01-26 93.44 0.94 0.05 ok
7NPO_B P0CG47 Polyubiquitin-B X-ray 2.19 2021-02-27 93.44 0.95 0.05 ok
7YCE_A P01116 Isoform 2B of GTPase KRas X-ray 1.80 2022-07-01 91.50 0.95 0.05 ok
7XVE_A Q15858 Sodium channel protein type 9 subunit alph EM 2.70 2022-05-21 69.06 0.93 0.05 ok
8A5U_B Q05901 Neuronal acetylcholine receptor subunit be X-ray 2.40 2022-06-16 83.31 0.95 0.05 ok
7WN5_A P25440 Isoform 4 of Bromodomain-containing protei X-ray 1.70 2022-01-17 64.06 0.94 0.04 ok
7YCC_A P01116 Isoform 2B of GTPase KRas X-ray 1.79 2022-07-01 91.50 0.96 0.04 ok
7V1U_A O60885 Bromodomain-containing protein 4 X-ray 1.82 2021-08-06 55.31 0.94 0.03 ok
7R1D_A Q09028 Histone-binding protein RBBP4 EM 3.50 2022-02-02 91.69 0.96 0.03 ok
7NBB_A P0CG47 Polyubiquitin-B X-ray 1.55 2021-01-26 93.44 0.96 0.03 ok
7VMS_G P68106 Peptidyl-prolyl cis-trans isomerase FKBP1B EM 3.80 2021-10-09 94.88 0.97 0.03 ok
8DJI_A P63165 Small ubiquitin-related modifier 1 X-ray 1.97 2022-06-30 78.31 0.96 0.03 ok
7VMR_G P68106 Peptidyl-prolyl cis-trans isomerase FKBP1B EM 3.30 2021-10-09 94.88 0.97 0.03 ok
7OQ9_A P31947 14-3-3 protein sigma X-ray 1.80 2021-06-02 92.88 0.97 0.03 ok
8AAU_L P53667 LIM domain kinase 1 X-ray 1.74 2022-07-03 75.19 0.96 0.03 ok
7XVF_C O60939 Sodium channel subunit beta-2 EM 2.80 2022-05-22 85.81 0.97 0.03 ok
7VMQ_G P68106 Peptidyl-prolyl cis-trans isomerase FKBP1B EM 3.70 2021-10-09 94.88 0.97 0.03 ok
7VMO_G P68106 Peptidyl-prolyl cis-trans isomerase FKBP1B EM 3.50 2021-10-09 94.88 0.97 0.03 ok
7VMM_G P68106 Peptidyl-prolyl cis-trans isomerase FKBP1B EM 3.50 2021-10-09 94.88 0.97 0.03 ok
7VML_G P68106 Peptidyl-prolyl cis-trans isomerase FKBP1B EM 3.30 2021-10-09 94.88 0.97 0.03 ok
7VMP_G P68106 Peptidyl-prolyl cis-trans isomerase FKBP1B EM 3.50 2021-10-09 94.88 0.97 0.03 ok
7VMN_G P68106 Peptidyl-prolyl cis-trans isomerase FKBP1B EM 3.50 2021-10-09 94.88 0.97 0.03 ok
7NPO_A P0CG47 Polyubiquitin-B X-ray 2.19 2021-02-27 93.44 0.97 0.03 ok
7OQA_A P31947 14-3-3 protein sigma X-ray 1.80 2021-06-02 92.88 0.97 0.02 ok
8DW5_A P02766 Transthyretin X-ray 1.52 2022-07-31 88.00 0.97 0.02 ok
7W0Q_A Q9C029 E3 ubiquitin-protein ligase TRIM7 X-ray 1.10 2021-11-18 85.50 0.97 0.02 ok
7WL4_A O60885 Bromodomain-containing protein 4 X-ray 1.82 2022-01-12 55.31 0.96 0.02 ok
7WMU_A P25440 Isoform 4 of Bromodomain-containing protei X-ray 1.73 2022-01-17 64.06 0.97 0.02 ok
7XVE_C O60939 Sodium channel subunit beta-2 EM 2.70 2022-05-21 85.81 0.98 0.02 ok
7XVF_A Q15858 Sodium channel protein type 9 subunit alph EM 2.80 2022-05-22 69.06 0.97 0.02 ok
7X6Z_A Q9C029 E3 ubiquitin-protein ligase TRIM7 X-ray 1.43 2022-03-08 85.50 0.98 0.02 ok
7WJS_A O60885 Bromodomain-containing protein 4 X-ray 2.73 2022-01-07 55.31 0.97 0.02 ok
7X70_A Q9C029 E3 ubiquitin-protein ligase TRIM7 X-ray 1.25 2022-03-08 85.50 0.98 0.02 ok
7WNI_A P25440 Isoform 4 of Bromodomain-containing protei X-ray 3.12 2022-01-18 64.06 0.97 0.02 ok
7W0T_B Q9C029 E3 ubiquitin-protein ligase TRIM7 X-ray 1.57 2021-11-18 85.50 0.98 0.02 ok
7WKY_A O60885 Bromodomain-containing protein 4 X-ray 2.83 2022-01-12 55.31 0.97 0.01 ok
7X6Y_A Q9C029 E3 ubiquitin-protein ligase TRIM7 X-ray 1.39 2022-03-08 85.50 0.98 0.01 ok
7W0S_B Q9C029 E3 ubiquitin-protein ligase TRIM7 X-ray 1.40 2021-11-18 85.50 0.98 0.01 ok
8A4C_B P20337 Ras-related protein Rab-3B X-ray 2.75 2022-06-10 83.38 0.99 0.01 ok
7RPP_A P13688 Carcinoembryonic antigen-related cell adhe X-ray 2.20 2021-08-04 81.56 0.98 0.01 ok
7LMS_A Q86TU7 Actin-histidine N-methyltransferase EM 3.50 2021-02-05 86.38 0.99 0.01 ok
8A4B_B P20337 Ras-related protein Rab-3B X-ray 2.80 2022-06-10 83.38 0.99 0.01 ok
7V2G_A P05413 Fatty acid-binding protein, heart X-ray 0.98 2021-08-09 96.19 0.99 0.01 ok
7WMQ_A P25440 Isoform 4 of Bromodomain-containing protei X-ray 2.37 2022-01-16 64.06 0.98 0.01 ok
8A7I_A Q9H8M2 Bromodomain-containing protein 9 X-ray 1.76 2022-06-21 62.97 0.98 0.01 ok
7WNA_A P25440 Isoform 4 of Bromodomain-containing protei X-ray 2.60 2022-01-17 64.06 0.98 0.01 ok
7QVM_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.25 2022-01-21 97.06 0.99 0.01 ok
7WLN_A P25440 Isoform 4 of Bromodomain-containing protei X-ray 2.85 2022-01-13 64.06 0.99 0.01 ok
7PM4_A P04066 Tissue alpha-L-fucosidase EM 2.49 2021-09-01 93.19 0.99 0.01 ok
7PLS_A P04066 Tissue alpha-L-fucosidase EM 2.49 2021-09-01 93.19 0.99 0.01 ok
7XKE_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.90 2022-04-19 97.06 0.99 0.01 ok
7XKF_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.40 2022-04-19 97.06 0.99 0.01 ok
7XKD_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.40 2022-04-19 97.06 0.99 0.01 ok
7PA3_AAA Q99497 Parkinson disease protein 7 X-ray 1.42 2021-07-28 98.44 1.00 0.00 ok
7PA2_AAA Q99497 Parkinson disease protein 7 X-ray 1.21 2021-07-28 98.44 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.