Live Stats, next update: Wed 09 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2020-03-18

87
structures analysed (54 full · 62.1%)
00.0%
confidently wrong
22.3%
novel sequences
00.0%
novel & wrong
0.976
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 0 of 87 structures (0.0%) are confidently wrong; median TM-score is 0.976.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.976 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6U19_A P55036 26S proteasome non-ATPase regulatory subun NMR 2019-08-15 0.00 55.51 0.50 0.68 10.27 13.68 0.34 ok
6VU5_B P50148 Guanine nucleotide-binding protein G(q) su EM 3.50 2020-02-14 93.00 0.71 0.27 ok
6VU8_B P63096 Guanine nucleotide-binding protein G(i) su EM 4.14 2020-02-14 93.75 0.72 0.26 ok
6SIU_C P60953 Cell division control protein 42 homolog X-ray 2.49 2019-08-12 0.00 93.48 0.91 0.88 48.43 6.66 0.22 ok
6VAF_B Q9BXW9 Fanconi anemia group D2 protein EM 3.90 2019-12-17 76.75 0.75 0.19 ok
6VAE_B Q9BXW9 Fanconi anemia group D2 protein EM 3.60 2019-12-17 76.75 0.75 0.19 ok
6HJL_B Q07817 Bcl-2-like protein 1 X-ray 2.20 2018-09-04 72.50 0.76 0.18 ok
6HJL_A Q07817 Bcl-2-like protein 1 X-ray 2.20 2018-09-04 72.50 0.76 0.17 ok
6XV0_A P02768 Serum albumin X-ray 3.00 2020-01-21 92.69 0.84 0.15 ok
6HCZ_A O60232 Sjoegren syndrome/scleroderma autoantigen X-ray 2.30 2018-08-17 77.62 0.81 0.14 ok
6VAD_B Q9BXW9 Fanconi anemia group D2 protein EM 3.30 2019-12-17 76.75 0.84 0.12 ok
6VAA_B Q9BXW9 Fanconi anemia group D2 protein EM 3.40 2019-12-17 76.75 0.85 0.12 ok
6UBI_A P0DOX5 VRC34.05 heavy chain X-ray 1.90 2019-09-11 18.50 91.90 0.88 0.91 68.99 2.03 0.11 ok
6UEL_A P31327 Carbamoyl-phosphate synthase [ammonia], mi X-ray 1.90 2019-09-21 0.00 96.50 0.98 0.92 82.67 2.20 0.09 ok
6LZG_A Q9BYF1 Angiotensin-converting enzyme 2 X-ray 2.50 2020-02-19 0.00 94.97 0.97 0.98 82.38 1.51 0.08 ok
6M0J_A Q9BYF1 Angiotensin-converting enzyme 2 X-ray 2.45 2020-02-21 0.00 94.96 0.97 0.98 83.88 1.42 0.07 ok
6HG9_A Q96PD4 Interleukin-17F X-ray 3.62 2018-08-23 87.62 0.92 0.07 ok
6HG9_B Q8NAC3 Interleukin-17 receptor C X-ray 3.62 2018-08-23 73.56 0.90 0.07 ok
6HG4_A Q96PD4 Interleukin-17F X-ray 3.32 2018-08-22 87.62 0.93 0.06 ok
6U19_B Q05086 Ubiquitin-protein ligase E3A NMR 2019-08-15 0.00 83.22 0.88 0.89 87.50 2.20 0.06 ok
6UZA_A Q9Y210 Short transient receptor potential channel EM 3.08 2019-11-14 76.69 0.92 0.06 ok
6UBI_B Q6GMX0 VRC34.05 light chain X-ray 1.90 2019-09-11 12.30 96.86 0.96 0.95 89.50 1.09 0.06 ok
6HGA_B Q8NAC3 Interleukin-17 receptor C X-ray 2.60 2018-08-23 73.56 0.92 0.06 ok
6RLZ_A P63104 14-3-3 protein zeta/delta X-ray 3.70 2019-05-03 0.00 96.88 0.97 0.91 92.40 1.37 0.06 ok
6OAE_A Q9HBB8 Mucin-like protocadherin X-ray 1.90 2019-03-15 74.40 novel 94.59 0.97 0.96 92.03 1.01 0.05 ok
6VAF_D P0CG48 Ubiquitin EM 3.90 2019-12-17 88.62 0.94 0.05 ok
6QU2_A Q13627 Dual specificity tyrosine-phosphorylation- X-ray 2.90 2019-02-26 0.00 96.10 0.98 0.96 92.34 1.21 0.05 ok
6L93_A Q8NER1 Transient receptor potential cation channe X-ray 4.47 2019-11-08 12.10 89.59 0.97 0.91 92.91 1.54 0.05 ok
6VAE_C P0CG48 Ubiquitin EM 3.60 2019-12-17 88.62 0.94 0.05 ok
6HG4_B Q8NAC3 Interleukin-17 receptor C X-ray 3.32 2018-08-22 73.56 0.93 0.05 ok
6SAN_A Q9UGM3 Deleted in malignant brain tumors 1 protei X-ray 1.36 2019-07-17 38.30 82.39 0.95 0.90 90.62 1.70 0.05 ok
6UZ8_A Q9Y210 Short transient receptor potential channel EM 2.84 2019-11-14 76.69 0.94 0.05 ok
6UCF_L Q6GMX0 N123-VRC34_pI4 light chain X-ray 1.29 2019-09-16 1.00 96.81 0.98 0.98 95.31 0.82 0.05 ok
6LOG_A P13501 C-C motif chemokine 5 X-ray 2.55 2020-01-05 3.00 96.43 0.93 0.93 94.44 1.22 0.05 ok
6TLG_A P31947 14-3-3 protein sigma X-ray 2.40 2019-12-02 0.00 96.03 0.96 0.95 93.39 1.05 0.04 ok
6UCE_L Q6GMX0 N123-VRC34_pI3 light chain X-ray 1.38 2019-09-16 2.40 96.67 0.98 0.97 94.86 0.81 0.04 ok
6U8Z_A Q13393 Phospholipase D1,Phospholipase D1 X-ray 1.80 2019-09-06 100.00 novel 94.82 0.98 0.93 94.81 1.83 0.04 ok
6TLF_A P31947 14-3-3 protein sigma X-ray 2.90 2019-12-02 0.00 96.35 0.96 0.95 95.23 0.95 0.04 ok
6QTY_A P49759 Dual specificity protein kinase CLK1 X-ray 1.65 2019-02-26 0.30 96.31 0.98 0.96 94.67 0.91 0.04 ok
6TM7_A P31947 14-3-3 protein sigma X-ray 3.00 2019-12-03 0.00 96.39 0.96 0.95 96.00 0.95 0.04 ok
6SA4_A Q9UGM3 Deleted in malignant brain tumors 1 protei X-ray 1.77 2019-07-16 38.30 85.14 0.95 0.90 93.35 1.07 0.04 ok
6SA5_A Q9UGM3 Deleted in malignant brain tumors 1 protei X-ray 1.29 2019-07-16 38.30 84.78 0.97 0.92 95.56 0.94 0.04 ok
6OA6_A O43707 Alpha-actinin-4 X-ray 1.37 2019-03-15 0.90 89.84 0.98 0.97 97.25 0.83 0.04 ok
6LVS_A P54578 Ubiquitin carboxyl-terminal hydrolase 14 X-ray 2.73 2020-02-04 2.50 90.29 0.99 0.97 96.00 0.86 0.03 ok
6QST_A Q92793 CREB-binding protein X-ray 2.10 2019-02-22 0.00 94.97 0.98 0.97 98.06 0.84 0.03 ok
6QTG_A P49336 Cyclin-dependent kinase 8 X-ray 2.70 2019-02-25 0.00 95.02 0.99 0.99 97.79 0.56 0.03 ok
6SM1_A P01704 Immunoglobulin lambda variable 2-14 X-ray 1.55 2019-08-21 2.70 92.91 0.88 0.95 96.25 0.90 0.03 ok
6W1D_B Q9HD34 LYR motif-containing protein 4 X-ray 1.79 2020-03-04 93.12 0.97 0.03 ok
6VI4_A P41145 Kappa opioid receptor X-ray 3.30 2020-01-11 79.50 0.97 0.03 ok
6SK3_A P30419 Glycylpeptide N-tetradecanoyltransferase 1 X-ray 2.70 2019-08-14 0.30 95.02 0.99 0.98 98.45 0.52 0.03 ok
6KJZ_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 2.20 2019-07-23 0.00 96.12 0.99 0.98 98.24 0.82 0.03 ok
6QVO_A P36639 7,8-dihydro-8-oxoguanine triphosphatase X-ray 2.45 2019-03-04 0.70 97.67 0.99 0.98 99.03 0.46 0.02 ok
6SJZ_A P30419 Glycylpeptide N-tetradecanoyltransferase 1 X-ray 2.00 2019-08-14 0.30 95.10 0.99 0.98 98.21 0.75 0.02 ok
6VAD_A Q9NVI1 Fanconi anemia, complementation group I EM 3.30 2019-12-17 83.25 0.97 0.02 ok
6QTJ_A P49336 Cyclin-dependent kinase 8 X-ray 2.48 2019-02-25 0.00 94.94 0.99 0.99 98.56 0.47 0.02 ok
6VAA_A Q9NVI1 Fanconi anemia, complementation group I EM 3.40 2019-12-17 83.25 0.97 0.02 ok
6VAE_A Q9NVI1 Fanconi anemia, complementation group I EM 3.60 2019-12-17 83.25 0.97 0.02 ok
6SPI_A P00441 Superoxide dismutase [Cu-Zn] X-ray 2.80 2019-09-01 0.00 98.10 0.99 0.99 98.86 0.43 0.02 ok
6VAF_A Q9NVI1 Fanconi anemia, complementation group I EM 3.90 2019-12-17 83.25 0.97 0.02 ok
6KK0_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 2.20 2019-07-23 0.00 96.23 1.00 0.99 99.61 0.41 0.02 ok
6QSC_A P12955 Xaa-Pro dipeptidase X-ray 1.57 2019-02-20 0.50 98.47 0.99 0.99 99.37 1.94 0.02 ok
6SPJ_A P00441 Superoxide dismutase [Cu-Zn] X-ray 1.97 2019-09-01 0.00 98.10 0.99 0.99 99.18 0.39 0.02 ok
6SK8_A P30419 Glycylpeptide N-tetradecanoyltransferase 1 X-ray 1.87 2019-08-14 0.30 94.75 1.00 0.99 99.11 0.61 0.02 ok
6SPK_A P00441 Superoxide dismutase [Cu-Zn] X-ray 2.77 2019-09-01 0.00 98.10 0.99 0.99 99.18 0.39 0.02 ok
6SKJ_A P30419 Glycylpeptide N-tetradecanoyltransferase 1 X-ray 2.80 2019-08-15 0.30 95.03 1.00 0.99 99.42 0.40 0.02 ok
6SPH_A P00441 Superoxide dismutase [Cu-Zn] X-ray 2.25 2019-09-01 0.00 98.10 0.99 0.99 99.35 0.36 0.02 ok
6QSB_A P12955 Xaa-Pro dipeptidase X-ray 1.99 2019-02-20 0.50 98.47 1.00 0.99 98.96 0.75 0.02 ok
6SPA_A P00441 Superoxide dismutase [Cu-Zn] X-ray 1.65 2019-08-31 0.00 98.10 0.99 0.99 99.35 0.40 0.02 ok
6JME_A Q02127 Dihydroorotate dehydrogenase (quinone), mi X-ray 1.80 2019-03-08 0.00 97.70 0.99 0.99 99.04 0.86 0.02 ok
6SK2_A P30419 Glycylpeptide N-tetradecanoyltransferase 1 X-ray 1.90 2019-08-14 0.30 95.06 1.00 0.99 99.36 0.39 0.02 ok
6QRM_A P30419 Glycylpeptide N-tetradecanoyltransferase 1 X-ray 2.30 2019-02-19 0.30 95.06 1.00 0.99 99.30 0.38 0.02 ok
6QTG_B P24863 Cyclin-C X-ray 2.70 2019-02-25 0.40 95.01 0.99 0.98 99.24 0.46 0.02 ok
6QTJ_B P24863 Cyclin-C X-ray 2.48 2019-02-25 0.40 95.01 0.99 0.98 98.86 0.48 0.02 ok
6T6R_A Q9NZ08 Endoplasmic reticulum aminopeptidase 1 X-ray 1.67 2019-10-18 3.50 97.54 1.00 0.99 99.53 0.42 0.02 ok
6XVT_A Q8N8S7 Protein enabled homolog X-ray 1.40 2020-01-22 70.62 0.98 0.02 ok
6K2U_B P0CG48 Polyubiquitin-C X-ray 2.55 2019-05-15 0.00 91.43 0.99 0.99 100.00 0.32 0.02 ok
6UZT_A P18433 Receptor-type tyrosine-protein phosphatase X-ray 1.80 2019-11-15 81.50 0.98 0.02 ok
6W1D_D Q9H1K1 Iron-sulfur cluster assembly enzyme ISCU, X-ray 1.79 2020-03-04 85.19 0.98 0.02 ok
6JMD_A Q02127 Dihydroorotate dehydrogenase (quinone), mi X-ray 1.78 2019-03-08 0.00 97.77 1.00 0.99 99.45 0.49 0.02 ok
6OAK_A Q86W56 Poly(ADP-ribose) glycohydrolase X-ray 1.70 2019-03-16 1.20 97.64 1.00 0.99 99.85 0.32 0.01 ok
6OAL_A Q86W56 Poly(ADP-ribose) glycohydrolase X-ray 1.60 2019-03-16 1.20 97.60 1.00 0.99 99.70 0.32 0.01 ok
6O9O_A Q9H7B4 Histone-lysine N-methyltransferase SMYD3 X-ray 1.59 2019-03-14 0.00 97.47 1.00 1.00 99.59 0.29 0.01 ok
6V75_A P14618 Pyruvate kinase PKM X-ray 2.85 2019-12-07 96.81 0.99 0.01 ok
6Y8M_A P01584 Interleukin-1 beta X-ray 1.90 2020-03-05 76.25 0.99 0.01 ok
6W1D_A Q9Y697 Cysteine desulfurase, mitochondrial X-ray 1.79 2020-03-04 88.75 1.00 0.00 ok
6V76_A P14618 Pyruvate kinase PKM X-ray 2.75 2019-12-07 96.81 1.00 0.00 ok
6V74_A P14618 Pyruvate kinase PKM X-ray 2.32 2019-12-07 96.81 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.