Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2019-11-20

86
structures analysed (54 full · 62.8%)
33.5%
confidently wrong
33.5%
novel sequences
11.2%
novel & wrong
0.967
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 3 of 86 structures (3.5%) are confidently wrong; median TM-score is 0.967.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.967 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6NL3_A Q5JTJ3 Cytochrome c oxidase assembly factor 6 hom NMR 2019-01-07 100.00 novel 87.85 0.27 0.48 7.91 13.74 0.63 wrong
6ULG_L Q8NFG4 Folliculin EM 3.31 2019-10-08 1.40 88.81 0.51 0.84 12.88 10.88 0.53 ok
6RX1_A Q9UQF0 Syncytin-1 X-ray 2.10 2019-06-07 14.80 55.06 0.44 0.60 0.00 18.75 0.52 ok
6PLM_C P0DP24 Calmodulin-2 X-ray 2.59 2019-07-01 0.70 86.32 0.41 0.67 12.13 10.36 0.52 wrong
6E5N_B Q9UM54 Unconventional myosin-VI NMR 2018-07-20 0.00 62.35 0.51 0.52 9.76 11.78 0.41 ok
6OIE_C Q16695 Histone H3.1t peptide X-ray 2.08 2019-04-09 63.65 0.47 0.42 29.69 5.99 0.24 ok
6I51_L P00734 Prothrombin X-ray 1.40 2018-11-12 83.94 0.73 0.22 ok
6ULG_F Q7L523 Ras-related GTP-binding protein A EM 3.31 2019-10-08 0.40 95.29 0.80 0.82 47.89 4.03 0.22 ok
6ULG_N Q9P278 Folliculin-interacting protein 2 EM 3.31 2019-10-08 100.00 novel 84.98 0.91 0.64 52.43 9.18 0.21 ok
6JNO_A P19793 Retinoic acid receptor RXR-alpha X-ray 2.65 2019-03-17 0.00 93.95 0.85 0.87 54.74 6.51 0.21 ok
6E5N_A P09496 Clathrin light chain A NMR 2018-07-20 100.00 novel 44.88 0.54 0.37 32.81 6.36 0.17 ok
6NI3_A P63092 Guanine nucleotide-binding protein G(s) su EM 3.80 2018-12-26 0.00 93.45 0.86 0.79 62.39 3.24 0.15 ok
6S9D_A P00533 Epidermal growth factor receptor X-ray 2.67 2019-07-12 0.00 81.98 0.92 0.87 53.83 7.50 0.15 ok
6PSJ_A P03372 Estrogen receptor X-ray 1.80 2019-07-12 1.20 91.72 0.91 0.87 67.46 5.05 0.14 ok
6S9B_A P00533 Epidermal growth factor receptor X-ray 3.25 2019-07-12 0.00 83.07 0.92 0.88 58.33 6.58 0.14 ok
6ULG_E Q6IAA8 Ragulator complex protein LAMTOR1 EM 3.31 2019-10-08 0.00 95.29 0.82 0.95 66.98 2.00 0.12 ok
6L6Q_A P43354 Nuclear receptor related 1 X-ray 2.60 2019-10-29 6.00 89.04 0.87 0.88 70.00 3.06 0.10 ok
6L6L_A P43354 Nuclear receptor related 1 X-ray 2.78 2019-10-29 6.00 89.04 0.87 0.89 71.76 3.03 0.10 ok
6I3Z_B P01009 Alpha-1-antitrypsin X-ray 3.10 2018-11-08 88.62 0.89 0.10 ok
6O8D_C P10747 T-cell-specific surface glycoprotein CD28 X-ray 3.55 2019-03-09 0.00 91.57 0.86 0.78 76.96 1.93 0.09 ok
6TCE_A Q99717 Mothers against decapentaplegic homolog 5 X-ray 2.92 2019-11-05 3.00 94.00 0.95 0.90 82.93 2.52 0.09 ok
6NI2_V P30518 Vasopressin V2 receptor EM 4.00 2018-12-26 0.00 43.36 0.26 0.89 58.93 2.75 0.07 ok
6I3Z_A P01009 Alpha-1-antitrypsin X-ray 3.10 2018-11-08 88.62 0.92 0.07 ok
6STI_B Q15596 Nuclear receptor coactivator 2 X-ray 1.89 2019-09-10 65.54 0.65 0.82 77.08 2.17 0.07 ok
6TBZ_A Q56I99 Mothers against decapentaplegic homolog 5 X-ray 1.78 2019-11-04 3.90 93.60 0.94 0.93 89.11 1.97 0.06 ok
6N2U_A P10145 Interleukin-8 X-ray 1.25 2018-11-14 0.00 94.02 0.91 0.92 90.22 1.69 0.06 ok
6NI3_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.80 2018-12-26 0.00 95.34 0.86 0.92 89.66 1.11 0.06 ok
6I51_H P00734 Prothrombin X-ray 1.40 2018-11-12 83.94 0.93 0.06 ok
6S9C_A P00533 Epidermal growth factor receptor X-ray 2.73 2019-07-12 0.00 81.91 0.95 0.90 83.64 1.77 0.06 ok
6I29_A Q00987 Human E3 Ubiquitin-Protein Ligase MDM2 X-ray 2.10 2018-11-01 62.59 0.91 0.06 ok
6UH5_Q P0CG47 Ubiquitin EM 3.50 2019-09-26 0.00 93.14 0.93 0.91 91.78 1.40 0.05 ok
6U16_A Q13569 G/T mismatch-specific thymine DNA glycosyl X-ray 1.60 2019-08-15 0.50 95.83 0.97 0.95 95.96 1.82 0.05 ok
6SEO_L A6NEQ2 Protein FAM181B X-ray 2.55 2019-07-30 70.07 0.44 0.90 84.38 1.34 0.05 wrong
6T9O_A Q13563 Polycystin-2 EM 3.39 2019-10-28 0.00 90.83 0.98 0.95 93.09 2.21 0.05 ok
6ULG_G Q9HB90 Ras-related GTP-binding protein C EM 3.31 2019-10-08 0.30 78.76 0.97 0.91 89.60 1.21 0.05 ok
6ULG_D Q0VGL1 Ragulator complex protein LAMTOR4 EM 3.31 2019-10-08 0.00 91.78 0.93 0.87 90.88 0.99 0.05 ok
6ULG_B Q9Y2Q5 Ragulator complex protein LAMTOR2 EM 3.31 2019-10-08 0.00 91.42 0.95 0.89 92.20 1.11 0.05 ok
6SLG_A P28482 Mitogen-activated protein kinase 1 X-ray 1.33 2019-08-19 0.00 92.26 0.97 0.92 92.47 1.70 0.05 ok
6ULG_C O43504 Ragulator complex protein LAMTOR5 EM 3.31 2019-10-08 0.00 96.56 0.94 0.91 94.51 0.95 0.05 ok
6HGO_A Q96PD4 Interleukin-17F X-ray 2.10 2018-08-23 87.62 0.95 0.04 ok
6SSQ_A P10826 Retinoic acid receptor beta X-ray 2.30 2019-09-09 0.00 95.81 0.98 0.95 96.03 1.46 0.04 ok
6RX3_A P60508 Syncytin-2 X-ray 2.20 2019-06-07 0.00 62.47 0.91 0.94 85.39 1.17 0.04 ok
6T9N_A Q13563 Polycystin-2 EM 2.96 2019-10-28 0.00 90.91 0.98 0.95 95.62 1.50 0.04 ok
6ULG_A Q9UHA4 Ragulator complex protein LAMTOR3 EM 3.31 2019-10-08 0.00 96.29 0.97 0.93 96.28 0.77 0.04 ok
6OHD_A Q16539 Mitogen-activated protein kinase 14 X-ray 2.50 2019-04-05 3.90 93.10 0.99 0.95 95.91 0.83 0.04 ok
6SEN_A Q15561 Transcriptional enhancer factor TEF-3 X-ray 1.65 2019-07-30 0.50 93.57 0.98 0.95 96.22 1.02 0.04 ok
6K0J_A Q92630 Dual specificity tyrosine-phosphorylation- X-ray 2.35 2019-05-06 0.70 97.13 0.99 0.97 96.41 0.92 0.04 ok
6U15_A Q13569 G/T mismatch-specific thymine DNA glycosyl X-ray 2.40 2019-08-15 0.50 96.03 0.98 0.96 97.56 1.16 0.04 ok
6NI3_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.80 2018-12-26 0.00 97.14 0.99 0.95 98.45 0.61 0.03 ok
6OIE_A Q8WYB5 Histone acetyltransferase KAT6B X-ray 2.08 2019-04-09 0.00 87.98 0.96 0.94 96.17 0.86 0.03 ok
6U17_A Q13569 G/T mismatch-specific thymine DNA glycosyl X-ray 1.55 2019-08-15 0.00 95.85 0.98 0.96 97.97 1.11 0.03 ok
6UXE_B Q9HD34 LYR motif-containing protein 4 X-ray 1.57 2019-11-07 93.12 0.97 0.03 ok
6SEO_A Q15561 Transcriptional enhancer factor TEF-3 X-ray 2.55 2019-07-30 0.50 93.61 0.98 0.96 96.83 0.77 0.03 ok
6I3N_A Q99836 Myeloid differentiation primary response p EM 3.10 2018-11-06 80.56 0.96 0.03 ok
6SEN_L Q8N9Y4 Protein FAM181A X-ray 1.65 2019-07-30 87.70 0.59 0.95 96.88 0.60 0.03 ok
6JQR_A P36888 Receptor-type tyrosine-protein kinase FLT3 X-ray 2.20 2019-04-01 0.00 88.06 0.99 0.95 96.10 0.94 0.03 ok
6OV7_A Q9HD26 Golgi-associated PDZ and coiled-coil motif X-ray 1.71 2019-05-07 0.00 90.29 0.98 0.96 98.56 0.50 0.03 ok
6STI_A P19793 Retinoic acid receptor RXR-alpha X-ray 1.89 2019-09-10 0.00 93.50 0.99 0.97 98.47 1.22 0.02 ok
6UPT_A Q12888 TP53-binding protein 1 X-ray 1.96 2019-10-18 43.94 0.95 0.02 ok
6N3G_A Q9NRG4 N-lysine methyltransferase SMYD2 X-ray 2.43 2018-11-15 0.00 97.82 1.00 0.99 99.53 0.41 0.02 ok
6PZ3_A Q9Y253 DNA polymerase eta X-ray 2.40 2019-07-31 0.00 97.23 0.99 0.98 98.60 0.62 0.02 ok
6UXE_D Q9H1K1 Iron-sulfur cluster assembly enzyme ISCU, X-ray 1.57 2019-11-07 85.19 0.98 0.02 ok
6Q02_A Q9Y253 DNA polymerase eta X-ray 2.09 2019-08-01 0.00 97.27 0.99 0.99 99.30 0.52 0.02 ok
6MQK_A Q8IYM1 Septin-12 X-ray 2.19 2018-10-10 81.44 0.98 0.01 ok
6MQ9_A Q8IYM1 Septin-12 X-ray 1.86 2018-10-09 81.44 0.98 0.01 ok
6MQL_A Q8IYM1 Septin-12 X-ray 2.17 2018-10-10 81.44 0.99 0.01 ok
6SSQ_F Q15788 Nuclear receptor coactivator 1 X-ray 2.30 2019-09-09 60.46 0.91 0.98 100.00 0.31 0.01 ok
6I4V_A P01009 Alpha-1-antitrypsin X-ray 1.78 2018-11-12 88.62 0.99 0.01 ok
6UYA_A Q9NWZ3 Interleukin-1 receptor-associated kinase 4 X-ray 1.74 2019-11-12 83.94 0.99 0.01 ok
6I0J_A P00915 Carbonic anhydrase 1 X-ray 1.35 2018-10-26 96.81 0.99 0.01 ok
6I0L_A P00915 Carbonic anhydrase 1 X-ray 1.40 2018-10-26 96.81 0.99 0.01 ok
6I0W_A P00918 Carbonic anhydrase 2 X-ray 1.04 2018-10-26 97.38 0.99 0.01 ok
6I1U_A P00918 Carbonic anhydrase 2 X-ray 1.08 2018-10-30 97.38 0.99 0.01 ok
6I2F_A P00918 Carbonic anhydrase 2 X-ray 1.20 2018-11-01 97.38 0.99 0.00 ok
6I4Z_A P09622 Dihydrolipoyl dehydrogenase, mitochondrial X-ray 2.34 2018-11-12 94.00 1.00 0.00 ok
6I3E_A P00918 Carbonic anhydrase 2 X-ray 1.07 2018-11-05 97.38 1.00 0.00 ok
6UXE_A Q9Y697 Cysteine desulfurase, mitochondrial X-ray 1.57 2019-11-07 88.75 1.00 0.00 ok
6I4T_A P09622 Dihydrolipoyl dehydrogenase, mitochondrial X-ray 1.82 2018-11-10 94.00 1.00 0.00 ok
6I4Q_A P09622 Dihydrolipoyl dehydrogenase, mitochondrial X-ray 1.75 2018-11-10 94.00 1.00 0.00 ok
6I4S_A P09622 Dihydrolipoyl dehydrogenase, mitochondrial X-ray 1.75 2018-11-10 94.00 1.00 0.00 ok
6I4P_A P09622 Dihydrolipoyl dehydrogenase, mitochondrial X-ray 1.60 2018-11-10 94.00 1.00 0.00 ok
6I4R_A P09622 Dihydrolipoyl dehydrogenase, mitochondrial X-ray 1.44 2018-11-10 94.00 1.00 0.00 ok
6I4U_A P09622 Dihydrolipoyl dehydrogenase, mitochondrial X-ray 1.84 2018-11-10 94.00 1.00 0.00 ok
6I34_A P23378 Neanderthal Glycine decarboxylase X-ray 2.10 2018-11-05 94.12 1.00 0.00 ok
6I35_A P23378 Glycine dehydrogenase (decarboxylating), m X-ray 2.00 2018-11-05 94.12 1.00 0.00 ok
6I33_A P23378 Glycine dehydrogenase (decarboxylating), m X-ray 2.30 2018-11-05 94.12 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.