Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2021-11-10

123
structures analysed (17 full · 13.8%)
43.3%
confidently wrong
108.1%
novel sequences
43.3%
novel & wrong
0.908
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 4 of 123 structures (3.3%) are confidently wrong; median TM-score is 0.908.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.908 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7MN8_A P21860 Receptor tyrosine-protein kinase erbB-3 EM 3.45 2021-04-30 0.00 92.30 0.51 0.91 2.55 24.21 0.83 ok
7KTS_C Q8NEM7 Isoform 3 of Transcription factor SPT20 ho EM 19.09 2020-11-24 100.00 novel 79.80 0.58 0.81 2.03 34.27 0.74 ok
7KTR_C Q8NEM7 Isoform 3 of Transcription factor SPT20 ho EM 2.93 2020-11-24 100.00 novel 79.80 0.58 0.81 2.03 34.27 0.74 ok
7KTS_B O75529 TAF5-like RNA polymerase II p300/CBP-assoc EM 19.09 2020-11-24 73.20 novel 78.79 0.58 0.82 1.69 29.12 0.73 ok
7KTR_B O75529 TAF5-like RNA polymerase II p300/CBP-assoc EM 2.93 2020-11-24 73.20 novel 78.79 0.58 0.82 1.69 29.12 0.73 ok
7KTS_J Q96BN2 Transcriptional adapter 1 EM 19.09 2020-11-24 100.00 novel 81.47 0.65 0.78 4.44 19.16 0.65 ok
7KTR_J Q96BN2 Transcriptional adapter 1 EM 2.93 2020-11-24 100.00 novel 81.47 0.65 0.78 4.44 19.16 0.65 ok
7PFO_Q Q9HAW4 Claspin EM 3.20 2021-08-11 100.00 novel 70.67 0.35 0.67 0.00 21.51 0.64 wrong
7PLO_Q Q9HAW4 Claspin EM 2.80 2021-09-01 100.00 novel 70.67 0.36 0.67 0.00 21.48 0.64 wrong
7KTS_F Q9Y6J9 TAF6-like RNA polymerase II p300/CBP-assoc EM 19.09 2020-11-24 65.80 88.39 0.68 0.55 11.18 17.68 0.64 ok
7PLO_O Q96L50 Leucine-rich repeat protein 1 EM 2.80 2021-09-01 60.20 90.32 0.67 0.80 25.65 6.75 0.37 ok
7AX3_A Q05193 Dynamin-1 EM 3.74 2020-11-09 78.00 0.68 0.25 ok
7PLO_T P62877 E3 ubiquitin-protein ligase RBX1 EM 2.80 2021-09-01 0.00 84.58 0.65 0.71 44.48 4.68 0.22 ok
7PFO_6 Q14566 DNA replication licensing factor MCM6 EM 3.20 2021-08-11 76.44 0.73 0.20 ok
7PLO_6 Q14566 DNA replication licensing factor MCM6 EM 2.80 2021-09-01 76.44 0.73 0.20 ok
7DE3_A P00568 Adenylate kinase isoenzyme 1 X-ray 2.20 2020-11-01 95.88 0.79 0.20 ok
7PFO_5 P33992 DNA replication licensing factor MCM5 EM 3.20 2021-08-11 78.06 0.75 0.19 ok
7PLO_5 P33992 DNA replication licensing factor MCM5 EM 2.80 2021-09-01 78.06 0.76 0.19 ok
7PFO_2 P49736 DNA replication licensing factor MCM2 EM 3.20 2021-08-11 76.25 0.78 0.17 ok
7PLO_P Q15370 Elongin-B EM 2.80 2021-09-01 92.50 0.82 0.17 ok
7KTS_N O15265 Ataxin-7 EM 19.09 2020-11-24 0.00 77.98 0.57 0.82 49.53 3.62 0.17 ok
7KTR_N O15265 Ataxin-7 EM 2.93 2020-11-24 0.00 77.98 0.57 0.82 49.53 3.62 0.17 ok
7PLO_2 P49736 DNA replication licensing factor MCM2 EM 2.80 2021-09-01 76.25 0.79 0.16 ok
7KTS_G Q16514 Transcription initiation factor TFIID subu EM 19.09 2020-11-24 76.44 0.79 0.16 ok
7KTR_G Q16514 Transcription initiation factor TFIID subu EM 2.93 2020-11-24 76.44 0.79 0.16 ok
7N70_A Q9NQ11 Isoform 3 of Polyamine-transporting ATPase EM 2.80 2021-06-09 79.62 0.80 0.16 ok
7KTS_I O75486 Transcription initiation protein SPT3 homo EM 19.09 2020-11-24 80.38 0.80 0.16 ok
7KTR_I O75486 Transcription initiation protein SPT3 homo EM 2.93 2020-11-24 80.38 0.80 0.16 ok
7LEW_B Q9Y679 Lipid droplet-regulating VLDL assembly fac X-ray 1.74 2021-01-15 79.50 0.80 0.16 ok
7PLO_A P56282 DNA polymerase epsilon subunit 2 EM 2.80 2021-09-01 93.00 0.84 0.15 ok
7KTS_S Q15393 Splicing factor 3B subunit 3 EM 19.09 2020-11-24 92.25 0.84 0.15 ok
7PFO_A P56282 DNA polymerase epsilon subunit 2 EM 3.20 2021-08-11 93.00 0.84 0.15 ok
7KMR_A P01116 Isoform 2B of GTPase KRas X-ray 1.51 2020-11-03 91.50 0.85 0.13 ok
7KTS_E Q9HBM6 Transcription initiation factor TFIID subu EM 19.09 2020-11-24 66.56 0.81 0.13 ok
7KTR_E Q9HBM6 Transcription initiation factor TFIID subu EM 2.93 2020-11-24 66.56 0.81 0.13 ok
7N72_A Q9NQ11 Isoform 3 of Polyamine-transporting ATPase EM 2.50 2021-06-09 79.62 0.84 0.13 ok
7N78_A Q9NQ11 Isoform 3 of Polyamine-transporting ATPase EM 3.00 2021-06-09 79.62 0.85 0.12 ok
7KTS_H Q12962 Transcription initiation factor TFIID subu EM 19.09 2020-11-24 66.88 0.82 0.12 ok
7KTR_H Q12962 Transcription initiation factor TFIID subu EM 2.93 2020-11-24 66.88 0.82 0.12 ok
7OPL_A P09884 DNA polymerase alpha catalytic subunit EM 4.12 2021-06-01 75.81 0.85 0.12 ok
7PLO_S Q13617 Cullin-2 EM 2.80 2021-09-01 85.75 0.87 0.11 ok
7PLO_3 P25205 DNA replication licensing factor MCM3 EM 2.80 2021-09-01 74.12 0.86 0.11 ok
7PFO_3 P25205 DNA replication licensing factor MCM3 EM 3.20 2021-08-11 74.12 0.87 0.10 ok
7PLO_7 P33993 DNA replication licensing factor MCM7 EM 2.80 2021-09-01 80.44 0.88 0.10 ok
7NA3_A Q00987 Isoform 11 of E3 ubiquitin-protein ligase X-ray 2.21 2021-06-19 62.59 0.84 0.10 ok
7KTS_D O94864 STAGA complex 65 subunit gamma, DhaA,STAGA EM 19.09 2020-11-24 64.94 0.85 0.10 ok
7KTR_D O94864 STAGA complex 65 subunit gamma,DhaA,STAGA EM 2.93 2020-11-24 64.94 0.85 0.10 ok
7NA4_A Q00987 Isoform 11 of E3 ubiquitin-protein ligase X-ray 1.84 2021-06-19 62.59 0.85 0.10 ok
7E72_E Q02763 Angiopoietin-1 receptor X-ray 2.09 2021-02-25 83.94 0.89 0.09 ok
7PLO_B Q07864 DNA polymerase epsilon catalytic subunit A EM 2.80 2021-09-01 79.75 0.89 0.09 ok
7PFO_4 P33991 DNA replication licensing factor MCM4 EM 3.20 2021-08-11 73.56 0.88 0.09 ok
7OBM_A Q4J6C6 Prolyl endopeptidase-like X-ray 3.10 2021-04-22 82.75 0.89 0.09 ok
7PLO_4 P33991 DNA replication licensing factor MCM4 EM 2.80 2021-09-01 73.56 0.88 0.09 ok
7PFO_7 P33993 DNA replication licensing factor MCM7 EM 3.20 2021-08-11 80.44 0.90 0.08 ok
7PFO_B Q07864 DNA polymerase epsilon catalytic subunit A EM 3.20 2021-08-11 79.75 0.90 0.08 ok
7KTS_T Q9BWJ5 Splicing factor 3B subunit 5 EM 19.09 2020-11-24 91.62 0.92 0.08 ok
7PLO_R Q15369 Elongin-C EM 2.80 2021-09-01 89.81 0.92 0.07 ok
7NA2_A Q00987 Isoform 11 of E3 ubiquitin-protein ligase X-ray 1.86 2021-06-19 62.59 0.88 0.07 ok
7M72_D K7N5M4 NKT Vbeta8.2 (Mouse)-2C12 TCR,Human nkt tc X-ray 2.40 2021-03-26 90.94 0.92 0.07 ok
7N75_A Q9NQ11 Isoform 3 of Polyamine-transporting ATPase EM 2.90 2021-06-09 79.62 0.91 0.07 ok
7M72_C K7N5N2 NKT Valpha14 (Mouse)-2C12 TCR,Human T-cell X-ray 2.40 2021-03-26 91.50 0.92 0.07 ok
7KTR_F Q9Y6J9 TAF6-like RNA polymerase II p300/CBP-assoc EM 2.93 2020-11-24 67.88 0.89 0.07 ok
7MGK_A Q59H18 Serine/threonine-protein kinase TNNI3K X-ray 3.10 2021-04-12 79.62 0.91 0.07 ok
7MYO_B P27986 Phosphatidylinositol 3-kinase regulatory s EM 2.92 2021-05-21 83.19 0.92 0.07 ok
7MN8_H Q02297 Isoform 6 of Pro-neuregulin-1, membrane-bo EM 3.45 2021-04-30 56.66 0.89 0.06 ok
7PLO_F Q9BRX5 DNA replication complex GINS protein PSF3 EM 2.80 2021-09-01 87.44 0.93 0.06 ok
7MGJ_A Q59H18 Serine/threonine-protein kinase TNNI3K X-ray 2.95 2021-04-12 79.62 0.92 0.06 ok
7E8D_C P0C0S8 Histone H2A type 1 EM 2.80 2021-03-01 91.12 0.93 0.06 ok
7PLO_D Q14691 DNA replication complex GINS protein PSF1 EM 2.80 2021-09-01 93.00 0.93 0.06 ok
7PFO_D Q14691 DNA replication complex GINS protein PSF1 EM 3.20 2021-08-11 93.00 0.94 0.06 ok
6WS4_A P01116 GTPase KRas X-ray 1.84 2020-04-30 91.50 0.94 0.06 ok
7PFO_F Q9BRX5 DNA replication complex GINS protein PSF3 EM 3.20 2021-08-11 87.44 0.93 0.06 ok
6WS2_A P01116 GTPase KRas X-ray 1.59 2020-04-30 91.50 0.94 0.06 ok
7N77_A Q9NQ11 Isoform 3 of Polyamine-transporting ATPase EM 3.20 2021-06-09 79.62 0.93 0.06 ok
7N74_A Q9NQ11 Isoform 3 of Polyamine-transporting ATPase EM 2.80 2021-06-09 79.62 0.93 0.05 ok
7PLO_L Q9BVW5 TIMELESS-interacting protein EM 2.80 2021-09-01 66.88 0.92 0.05 ok
7PFO_L Q9BVW5 TIMELESS-interacting protein EM 3.20 2021-08-11 66.88 0.92 0.05 ok
7N73_A Q9NQ11 Isoform 3 of Polyamine-transporting ATPase EM 2.90 2021-06-09 79.62 0.94 0.05 ok
7N76_A Q9NQ11 Isoform 3 of Polyamine-transporting ATPase EM 2.90 2021-06-09 79.62 0.94 0.05 ok
7BEE_C Q96A83 21er collagen model peptide X-ray 1.94 2020-12-23 100.00 novel 72.19 0.41 0.99 90.00 1.01 0.04 wrong
7BDU_C Q96A83 21er collagen model peptide X-ray 2.49 2020-12-22 100.00 novel 71.25 0.49 1.00 90.00 1.11 0.04 wrong
7LEW_A P60604 Ubiquitin-conjugating enzyme E2 G2 X-ray 1.74 2021-01-15 94.44 0.96 0.04 ok
7PLO_E Q9Y248 DNA replication complex GINS protein PSF2 EM 2.80 2021-09-01 93.12 0.96 0.04 ok
7OPL_D P49643 DNA primase large subunit EM 4.12 2021-06-01 80.62 0.96 0.04 ok
7PLO_G Q9BRT9 DNA replication complex GINS protein SLD5 EM 2.80 2021-09-01 90.38 0.96 0.04 ok
7PFO_E Q9Y248 DNA replication complex GINS protein PSF2 EM 3.20 2021-08-11 93.12 0.96 0.03 ok
7PFO_G Q9BRT9 DNA replication complex GINS protein SLD5 EM 3.20 2021-08-11 90.38 0.96 0.03 ok
7NV0_A Q9UBT6 DNA polymerase kappa EM 3.40 2021-03-15 70.50 0.95 0.03 ok
7KF0_C P15692 Isoform L-VEGF206 of Vascular endothelial X-ray 2.32 2020-10-13 63.91 0.95 0.03 ok
7NA1_A Q00987 E3 ubiquitin-protein ligase Mdm2 X-ray 2.30 2021-06-19 62.59 0.95 0.03 ok
7MYN_B P27986 Phosphatidylinositol 3-kinase regulatory s EM 2.79 2021-05-21 83.19 0.96 0.03 ok
7FBP_A P00748 Coagulation factor XIIa light chain X-ray 1.99 2021-07-12 76.31 0.96 0.03 ok
7KFA_B Q8NBP7 Proprotein convertase subtilisin/kexin typ X-ray 2.45 2020-10-13 85.19 0.97 0.03 ok
7OPL_B Q14181 DNA polymerase alpha subunit B EM 4.12 2021-06-01 84.75 0.97 0.03 ok
7PFO_K Q9UNS1 Protein timeless homolog EM 3.20 2021-08-11 74.19 0.97 0.03 ok
7PLO_K Q9UNS1 Protein timeless homolog EM 2.80 2021-09-01 74.19 0.97 0.02 ok
7E8D_K O96028 Histone-lysine N-methyltransferase NSD2 EM 2.80 2021-03-01 65.62 0.97 0.02 ok
7BFI_E Q96A83 15R8 collagen model peptide X-ray 2.44 2021-01-03 72.71 0.67 0.99 100.00 0.47 0.02 ok
7NV0_B P12004 Proliferating cell nuclear antigen EM 3.40 2021-03-15 94.31 0.98 0.02 ok
7OPL_C P49642 DNA primase small subunit EM 4.12 2021-06-01 92.69 0.98 0.02 ok
7KEZ_V P15692 Isoform L-VEGF206 of Vascular endothelial X-ray 2.31 2020-10-13 63.91 0.97 0.02 ok
7PLO_H O75717 WD repeat and HMG-box DNA-binding protein EM 2.80 2021-09-01 74.50 0.97 0.02 ok
7PLO_C O75419 Cell division control protein 45 homolog EM 2.80 2021-09-01 92.56 0.98 0.02 ok
7PFO_C O75419 Cell division control protein 45 homolog EM 3.20 2021-08-11 92.56 0.98 0.02 ok
7RUO_A Q8TED0 U3 small nucleolar RNA-associated protein X-ray 1.80 2021-08-17 82.38 0.98 0.02 ok
7KF1_C P15692 Isoform L-VEGF206 of Vascular endothelial X-ray 2.45 2020-10-13 63.91 0.97 0.02 ok
7MYO_A P42336 Phosphatidylinositol 4,5-bisphosphate 3-ki EM 2.92 2021-05-21 92.38 0.98 0.02 ok
7E8D_B P62805 Histone H4 EM 2.80 2021-03-01 89.81 0.98 0.01 ok
7E8D_D P06899 Histone H2B type 1-J EM 2.80 2021-03-01 85.50 0.99 0.01 ok
7APQ_A Q13451 Peptidyl-prolyl cis-trans isomerase FKBP5 X-ray 1.09 2020-10-19 92.50 0.99 0.01 ok
7APW_A Q13451 Peptidyl-prolyl cis-trans isomerase FKBP5 X-ray 0.89 2020-10-20 92.50 0.99 0.01 ok
7DG4_A Q92630 Dual specificity tyrosine-phosphorylation- X-ray 2.58 2020-11-10 75.56 0.99 0.01 ok
7PFO_H O75717 WD repeat and HMG-box DNA-binding protein EM 3.20 2021-08-11 74.50 0.99 0.01 ok
7APT_A Q13451 Peptidyl-prolyl cis-trans isomerase FKBP5 X-ray 1.13 2020-10-19 92.50 0.99 0.01 ok
7E8D_A P68431 Histone H3.1 EM 2.80 2021-03-01 86.06 0.99 0.01 ok
7MYN_A P42336 Phosphatidylinositol 4,5-bisphosphate 3-ki EM 2.79 2021-05-21 92.38 0.99 0.01 ok
7RXX_A P31153 S-adenosylmethionine synthase isoform type X-ray 1.25 2021-08-23 96.06 0.99 0.01 ok
7RXW_A P31153 S-adenosylmethionine synthase isoform type X-ray 1.07 2021-08-23 96.06 0.99 0.01 ok
7KFA_A Q8NBP7 Proprotein convertase subtilisin/kexin typ X-ray 2.45 2020-10-13 85.19 0.99 0.01 ok
7KZG_A O95243 Methyl-CpG-binding domain protein 4 X-ray 1.68 2020-12-10 59.59 0.99 0.00 ok
7KZ0_A O95243 Methyl-CpG-binding domain protein 4 X-ray 1.57 2020-12-09 59.59 0.99 0.00 ok
7EVT_A P15104 Glutamine synthetase X-ray 2.95 2021-05-22 97.50 1.00 0.00 ok
7KZ1_A O95243 Methyl-CpG-binding domain protein 4 X-ray 1.62 2020-12-09 59.59 0.99 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.