Live Stats, next update: Wed 09 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2022-02-16

107
structures analysed (33 full · 30.8%)
32.8%
confidently wrong
21.9%
novel sequences
00.0%
novel & wrong
0.935
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 3 of 107 structures (2.8%) are confidently wrong; median TM-score is 0.935.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.935 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7VBC_I Q9P1U0 DNA-directed RNA polymerase I subunit RPA1 EM 3.01 2021-08-31 62.80 85.45 0.40 0.54 3.50 18.00 0.73 wrong
7QIV_B P01024 Complement C3b alpha' chain X-ray 2.80 2021-12-16 0.00 79.47 0.46 0.80 0.66 27.15 0.69 wrong
7VBA_I Q9P1U0 DNA-directed RNA polymerase I subunit RPA1 EM 2.89 2021-08-31 62.80 83.92 0.52 0.38 2.08 13.48 0.68 ok
7QK5_A P10636 Microtubule-associated protein tau EM 1.92 2021-12-17 0.00 68.24 0.25 0.47 0.00 24.51 0.67 ok
7QJV_A P10636 Microtubule-associated protein tau EM 3.29 2021-12-17 0.00 67.87 0.28 0.46 0.00 25.36 0.67 ok
7QL4_A P10636 Microtubule-associated protein tau EM 3.20 2021-12-19 0.00 67.86 0.27 0.46 0.00 25.22 0.67 ok
7QKK_A P10636 Microtubule-associated protein tau EM 2.80 2021-12-17 0.00 67.86 0.27 0.46 0.00 24.91 0.66 ok
7QKU_A P10636 Microtubule-associated protein tau EM 2.57 2021-12-19 0.00 67.86 0.28 0.46 0.00 24.57 0.66 ok
7QK1_A P10636 Microtubule-associated protein tau EM 3.03 2021-12-17 0.00 67.98 0.25 0.47 0.00 24.57 0.66 ok
7QKI_A P10636 Microtubule-associated protein tau EM 3.13 2021-12-17 0.00 67.86 0.24 0.45 0.00 25.10 0.66 ok
7QJZ_A P10636 Microtubule-associated protein tau EM 3.40 2021-12-17 0.00 67.99 0.26 0.46 0.00 24.28 0.66 ok
7QL1_A P10636 Microtubule-associated protein tau EM 3.34 2021-12-19 0.00 68.26 0.25 0.47 0.68 23.96 0.65 ok
7QKL_A P10636 Microtubule-associated protein tau EM 2.07 2021-12-17 0.00 67.86 0.24 0.48 0.00 24.34 0.65 ok
7QKV_A P10636 Microtubule-associated protein tau EM 3.23 2021-12-19 0.00 68.39 0.24 0.45 0.36 23.63 0.65 ok
7QKX_A P10636 Microtubule-associated protein tau EM 3.16 2021-12-19 0.00 68.26 0.27 0.45 0.68 23.91 0.65 ok
7QL0_A P10636 Microtubule-associated protein tau EM 3.13 2021-12-19 0.00 68.39 0.24 0.45 0.72 23.47 0.65 ok
7QK2_A P10636 Microtubule-associated protein tau EM 2.61 2021-12-17 0.00 68.38 0.26 0.48 0.70 22.64 0.64 ok
7QKF_A P10636 Microtubule-associated protein tau EM 2.83 2021-12-17 0.00 68.01 0.29 0.54 1.44 20.62 0.63 ok
7QJY_A P10636 Microtubule-associated protein tau EM 3.14 2021-12-17 0.00 67.98 0.24 0.49 1.33 23.43 0.63 ok
7QL3_A P10636 Microtubule-associated protein tau EM 3.32 2021-12-19 0.00 68.38 0.26 0.46 0.35 22.75 0.62 ok
7QKM_A P10636 Microtubule-associated protein tau EM 2.66 2021-12-17 0.00 63.64 0.25 0.48 1.82 20.66 0.58 ok
7QKY_A P10636 Microtubule-associated protein tau EM 1.86 2021-12-19 0.00 59.05 0.26 0.48 0.76 18.33 0.55 ok
7QK3_A P10636 Microtubule-associated protein tau EM 2.44 2021-12-17 0.00 63.72 0.26 0.45 2.05 18.55 0.54 ok
7QL2_A P10636 Microtubule-associated protein tau EM 2.95 2021-12-19 0.00 63.87 0.26 0.47 4.50 17.22 0.52 ok
7QGL_A P21589 5'-nucleotidase X-ray 1.50 2021-12-08 0.40 96.27 0.69 0.93 25.19 11.56 0.49 ok
7QGA_A P21589 5'-nucleotidase X-ray 1.50 2021-12-07 0.40 96.27 0.69 0.93 25.14 11.55 0.49 ok
7QKW_A P10636 Microtubule-associated protein tau EM 2.32 2021-12-19 0.00 63.69 0.30 0.52 6.02 12.55 0.48 ok
7QKG_A P10636 Microtubule-associated protein tau EM 3.36 2021-12-17 0.00 63.69 0.28 0.54 6.48 12.29 0.46 ok
7QK6_A P10636 Microtubule-associated protein tau EM 2.27 2021-12-17 0.00 63.69 0.24 0.52 7.87 11.29 0.44 ok
7VBC_N O15446 DNA-directed RNA polymerase I subunit RPA3 EM 3.01 2021-08-31 100.00 novel 86.00 0.70 0.85 32.12 8.25 0.34 ok
7VBA_N O15446 DNA-directed RNA polymerase I subunit RPA3 EM 2.89 2021-08-31 100.00 novel 86.00 0.70 0.85 32.12 8.25 0.34 ok
7NPQ_A P49913 Cathelicidin antimicrobial peptide X-ray 1.50 2021-02-28 80.00 0.71 0.23 ok
7LO0_I Q86UE8 Serine/threonine-protein kinase tousled-li X-ray 2.71 2021-02-08 71.62 0.72 0.20 ok
7VBC_L P53803 DNA-directed RNA polymerases I, II, and II EM 3.01 2021-08-31 85.75 0.77 0.20 ok
7VBA_L P53803 DNA-directed RNA polymerases I, II, and II EM 2.89 2021-08-31 85.75 0.77 0.20 ok
7VBC_G Q3B726 DNA-directed RNA polymerase I subunit RPA4 EM 3.01 2021-08-31 68.19 0.73 0.18 ok
7VBA_G Q3B726 DNA-directed RNA polymerase I subunit RPA4 EM 2.89 2021-08-31 68.19 0.73 0.18 ok
7QKZ_A P10636 Microtubule-associated protein tau EM 2.65 2021-12-19 0.00 70.72 0.29 0.73 43.18 3.73 0.16 wrong
7W72_K Q92643 GPI-anchor transamidase EM 3.10 2021-12-02 85.06 0.82 0.16 ok
7VR9_A P02768 Serum albumin X-ray 2.30 2021-10-22 92.69 0.85 0.14 ok
7F6V_A Q9BXJ8 Ion channel TACAN EM 3.66 2021-06-25 89.25 0.86 0.13 ok
7T1Z_C P01106 Myc proto-oncogene N terminal degron X-ray 2.77 2021-12-02 0.00 63.84 0.30 0.71 60.42 2.54 0.10 ok
7W72_S Q96S52 GPI transamidase component PIG-S EM 3.10 2021-12-02 85.50 0.89 0.09 ok
7VBA_M Q9GZS1 DNA-directed RNA polymerase I subunit RPA4 EM 2.89 2021-08-31 82.69 0.92 0.07 ok
7VBC_M Q9GZS1 DNA-directed RNA polymerase I subunit RPA4 EM 3.01 2021-08-31 82.69 0.92 0.07 ok
7T1Z_A P63208 S-phase kinase-associated protein 1 X-ray 2.77 2021-12-02 90.12 0.92 0.07 ok
7W72_T Q969N2 GPI transamidase component PIG-T EM 3.10 2021-12-02 87.25 0.92 0.07 ok
7T1Y_A P63208 S-phase kinase-associated protein 1 X-ray 2.55 2021-12-02 90.12 0.93 0.06 ok
7VGF_A O75027 Iron-sulfur clusters transporter ABCB7, mi EM 3.30 2021-09-16 78.12 0.93 0.06 ok
7VBC_K P0DPB6 DNA-directed RNA polymerases I and III sub EM 3.01 2021-08-31 86.38 0.94 0.05 ok
7VBA_K P0DPB6 DNA-directed RNA polymerases I and III sub EM 2.89 2021-08-31 86.38 0.94 0.05 ok
7TVD_A P00533 Epidermal growth factor receptor X-ray 2.96 2022-02-04 75.94 0.93 0.05 ok
7VBC_F P61218 DNA-directed RNA polymerases I, II, and II EM 3.01 2021-08-31 78.44 0.94 0.05 ok
7VBA_F P61218 DNA-directed RNA polymerases I, II, and II EM 2.89 2021-08-31 78.44 0.94 0.05 ok
7LQ1_B P27986 Phosphatidylinositol 3-kinase regulatory s X-ray 2.96 2021-02-12 83.19 0.94 0.05 ok
7WSV_A Q96RD7 Pannexin-1 EM 4.50 2022-02-01 74.31 0.93 0.05 ok
7VBA_J P62875 DNA-directed RNA polymerases I, II, and II EM 2.89 2021-08-31 92.94 0.95 0.05 ok
7VBC_J P62875 DNA-directed RNA polymerases I, II, and II EM 3.01 2021-08-31 92.94 0.95 0.04 ok
7VBC_H P52434 DNA-directed RNA polymerases I, II, and II EM 3.01 2021-08-31 84.25 0.95 0.04 ok
7VBA_H P52434 DNA-directed RNA polymerases I, II, and II EM 2.89 2021-08-31 84.25 0.95 0.04 ok
7EVJ_A Q92793 CREB-binding protein X-ray 2.57 2021-05-21 52.53 0.92 0.04 ok
7VBC_A O95602 DNA-directed RNA polymerase I subunit RPA1 EM 3.01 2021-08-31 80.12 0.95 0.04 ok
7VBA_A O95602 DNA-directed RNA polymerase I subunit RPA1 EM 2.89 2021-08-31 80.12 0.95 0.04 ok
7LQD_A P33981 Dual specificity protein kinase TTK or mon X-ray 1.95 2021-02-13 63.44 0.95 0.03 ok
7QGM_A P21589 5'-nucleotidase X-ray 2.90 2021-12-08 91.88 0.97 0.03 ok
7QGO_A P21589 5'-nucleotidase X-ray 2.21 2021-12-09 91.88 0.97 0.03 ok
7VBX_A Q15119 [Pyruvate dehydrogenase (acetyl-transferri X-ray 2.60 2021-09-01 90.75 0.97 0.03 ok
7T1Z_B Q969H0 F-box/WD repeat-containing protein 7 X-ray 2.77 2021-12-02 77.00 0.97 0.03 ok
7T1Y_B Q969H0 F-box/WD repeat-containing protein 7 X-ray 2.55 2021-12-02 77.00 0.97 0.02 ok
7VBU_A Q15119 [Pyruvate dehydrogenase (acetyl-transferri X-ray 1.89 2021-09-01 90.75 0.97 0.02 ok
7VBV_A Q15119 [Pyruvate dehydrogenase (acetyl-transferri X-ray 2.21 2021-09-01 90.75 0.97 0.02 ok
7VBC_E P19388 DNA-directed RNA polymerases I, II, and II EM 3.01 2021-08-31 93.06 0.98 0.02 ok
7VBA_E P19388 DNA-directed RNA polymerases I, II, and II EM 2.89 2021-08-31 93.06 0.98 0.02 ok
7VBC_C O15160 DNA-directed RNA polymerases I and III sub EM 3.01 2021-08-31 92.12 0.98 0.02 ok
7VBA_C O15160 DNA-directed RNA polymerases I and III sub EM 2.89 2021-08-31 92.12 0.98 0.02 ok
7LQ1_A O00329 Phosphatidylinositol 4,5-bisphosphate 3-ki X-ray 2.96 2021-02-12 87.94 0.98 0.02 ok
7QIV_A P01024 Complement C3 beta chain X-ray 2.80 2021-12-16 79.75 0.97 0.02 ok
7E50_B P00747 Plasminogen X-ray 1.95 2021-02-16 82.81 0.98 0.02 ok
7VBA_B Q9H9Y6 DNA-directed RNA polymerase I subunit RPA2 EM 2.89 2021-08-31 92.19 0.98 0.02 ok
7LNY_A Q9Y294 Histone chaperone ASF1A X-ray 2.10 2021-02-08 84.12 0.98 0.02 ok
7V1Z_A P83111 Serine beta-lactamase-like protein LACTB, EM 2.98 2021-08-07 78.94 0.98 0.01 ok
7W72_A O43292 Glycosylphosphatidylinositol anchor attach EM 3.10 2021-12-02 87.25 0.98 0.01 ok
7PRM_A Q99685 Monoglyceride lipase X-ray 1.65 2021-09-22 93.88 0.99 0.01 ok
7V1Y_A P83111 Serine beta-lactamase-like protein LACTB, EM 2.82 2021-08-07 78.94 0.98 0.01 ok
7VBC_B Q9H9Y6 DNA-directed RNA polymerase I subunit RPA2 EM 3.01 2021-08-31 92.19 0.99 0.01 ok
7V21_A P83111 Serine beta-lactamase-like protein LACTB, EM 3.08 2021-08-07 78.94 0.99 0.01 ok
7W72_U Q9H490 Phosphatidylinositol glycan anchor biosynt EM 3.10 2021-12-02 92.69 0.99 0.01 ok
7F0M_A Q13526 Peptidyl-prolyl cis-trans isomerase NIMA-i X-ray 1.90 2021-06-05 91.62 0.99 0.01 ok
7EAX_A P04637 Cellular tumor antigen p53 X-ray 2.55 2021-03-08 75.06 0.99 0.01 ok
7Q27_A P12821 Angiotensin-converting enzyme X-ray 1.50 2021-10-23 90.94 0.99 0.01 ok
7Q29_A P12821 Angiotensin-converting enzyme X-ray 1.60 2021-10-23 90.94 0.99 0.01 ok
7Q28_A P12821 Angiotensin-converting enzyme X-ray 1.65 2021-10-23 90.94 0.99 0.01 ok
7LO0_A Q9Y294 Histone chaperone ASF1A X-ray 2.71 2021-02-08 84.12 0.99 0.01 ok
7EFX_A Q13526 Peptidyl-prolyl cis-trans isomerase NIMA-i X-ray 2.41 2021-03-23 91.62 0.99 0.01 ok
7EFJ_A Q13526 Peptidyl-prolyl cis-trans isomerase NIMA-i X-ray 1.99 2021-03-21 91.62 0.99 0.01 ok
7EKV_A Q13526 Peptidyl-prolyl cis-trans isomerase NIMA-i X-ray 1.95 2021-04-06 91.62 0.99 0.01 ok
7RRL_A P40925 Malate dehydrogenase, cytoplasmic X-ray 2.05 2021-08-09 96.81 1.00 0.00 ok
7LQ0_A O43414 ERI1 exoribonuclease 3 X-ray 1.60 2021-02-12 73.75 0.99 0.00 ok
7LPZ_A O43414 ERI1 exoribonuclease 3 X-ray 1.55 2021-02-12 73.75 0.99 0.00 ok
7LPY_A O43414 ERI1 exoribonuclease 3 X-ray 1.85 2021-02-12 73.75 0.99 0.00 ok
7Q24_A P12821 Angiotensin-converting enzyme X-ray 2.00 2021-10-23 90.94 1.00 0.00 ok
7LK1_A P04181 Ornithine aminotransferase, mitochondrial X-ray 1.79 2021-02-01 94.06 1.00 0.00 ok
7Q25_A P12821 Angiotensin-converting enzyme X-ray 1.60 2021-10-23 90.94 1.00 0.00 ok
7LK0_A P04181 Ornithine aminotransferase, mitochondrial X-ray 1.96 2021-02-01 94.06 1.00 0.00 ok
7Q26_A P12821 Angiotensin-converting enzyme X-ray 1.70 2021-10-23 90.94 1.00 0.00 ok
7E3D_A P22303 Acetylcholinesterase X-ray 2.50 2021-02-08 92.94 1.00 0.00 ok
7E3H_A P22303 Acetylcholinesterase X-ray 2.45 2021-02-08 92.94 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.