Live Stats, next update: Wed 09 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2022-03-16

127
structures analysed (34 full · 26.8%)
86.3%
confidently wrong
00.0%
novel sequences
00.0%
novel & wrong
0.957
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 8 of 127 structures (6.3%) are confidently wrong; median TM-score is 0.957.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.957 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7PFP_A P07911 Uromodulin EM 6.10 2021-08-11 2.20 87.44 0.38 0.79 0.22 32.96 0.86 wrong
7MQR_E P06213 Isoform Short of Insulin receptor EM 4.10 2021-05-06 0.20 87.54 0.48 0.85 0.09 20.08 0.82 wrong
7MQO_E P06213 Isoform Short of Insulin receptor EM 3.40 2021-05-06 0.20 87.17 0.58 0.82 5.36 18.38 0.68 ok
7QBF_C Q9NPF0 CD320 antigen X-ray 1.85 2021-11-19 0.00 85.95 0.48 0.96 10.26 11.83 0.58 wrong
7QBG_B Q9NPF0 CD320 antigen X-ray 2.69 2021-11-19 0.00 83.24 0.45 0.89 10.00 11.77 0.57 wrong
7QBD_C Q9NPF0 CD320 antigen X-ray 4.18 2021-11-19 0.00 86.61 0.47 0.90 10.86 11.20 0.57 wrong
7NSG_A P43005 Excitatory amino acid transporter 3 EM 3.34 2021-03-05 38.20 88.78 0.62 0.79 10.06 10.51 0.56 ok
7QBE_B Q9NPF0 CD320 antigen X-ray 3.00 2021-11-19 0.00 85.16 0.46 0.89 11.25 11.12 0.56 wrong
7QPG_R P50748 Kinetochore-associated protein 1 EM 3.90 2022-01-04 71.50 0.24 0.55 wrong
7QWQ_u P20290 Isoform 2 of Transcription factor BTF3 EM 2.83 2022-01-25 72.62 0.46 0.39 wrong
7Q3N_U P07911 Uromodulin EM 7.40 2021-10-28 2.10 87.06 0.70 0.76 24.83 7.75 0.36 ok
7QPG_W O43264 Centromere/kinetochore protein zw10 homolo EM 3.90 2022-01-04 81.25 0.60 0.33 ok
7Q1L_A P02787 Serotransferrin X-ray 3.00 2021-10-20 93.12 0.71 0.27 ok
7QI2_A P21796 Voltage-dependent anion-selective channel NMR 2021-12-14 93.06 0.74 0.24 ok
7WI6_A Q14832 Metabotropic glutamate receptor 3 EM 3.71 2022-01-03 85.31 0.74 0.22 ok
7TBH_a P16220 LEU-SER-ARG-ARG-PRO-SEP-TYR-ARG-LYS-ILE-LE EM 2.30 2021-12-22 67.14 0.54 0.69 34.21 4.65 0.20 ok
7MQS_E P06213 Isoform Short of Insulin receptor EM 4.40 2021-05-06 77.62 0.78 0.17 ok
7WI8_A Q14832 Metabotropic glutamate receptor 3 EM 4.17 2022-01-03 85.31 0.80 0.17 ok
7QWQ_t Q13765 Nascent polypeptide-associated complex sub EM 2.83 2022-01-25 72.69 0.77 0.16 ok
7QWQ_x P61011 Signal recognition particle 54 kDa protein EM 2.83 2022-01-25 79.25 0.82 0.14 ok
7MQR_A P01308 Insulin A chain EM 4.10 2021-05-06 4.60 51.25 0.21 0.50 46.43 4.83 0.13 ok
7MQO_A P01308 Insulin A chain EM 3.40 2021-05-06 4.60 51.25 0.22 0.49 47.62 4.67 0.13 ok
7TPS_D Q9NZQ7 Programmed cell death 1 ligand 1 X-ray 3.15 2022-01-26 88.25 0.86 0.13 ok
7QO6_9 J3QS39 Polyubiquitin-B EM 6.30 2021-12-23 93.25 0.88 0.12 ok
7S58_E P80098 C-C motif chemokine 7 X-ray 1.82 2021-09-10 84.94 0.87 0.11 ok
7WIH_A Q14832 Metabotropic glutamate receptor 3 EM 3.68 2022-01-03 85.31 0.88 0.10 ok
7MRJ_A A0A2R8Y7D0 Ubiquitin domain-containing protein TINCR X-ray 2.12 2021-05-07 76.94 0.87 0.10 ok
7MQS_A P01308 Insulin A chain EM 4.40 2021-05-06 4.60 51.25 0.37 0.54 58.33 3.61 0.10 ok
7MQO_B P01308 Insulin B chain EM 3.40 2021-05-06 9.10 50.40 0.42 0.60 52.78 3.11 0.10 ok
7U47_D P62807 Histone H2B type 1-C/E/F/G/I EM 7.50 2022-02-28 88.12 0.89 0.09 ok
7U46_D P62807 Histone H2B type 1-C/E/F/G/I EM 2.68 2022-02-28 88.12 0.89 0.09 ok
7MQR_B P01308 Insulin B chain EM 4.10 2021-05-06 9.10 50.40 0.36 0.63 52.78 3.00 0.09 ok
7OFI_C Q15596 Nuclear receptor coactivator 2 X-ray 1.95 2021-05-05 65.54 0.63 0.70 68.75 2.63 0.09 ok
7QO5_9 P0CG47 Polyubiquitin-B EM 6.00 2021-12-23 93.44 0.90 0.09 ok
7OFK_C Q15596 Nuclear receptor coactivator 2 X-ray 1.61 2021-05-05 65.54 0.63 0.70 70.83 2.58 0.09 ok
7MQS_B P01308 Insulin B chain EM 4.40 2021-05-06 9.10 51.29 0.47 0.63 62.50 2.26 0.07 ok
7SO0_B P13500 C-C motif chemokine 2 X-ray 1.74 2021-10-28 86.94 0.92 0.07 ok
7S4N_B Q92583 C-C motif chemokine 17 X-ray 1.65 2021-09-09 89.31 0.92 0.07 ok
7RA9_A P60568 Interleukin-2 X-ray 2.20 2021-06-30 84.12 0.93 0.06 ok
7MQZ_A Q96BR5 Cytochrome c oxidase assembly factor 7 X-ray 2.39 2021-05-07 95.31 0.94 0.06 ok
7PU5_B P23246 Splicing factor, proline- and glutamine-ri X-ray 3.00 2021-09-28 67.62 0.92 0.06 ok
7LZ5_A P01116 Isoform 2B of GTPase KRas X-ray 1.50 2021-03-09 91.50 0.95 0.05 ok
7RP2_A P01116 GTPase KRas X-ray 2.20 2021-08-03 91.50 0.95 0.05 ok
7PU5_A Q15233 Non-POU domain-containing octamer-binding X-ray 3.00 2021-09-28 76.75 0.94 0.05 ok
7P6S_A P55259 Isoform Alpha of Pancreatic secretory gran X-ray 1.35 2021-07-17 78.62 0.94 0.05 ok
7P6R_A P55259 Isoform Alpha of Pancreatic secretory gran X-ray 1.90 2021-07-17 78.62 0.94 0.05 ok
7MDP_A P01116 Isoform 2B of GTPase KRas X-ray 1.96 2021-04-05 91.50 0.95 0.05 ok
5SCL_A P30613 Pyruvate kinase X-ray 2.13 2021-12-01 18.30 96.32 0.99 0.96 96.19 2.36 0.04 ok
7RP3_A P01116 Isoform 2B of GTPase KRas X-ray 2.00 2021-08-03 91.50 0.95 0.04 ok
5SCI_A P30613 Pyruvate kinase X-ray 2.15 2021-12-01 18.30 95.98 0.99 0.96 96.56 2.35 0.04 ok
5SCC_A P30613 Pyruvate kinase X-ray 1.89 2021-12-01 18.30 96.34 0.99 0.96 96.12 2.34 0.04 ok
5SCB_A P30613 Pyruvate kinase X-ray 1.80 2021-12-01 18.30 96.34 0.99 0.97 97.02 2.33 0.04 ok
5SCA_A P30613 Pyruvate kinase X-ray 1.92 2021-12-01 18.30 96.34 0.99 0.97 97.32 2.33 0.04 ok
7LZR_A P41182 B-cell lymphoma 6 protein X-ray 1.34 2021-03-10 52.06 0.92 0.04 ok
5SCJ_A P30613 Pyruvate kinase X-ray 2.35 2021-12-01 18.30 95.98 0.99 0.96 97.16 2.35 0.04 ok
5SDT_A P30613 Pyruvate kinase X-ray 1.94 2022-01-20 18.30 96.34 0.99 0.97 97.08 2.29 0.04 ok
5SC8_A P30613 Pyruvate kinase X-ray 1.77 2021-12-01 18.30 96.34 0.99 0.97 97.02 2.30 0.04 ok
7TPS_B Q9NZQ7 Programmed cell death 1 ligand 1 X-ray 3.15 2022-01-26 88.25 0.95 0.04 ok
7T47_A P01116 GTPase KRas X-ray 1.27 2021-12-09 91.50 0.95 0.04 ok
7QWQ_q P09132 Signal recognition particle 19 kDa protein EM 2.83 2022-01-25 85.81 0.95 0.04 ok
7S7L_A P08254 Stromelysin-1 X-ray 2.34 2021-09-16 85.69 0.95 0.04 ok
7QWQ_v Q9UHB9 Signal recognition particle subunit SRP68 EM 2.83 2022-01-25 78.69 0.95 0.04 ok
7U47_C Q93077 Histone H2A EM 7.50 2022-02-28 91.00 0.96 0.04 ok
7U46_C Q93077 Histone H2A EM 2.68 2022-02-28 91.00 0.96 0.04 ok
7P6T_A P55259 Isoform Alpha of Pancreatic secretory gran X-ray 1.40 2021-07-17 78.62 0.95 0.04 ok
5SCD_A P30613 Pyruvate kinase X-ray 2.04 2021-12-01 18.30 96.34 0.99 0.97 97.43 2.06 0.04 ok
7LZS_A P41182 B-cell lymphoma 6 protein X-ray 1.49 2021-03-10 52.06 0.93 0.04 ok
5SCK_A P30613 Pyruvate kinase X-ray 1.72 2021-12-01 18.30 96.34 0.99 0.97 97.49 1.96 0.04 ok
5SCE_A P30613 Pyruvate kinase X-ray 2.15 2021-12-01 18.30 96.34 0.99 0.97 97.49 1.96 0.04 ok
7U47_K Q96H22 Centromere protein N EM 7.50 2022-02-28 85.56 0.96 0.04 ok
7U46_K Q96H22 Centromere protein N EM 2.68 2022-02-28 85.56 0.96 0.04 ok
5SCF_A P30613 Pyruvate kinase X-ray 2.19 2021-12-01 18.30 96.34 0.99 0.97 97.37 1.94 0.04 ok
7RP4_A P01116 Isoform 2B of GTPase KRas X-ray 2.15 2021-08-03 91.50 0.96 0.04 ok
5SCH_A P30613 Pyruvate kinase X-ray 2.09 2021-12-01 18.30 96.36 0.99 0.97 97.84 1.95 0.04 ok
5SCG_A P30613 Pyruvate kinase X-ray 1.94 2021-12-01 18.30 96.34 0.99 0.97 97.85 1.94 0.04 ok
7VUE_A Q96RI1 Bile acid receptor X-ray 2.60 2021-11-02 68.81 0.95 0.03 ok
7YWB_A Q9Y5A9 YTH domain-containing family protein 2 X-ray 1.92 2022-02-12 59.50 0.94 0.03 ok
7Z26_A Q9Y5A9 YTH domain-containing family protein 2 X-ray 1.90 2022-02-25 59.50 0.94 0.03 ok
7RAA_A P60568 Interleukin-2 X-ray 2.69 2021-06-30 84.12 0.96 0.03 ok
7U47_B P62805 Histone H4 EM 7.50 2022-02-28 89.81 0.96 0.03 ok
7U46_B P62805 Histone H4 EM 2.68 2022-02-28 89.81 0.96 0.03 ok
7QPG_B Q9H900 Protein zwilch homolog EM 3.90 2022-01-04 82.56 0.96 0.03 ok
7R5W_A Q9Y5A9 YTH domain-containing family protein 2 X-ray 1.75 2022-02-11 59.50 0.95 0.03 ok
7TPS_A P33681 T-lymphocyte activation antigen CD80 X-ray 3.15 2022-01-26 86.12 0.96 0.03 ok
7Z4U_A Q9Y5A9 YTH domain-containing family protein 2 X-ray 1.83 2022-03-04 59.50 0.95 0.03 ok
7VUE_B Q15596 Peptide from Nuclear receptor coactivator X-ray 2.60 2021-11-02 44.53 0.66 0.81 90.91 1.04 0.03 ok
7S1P_A O14744 Protein arginine N-methyltransferase 5 X-ray 2.21 2021-09-02 93.31 0.97 0.03 ok
7S7L_B P01033 Metalloproteinase inhibitor 1 X-ray 2.34 2021-09-16 89.62 0.97 0.03 ok
5SC9_A P30613 Pyruvate kinase X-ray 1.69 2021-12-01 18.30 96.37 0.99 0.98 98.25 0.67 0.03 ok
7S7M_B P01033 Metalloproteinase inhibitor 1 X-ray 3.00 2021-09-16 89.62 0.97 0.02 ok
7QBF_A P20062 Transcobalamin-2 X-ray 1.85 2021-11-19 91.50 0.98 0.02 ok
7OFI_A P51449 Nuclear receptor ROR-gamma X-ray 1.95 2021-05-05 74.19 0.97 0.02 ok
7M0D_A Q9UGP5 DNA polymerase lambda X-ray 1.80 2021-03-10 80.38 0.97 0.02 ok
7OFK_A P51449 Nuclear receptor ROR-gamma X-ray 1.61 2021-05-05 74.19 0.97 0.02 ok
7TEZ_E Q9BYF1 Processed angiotensin-converting enzyme 2 EM 3.27 2022-01-06 90.69 0.98 0.02 ok
7M0C_A Q9UGP5 DNA polymerase lambda X-ray 2.65 2021-03-10 80.38 0.98 0.02 ok
7U47_A P49450 Histone H3-like centromeric protein A EM 7.50 2022-02-28 81.50 0.98 0.02 ok
7U46_A P49450 Histone H3-like centromeric protein A EM 2.68 2022-02-28 81.50 0.98 0.02 ok
7M0A_A Q9UGP5 DNA polymerase lambda X-ray 1.83 2021-03-10 80.38 0.98 0.02 ok
7M09_A Q9UGP5 DNA polymerase lambda X-ray 1.65 2021-03-10 80.38 0.98 0.02 ok
7M0B_A Q9UGP5 DNA polymerase lambda X-ray 2.00 2021-03-10 80.38 0.98 0.02 ok
7S7M_A P08254 Stromelysin-1 X-ray 3.00 2021-09-16 85.69 0.98 0.02 ok
7EJE_A Q06609 DNA repair protein RAD51 homolog 1 EM 3.98 2021-04-02 91.44 0.98 0.02 ok
7M07_A Q9UGP5 DNA polymerase lambda X-ray 1.57 2021-03-10 80.38 0.98 0.02 ok
7TEW_E Q9BYF1 Processed angiotensin-converting enzyme 2 EM 3.52 2022-01-06 90.69 0.98 0.01 ok
7M08_A Q9UGP5 DNA polymerase lambda X-ray 1.70 2021-03-10 80.38 0.98 0.01 ok
7PQV_A Q02750 Dual specificity mitogen-activated protein X-ray 2.13 2021-09-20 83.25 0.98 0.01 ok
7M0E_A Q9UGP5 DNA polymerase lambda X-ray 2.25 2021-03-10 80.38 0.99 0.01 ok
7SUO_A Q13283 Ras GTPase-activating protein-binding prot X-ray 2.35 2021-11-17 66.81 0.98 0.01 ok
7PO6_A Q96MU7 Isoform 2 of YTH domain-containing protein X-ray 1.77 2021-09-08 60.34 0.98 0.01 ok
7QBE_A P20062 Transcobalamin-2 X-ray 3.00 2021-11-19 91.50 0.99 0.01 ok
7QWQ_B G1TL06 uL3 EM 2.83 2022-01-25 97.19 0.99 0.01 ok
7QBG_A P20062 Transcobalamin-2 X-ray 2.69 2021-11-19 91.50 0.99 0.01 ok
7VPQ_A P15144 Aminopeptidase N X-ray 3.10 2021-10-17 93.06 0.99 0.01 ok
7NTB_A P00918 Carbonic anhydrase 2 X-ray 1.70 2021-03-09 97.38 0.99 0.01 ok
7RRC_A P14902 Indoleamine 2,3-dioxygenase 1 X-ray 2.18 2021-08-09 93.06 0.99 0.01 ok
7RRB_A P14902 Indoleamine 2,3-dioxygenase 1 X-ray 2.69 2021-08-09 93.06 0.99 0.01 ok
7QBH_AAA P00918 Carbonic anhydrase 2 X-ray 1.22 2021-11-19 97.38 0.99 0.01 ok
7QBD_A P20062 Transcobalamin-2 X-ray 4.18 2021-11-19 91.50 0.99 0.01 ok
7W4X_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 2.20 2021-11-29 67.44 0.99 0.00 ok
7Q6Q_A Q14145 Kelch-like ECH-associated protein 1 X-ray 2.55 2021-11-09 90.06 1.00 0.00 ok
7S1P_B Q9BQA1 Methylosome protein 50 X-ray 2.21 2021-09-02 91.00 1.00 0.00 ok
7W4Y_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 2.10 2021-11-29 67.44 0.99 0.00 ok
7Q8R_A Q14145 Kelch-like ECH-associated protein 1 X-ray 2.28 2021-11-11 90.06 1.00 0.00 ok
7Q5H_A Q14145 Kelch-like ECH-associated protein 1 X-ray 2.31 2021-11-03 90.06 1.00 0.00 ok
7Q96_A Q14145 Kelch-like ECH-associated protein 1 X-ray 2.42 2021-11-12 90.06 1.00 0.00 ok
7Q6S_A Q14145 Kelch-like ECH-associated protein 1 X-ray 2.14 2021-11-09 90.06 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.