Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2022-08-31

114
structures analysed (19 full · 16.7%)
32.6%
confidently wrong
43.5%
novel sequences
00.0%
novel & wrong
0.944
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 3 of 114 structures (2.6%) are confidently wrong; median TM-score is 0.944.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.944 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7SX8_D P13797 Plastin-3 EM 9.00 2021-11-22 0.00 94.11 0.45 0.69 0.39 25.32 0.89 wrong
7V7B_A Q9Y4B6 DDB1- and CUL4-associated factor 1 EM 4.20 2021-08-21 0.30 88.69 0.63 0.77 1.22 25.31 0.83 ok
7V7C_A Q9Y4B6 DDB1- and CUL4-associated factor 1 EM 3.70 2021-08-21 0.30 88.69 0.63 0.80 1.19 25.11 0.83 ok
7SX9_D P13797 Plastin-3 EM 10.00 2021-11-22 0.00 94.11 0.46 0.69 3.24 19.30 0.81 wrong
8A9L_A P37840 Alpha-synuclein EM 2.20 2022-06-28 0.00 83.75 0.19 0.29 1.79 25.84 0.76 wrong
7XT6_B P01871 Isoform 2 of Immunoglobulin heavy constant EM 3.63 2022-05-16 16.90 87.09 0.53 0.83 6.34 20.45 0.66 ok
7SXA_A P13797 Plastin-3 EM 6.87 2021-11-22 0.00 93.59 0.62 0.66 9.66 13.09 0.65 ok
7Y1R_A P01137 Transforming growth factor beta-1 proprote EM 4.01 2022-06-08 0.90 84.78 0.67 0.64 6.48 21.05 0.62 ok
7PHR_C P09693 T-cell surface glycoprotein CD3 gamma chai EM 3.08 2021-08-18 0.00 85.01 0.65 0.86 9.65 11.80 0.57 ok
7RTZ_A P05067 Amyloid-beta protein 40 X-ray 2.10 2021-08-16 100.00 novel 52.04 0.22 0.31 0.00 16.86 0.48 ok
7XT6_A P11912 B-cell antigen receptor complex-associated EM 3.63 2022-05-16 71.60 novel 89.62 0.65 0.81 38.69 6.29 0.30 ok
7WSO_A P11912 B-cell antigen receptor complex-associated EM 3.03 2022-01-30 71.60 novel 89.62 0.67 0.83 37.77 6.35 0.29 ok
7RZH_A P14735 Cysteine-free Insulin-degrading enzyme EM 3.80 2021-08-27 94.00 0.76 0.23 ok
7DCV_A Q9NZQ7 Programmed cell death 1 ligand 1 NMR 2020-10-27 100.00 novel 67.24 0.58 0.73 30.08 5.99 0.23 ok
7PHR_Z P20963 T-cell surface glycoprotein CD3 zeta chain EM 3.08 2021-08-18 3.40 82.08 0.64 0.90 40.44 4.86 0.22 ok
7XT6_C P40259 B-cell antigen receptor complex-associated EM 3.63 2022-05-16 75.38 0.72 0.21 ok
7WSO_C P40259 B-cell antigen receptor complex-associated EM 3.03 2022-01-30 75.38 0.72 0.21 ok
8A43_I Q9P1U0 DNA-directed RNA polymerase I subunit RPA1 EM 4.09 2022-06-10 62.80 88.88 0.61 0.71 50.53 3.77 0.19 ok
7FI9_C Q29983 MHC class I polypeptide-related sequence A X-ray 2.16 2021-07-30 81.69 0.77 0.19 ok
7FI8_C Q29983 MHC class I polypeptide-related sequence A X-ray 2.80 2021-07-30 81.69 0.78 0.18 ok
7FI5_C Q29983 MHC class I polypeptide-related sequence A X-ray 2.39 2021-07-30 81.69 0.79 0.18 ok
7WSO_B P01857 Immunoglobulin heavy constant gamma 1 EM 3.03 2022-01-30 86.69 0.80 0.17 ok
7FI7_C Q29983 MHC class I polypeptide-related sequence A X-ray 2.78 2021-07-30 81.69 0.79 0.17 ok
7FI6_C Q29983 MHC class I polypeptide-related sequence A X-ray 2.90 2021-07-30 81.69 0.79 0.17 ok
7XAV_B P63096 Guanine nucleotide-binding protein G(i) su EM 2.87 2022-03-19 93.75 0.84 0.15 ok
7XAU_B P63096 Guanine nucleotide-binding protein G(i) su EM 2.97 2022-03-19 93.75 0.84 0.15 ok
7XAT_B P63096 Guanine nucleotide-binding protein G(i) su EM 2.85 2022-03-19 93.75 0.84 0.15 ok
7PHR_E P07766 T-cell surface glycoprotein CD3 epsilon ch EM 3.08 2021-08-18 73.06 0.83 0.12 ok
7RZI_a P01308 Insulin A chain EM 3.00 2021-08-27 0.00 51.57 0.40 0.52 40.91 3.63 0.12 ok
8A43_F P61218 DNA-directed RNA polymerases I, II, and II EM 4.09 2022-06-10 78.44 0.85 0.11 ok
8A43_M O15446 DNA-directed RNA polymerase I subunit RPA3 EM 4.09 2022-06-10 55.88 0.80 0.11 ok
8ANS_A P08581 Hepatocyte growth factor receptor X-ray 2.01 2022-08-05 79.25 0.87 0.10 ok
7WMC_A P40261 Nicotinamide N-methyltransferase X-ray 2.55 2022-01-14 96.06 0.89 0.10 ok
7XAT_F P61278 Somatostatin-14 EM 2.85 2022-03-19 58.76 0.24 0.65 58.33 2.88 0.10 ok
7Y1T_D P01137 Transforming growth factor beta-1 proprote EM 3.24 2022-06-08 79.56 0.87 0.10 ok
7XAU_A P30874 Somatostatin receptor type 2,LargeBit EM 2.97 2022-03-19 81.31 0.88 0.10 ok
8A43_L P53803 DNA-directed RNA polymerases I, II, and II EM 4.09 2022-06-10 0.00 91.67 0.69 0.83 75.00 2.02 0.10 ok
7XAV_A P30874 Somatostatin receptor type 2,LargeBit EM 2.87 2022-03-19 81.31 0.88 0.10 ok
7SOY_A P30153 Serine/threonine-protein phosphatase 2A 65 EM 3.40 2021-11-01 94.94 0.90 0.10 ok
8A43_J P62875 DNA-directed RNA polymerases I, II, and II EM 4.09 2022-06-10 92.94 0.90 0.10 ok
7XAT_A P30874 Somatostatin receptor type 2,LargeBit EM 2.85 2022-03-19 81.31 0.89 0.09 ok
7QSB_A Q14160 Protein scribble homolog X-ray 1.84 2022-01-13 62.53 0.86 0.09 ok
8AN8_A P08581 Hepatocyte growth factor receptor X-ray 2.39 2022-08-04 79.25 0.89 0.09 ok
7VAZ_E P15941 Mucin-1 subunit alpha X-ray 2.73 2021-08-30 41.15 0.50 0.69 52.50 3.26 0.08 ok
7V7B_B Q16531 DNA damage-binding protein 1 EM 4.20 2021-08-21 92.00 0.91 0.08 ok
7V7C_B Q16531 DNA damage-binding protein 1 EM 3.70 2021-08-21 92.00 0.91 0.08 ok
8A43_A O95602 DNA-directed RNA polymerase I subunit RPA1 EM 4.09 2022-06-10 80.12 0.90 0.08 ok
7Y1R_E Q86YC3 Transforming growth factor beta activator EM 4.01 2022-06-08 83.31 0.92 0.07 ok
8A43_H P52434 DNA-directed RNA polymerases I, II, and II EM 4.09 2022-06-10 84.25 0.93 0.06 ok
7V7C_D P13051 Uracil-DNA glycosylase EM 3.70 2021-08-21 85.31 0.93 0.06 ok
7X1U_A P34981 Thyrotropin-releasing hormone receptor EM 3.19 2022-02-24 79.62 0.93 0.06 ok
7X1T_A P34981 Thyrotropin-releasing hormone receptor EM 3.26 2022-02-24 79.62 0.93 0.06 ok
7QSA_A Q14160 Protein scribble homolog X-ray 2.02 2022-01-13 62.53 0.91 0.06 ok
8A43_K P0DPB6 DNA-directed RNA polymerases I and III sub EM 4.09 2022-06-10 86.38 0.94 0.06 ok
8A43_E P19388 DNA-directed RNA polymerases I, II, and II EM 4.09 2022-06-10 93.06 0.94 0.05 ok
7PVN_A A0AVT1 Ubiquitin-like modifier-activating enzyme X-ray 2.71 2021-10-05 91.44 0.94 0.05 ok
7WMT_A P40261 Nicotinamide N-methyltransferase X-ray 1.77 2022-01-17 96.06 0.95 0.05 ok
8CX5_A P01116 Isoform 2B of GTPase KRas X-ray 1.72 2022-05-19 91.50 0.94 0.05 ok
7SOY_P Q9Y570 Protein phosphatase methylesterase 1 EM 3.40 2021-11-01 82.62 0.94 0.05 ok
7YA1_A Q9BYF1 Angiotensin-converting enzyme 2 EM 3.11 2022-06-27 90.69 0.95 0.05 ok
8A43_N Q9GZS1 DNA-directed RNA polymerase I subunit RPA4 EM 4.09 2022-06-10 82.69 0.94 0.05 ok
7V8N_A P29374 AT-rich interactive domain-containing prot X-ray 2.05 2021-08-23 56.31 0.92 0.04 ok
8A43_B Q9H9Y6 DNA-directed RNA polymerase I subunit RPA2 EM 4.09 2022-06-10 92.19 0.95 0.04 ok
7MWH_A Q9UIF9 Bromodomain adjacent to zinc finger domain X-ray 2.28 2021-05-17 55.03 0.92 0.04 ok
7TA2_A W5XKT8 Sperm acrosome membrane-associated protein X-ray 2.25 2021-12-20 86.69 0.95 0.04 ok
7ZL7_A O95166 Gamma-aminobutyric acid receptor-associate X-ray 1.55 2022-04-14 94.94 0.96 0.04 ok
7XGO_A P00797 Renin X-ray 2.10 2022-04-05 85.44 0.96 0.04 ok
7XCH_D Q9BYF1 Processed angiotensin-converting enzyme 2 EM 3.40 2022-03-24 90.69 0.96 0.04 ok
7QS9_A Q14160 Protein scribble homolog X-ray 1.80 2022-01-13 62.53 0.94 0.04 ok
7XGK_A P00797 Renin X-ray 2.40 2022-04-05 85.44 0.96 0.04 ok
8A43_C O15160 DNA-directed RNA polymerases I and III sub EM 4.09 2022-06-10 92.12 0.96 0.03 ok
7XCI_A Q9BYF1 Processed angiotensin-converting enzyme 2 EM 3.20 2022-03-24 90.69 0.97 0.03 ok
7ZKR_A O95166 Gamma-aminobutyric acid receptor-associate X-ray 1.10 2022-04-13 94.94 0.97 0.03 ok
7XCP_A Q9BYF1 Processed angiotensin-converting enzyme 2 EM 3.05 2022-03-24 90.69 0.97 0.03 ok
7UP6_A O75582 Ribosomal protein S6 kinase alpha-5 X-ray 2.60 2022-04-14 69.94 0.96 0.03 ok
7RXO_A P24941 Cyclin-dependent kinase 2 X-ray 1.38 2021-08-23 88.44 0.97 0.03 ok
7TTJ_A P09917 Arachidonate 5-lipoxygenase X-ray 2.10 2022-02-01 97.25 0.97 0.03 ok
7FI5_A P26718 NKG2-D type II integral membrane protein X-ray 2.39 2021-07-30 79.19 0.97 0.02 ok
8CUB_B Q9H221 ATP-binding cassette sub-family G member 8 X-ray 4.05 2022-05-17 80.56 0.97 0.02 ok
7FI9_A P26718 NKG2-D type II integral membrane protein X-ray 2.16 2021-07-30 79.19 0.97 0.02 ok
7SOY_B Q13362 Isoform Gamma-1 of Serine/threonine-protei EM 3.40 2021-11-01 84.44 0.97 0.02 ok
7FI7_A P26718 NKG2-D type II integral membrane protein X-ray 2.78 2021-07-30 79.19 0.98 0.02 ok
7UAZ_A P08684 Cytochrome P450 3A4 X-ray 2.65 2022-03-14 92.38 0.98 0.02 ok
7T3F_A O60885 Bromodomain-containing protein 4 X-ray 1.28 2021-12-07 55.31 0.97 0.02 ok
7V9B_A P62258 YWHAE/FAM22B fusion protein X-ray 1.85 2021-08-24 92.88 0.98 0.02 ok
7TY2_A Q9BYW2 Histone-lysine N-methyltransferase SETD2 X-ray 2.44 2022-02-11 43.34 0.96 0.02 ok
7Y1T_B P26012 Integrin beta-8 EM 3.24 2022-06-08 76.69 0.98 0.02 ok
8DLV_E Q9BYF1 Processed angiotensin-converting enzyme 2 EM 3.11 2022-07-08 90.69 0.98 0.02 ok
7FI6_A P26718 NKG2-D type II integral membrane protein X-ray 2.90 2021-07-30 79.19 0.98 0.02 ok
7UAY_A P08684 Cytochrome P450 3A4 X-ray 2.78 2022-03-14 92.38 0.98 0.02 ok
8DLQ_E Q9BYF1 Processed angiotensin-converting enzyme 2 EM 2.77 2022-07-08 90.69 0.98 0.02 ok
7FI8_A P26718 NKG2-D type II integral membrane protein X-ray 2.80 2021-07-30 79.19 0.98 0.02 ok
8DLK_E Q9BYF1 Processed angiotensin-converting enzyme 2 EM 3.04 2022-07-08 90.69 0.98 0.01 ok
7PHR_L P61769 Beta-2-microglobulin EM 3.08 2021-08-18 94.06 0.98 0.01 ok
8DLM_E Q9BYF1 Processed angiotensin-converting enzyme 2 EM 2.89 2022-07-08 90.69 0.98 0.01 ok
7Y1T_A P06756 Integrin alpha-V EM 3.24 2022-06-08 88.31 0.98 0.01 ok
8DLP_D Q9BYF1 Processed angiotensin-converting enzyme 2 EM 2.64 2022-07-08 90.69 0.99 0.01 ok
7RZG_A P14735 Cysteine-free Insulin-degrading enzyme EM 4.10 2021-08-27 94.00 0.99 0.01 ok
8CUB_A Q9H222 ATP-binding cassette sub-family G member 5 X-ray 4.05 2022-05-17 85.06 0.98 0.01 ok
8DLU_D Q9BYF1 Processed angiotensin-converting enzyme 2 EM 3.14 2022-07-08 90.69 0.99 0.01 ok
8DLN_E Q9BYF1 Processed angiotensin-converting enzyme 2 EM 3.04 2022-07-08 90.69 0.99 0.01 ok
7TTL_A P09917 Arachidonate 5-lipoxygenase X-ray 2.43 2022-02-01 97.25 0.99 0.01 ok
8DLJ_E Q9BYF1 Processed angiotensin-converting enzyme 2 EM 2.91 2022-07-08 90.69 0.99 0.01 ok
7SOY_C P67775 Serine/threonine-protein phosphatase 2A ca EM 3.40 2021-11-01 95.06 0.99 0.01 ok
7RZE_A P14735 Cysteine-free Insulin-degrading enzyme EM 3.30 2021-08-27 94.00 0.99 0.01 ok
7RZF_A P14735 Cysteine-free Insulin-degrading enzyme EM 3.40 2021-08-27 94.00 0.99 0.01 ok
7QQG_A Q6NSJ0 Myogenesis-regulating glycosidase X-ray 2.43 2022-01-07 90.25 0.99 0.01 ok
7PHR_H P04439 HLA class I histocompatibility antigen, A EM 3.08 2021-08-18 87.12 0.99 0.01 ok
7V97_A P04637 Cellular tumor antigen p53 X-ray 2.02 2021-08-24 75.06 0.99 0.01 ok
7QQH_A Q6NSJ0 Myogenesis-regulating glycosidase X-ray 2.25 2022-01-07 90.25 0.99 0.01 ok
7QQF_A Q6NSJ0 Myogenesis-regulating glycosidase X-ray 2.43 2022-01-07 90.25 0.99 0.01 ok
7TY3_A Q9BYW2 Histone-lysine N-methyltransferase SETD2 X-ray 2.30 2022-02-11 43.34 0.98 0.01 ok
7RZI_A P14735 Cysteine-free Insulin-degrading enzyme EM 3.00 2021-08-27 94.00 0.99 0.01 ok
7RZE_b P01308 Insulin B chain EM 3.30 2021-08-27 52.91 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.