Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2020-09-09

123
structures analysed (30 full · 24.4%)
10.8%
confidently wrong
54.1%
novel sequences
00.0%
novel & wrong
0.948
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 1 of 123 structures (0.8%) are confidently wrong; median TM-score is 0.948.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.948 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6TVM_A O75475 PC4 and SFRS1-interacting protein NMR 2020-01-10 0.90 85.68 0.47 0.71 1.76 24.97 0.81 wrong
6VIS_A P50120 Retinol-binding protein 2 X-ray 2.79 2020-01-13 3.80 96.79 0.56 0.93 3.20 16.25 0.75 ok
6TRJ_A O75475 PC4 and SFRS1-interacting protein X-ray 1.30 2019-12-19 1.20 94.98 0.68 0.92 5.88 16.46 0.72 ok
6SLO_A Q9UHX1 Thioredoxin,Poly(U)-binding-splicing facto X-ray 1.94 2019-08-20 0.00 62.23 0.52 0.51 1.17 38.29 0.58 ok
6KVG_A Q9Y5N6 Origin recognition complex subunit 6 NMR 2019-09-04 0.00 81.83 0.51 0.70 4.66 18.47 0.57 ok
6K7X_A Q8NE86 Calcium uniporter protein, mitochondrial EM 3.27 2019-06-10 0.00 90.87 0.58 0.92 12.36 9.87 0.55 ok
6K7Y_A Q8NE86 Calcium uniporter protein, mitochondrial EM 3.60 2019-06-10 0.00 90.87 0.58 0.92 13.10 9.63 0.53 ok
7JPR_B Q13416 Origin recognition complex subunit 2 EM 4.00 2020-08-09 0.00 83.85 0.68 0.83 23.86 12.84 0.43 ok
7JPP_B Q13416 Origin recognition complex subunit 2 EM 3.70 2020-08-09 0.00 83.85 0.68 0.84 23.86 12.86 0.43 ok
6K7Y_I Q9BPX6 Calcium uptake protein 1, mitochondrial EM 3.60 2019-06-10 0.00 88.92 0.78 0.74 33.91 7.76 0.31 ok
6X19_A P63092 Guanine nucleotide-binding protein G(s) su EM 2.10 2020-05-18 91.31 0.72 0.26 ok
6X18_A P63092 Guanine nucleotide-binding protein G(s) su EM 2.10 2020-05-18 91.31 0.72 0.25 ok
6X1A_A P63092 Guanine nucleotide-binding protein G(s) su EM 2.50 2020-05-18 91.31 0.72 0.25 ok
6XBZ_H P51948 CDK-activating kinase assembly factor MAT1 EM 2.80 2020-06-07 85.38 0.78 0.19 ok
6XD3_H P51948 CDK-activating kinase assembly factor MAT1 EM 3.30 2020-06-09 85.38 0.78 0.19 ok
6SO5_A O43681 ATPase ASNA1 EM 4.20 2019-08-29 44.80 82.53 0.81 0.73 51.36 7.03 0.18 ok
6SO5_C O00258 Tail-anchored protein insertion receptor W EM 4.20 2019-08-29 100.00 novel 81.30 0.71 0.82 51.91 3.91 0.17 ok
6X18_R P43220 Glucagon-like peptide 1 receptor EM 2.10 2020-05-18 81.50 0.81 0.16 ok
7JFM_C Q92793 CREB-binding protein X-ray 2.23 2020-07-17 0.00 49.76 0.56 0.65 39.10 7.09 0.16 ok
6K7Y_J Q8IYU8 Calcium uptake protein 2, mitochondrial EM 3.60 2019-06-10 72.80 novel 86.18 0.87 0.84 59.72 4.57 0.15 ok
6XJX_B Q9H4I9 Essential MCU regulator, mitochondrial EM 4.60 2020-06-24 72.56 0.79 0.15 ok
7JL5_A Q8TAT5 Endonuclease 8-like 3 X-ray 2.60 2020-07-29 54.80 82.50 0.68 0.92 54.83 3.10 0.15 ok
6X1A_R P43220 Glucagon-like peptide 1 receptor EM 2.50 2020-05-18 81.50 0.83 0.14 ok
6XJV_B Q9H4I9 Essential MCU regulator, mitochondrial EM 4.17 2020-06-24 72.56 0.81 0.14 ok
7JWN_A P02768 Albumin X-ray 2.60 2020-08-25 92.69 0.85 0.14 ok
6XJV_Q Q9BPX6 Calcium uptake protein 1, mitochondrial EM 4.17 2020-06-24 76.12 0.82 0.13 ok
6X19_R P43220 Glucagon-like peptide 1 receptor EM 2.10 2020-05-18 81.50 0.84 0.13 ok
6SO5_E P49069 Calcium signal-modulating cyclophilin liga EM 4.20 2019-08-29 100.00 novel 75.99 0.82 0.70 57.28 2.91 0.13 ok
7CFM_A P63092 Guanine nucleotide-binding protein G(s) su EM 3.00 2020-06-27 91.31 0.86 0.12 ok
7CFN_A P63092 Guanine nucleotide-binding protein G(s) su EM 3.00 2020-06-27 91.31 0.87 0.12 ok
7JFL_C Q92793 CREB-binding protein X-ray 1.68 2020-07-17 0.00 50.63 0.62 0.73 50.69 5.05 0.12 ok
7CFM_R Q8TDU6 G-protein coupled bile acid receptor 1 EM 3.00 2020-06-27 80.44 0.86 0.11 ok
6WBV_B P81172 Hepcidin EM 2.50 2020-03-27 0.00 78.79 0.55 0.84 65.00 2.88 0.11 ok
6XJV_A Q8NE86 Calcium uniporter protein, mitochondrial EM 4.17 2020-06-24 79.12 0.87 0.11 ok
7CFN_R Q8TDU6 G-protein coupled bile acid receptor 1 EM 3.00 2020-06-27 80.44 0.87 0.10 ok
6X1A_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.50 2020-05-18 89.56 0.88 0.10 ok
7JPR_E O43913 Origin recognition complex subunit 5 EM 4.00 2020-08-09 82.19 0.88 0.10 ok
6X18_P P01275 Glucagon-like peptide-1 (GLP-1)(7-36)NH2 EM 2.10 2020-05-18 68.94 0.86 0.10 ok
7JPR_C Q9UBD5 Origin recognition complex subunit 3 EM 4.00 2020-08-09 80.19 0.88 0.09 ok
6L3V_A Q8NFK1 Gap junction gamma-3 protein EM 2.63 2019-10-15 65.60 86.92 0.90 0.85 77.49 2.49 0.09 ok
6K7Y_E Q9H4I9 Essential MCU regulator, mitochondrial EM 3.60 2019-06-10 100.00 novel 83.93 0.78 0.93 74.07 2.09 0.09 ok
6L3T_A Q8NFK1 Gap junction gamma-3 protein EM 2.34 2019-10-15 65.60 86.92 0.91 0.85 79.48 2.43 0.09 ok
6K7X_E Q9H4I9 Essential MCU regulator, mitochondrial EM 3.27 2019-06-10 100.00 novel 83.93 0.78 0.94 74.07 2.04 0.09 ok
7JPS_D O43929 Origin recognition complex subunit 4 EM 4.40 2020-08-09 85.88 0.90 0.09 ok
7JPP_D O43929 Origin recognition complex subunit 4 EM 3.70 2020-08-09 85.88 0.90 0.08 ok
6L3U_A Q8NFK1 Gap junction gamma-3 protein EM 2.53 2019-10-15 65.60 86.92 0.92 0.86 81.09 2.35 0.08 ok
7JPR_D O43929 Origin recognition complex subunit 4 EM 4.00 2020-08-09 85.88 0.91 0.08 ok
7JFL_A Q14653 Interferon regulatory factor 3 X-ray 1.68 2020-07-17 80.25 0.91 0.08 ok
7CFM_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.00 2020-06-27 89.56 0.92 0.07 ok
6Z4A_A Q6UVJ0 Spindle assembly abnormal protein 6 homolo X-ray 1.46 2020-05-25 73.25 0.91 0.06 ok
6SLZ_A P51449 Nuclear receptor ROR-gamma X-ray 2.20 2019-08-21 0.00 95.61 0.97 0.92 91.40 1.66 0.06 ok
6SLR_A P07602 Prosaposin X-ray 2.38 2019-08-20 0.00 87.75 0.89 0.94 87.66 1.51 0.06 ok
6XJX_R Q8IYU8 Calcium uptake protein 2, mitochondrial EM 4.60 2020-06-24 74.19 0.92 0.06 ok
6XD3_J P50613 Cyclin-dependent kinase 7 EM 3.30 2020-06-09 82.00 0.93 0.06 ok
7CFN_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.00 2020-06-27 89.56 0.93 0.06 ok
6X19_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.10 2020-05-18 89.56 0.93 0.06 ok
6XBZ_J P50613 Cyclin-dependent kinase 7 EM 2.80 2020-06-07 82.00 0.93 0.06 ok
6X8O_A O43521 Bcl-2-like protein 11 X-ray 1.31 2020-06-01 0.00 82.35 0.70 0.92 89.42 1.46 0.06 ok
7JPS_E O43913 Origin recognition complex subunit 5 EM 4.40 2020-08-09 82.19 0.93 0.06 ok
6U6B_A P06746 DNA polymerase beta X-ray 3.11 2019-08-29 0.00 95.88 0.97 0.95 90.62 1.11 0.06 ok
7JPP_E O43913 Origin recognition complex subunit 5 EM 3.70 2020-08-09 82.19 0.93 0.06 ok
6XJX_Q Q9BPX6 Calcium uptake protein 1, mitochondrial EM 4.60 2020-06-24 76.12 0.94 0.05 ok
6XKR_P Q15116 Programmed cell death protein 1 X-ray 2.59 2020-06-27 74.12 0.94 0.04 ok
6RUU_A Q9Y616 Interleukin-1 receptor-associated kinase 3 X-ray 2.95 2019-05-29 62.90 92.14 0.98 0.94 93.68 1.09 0.04 ok
6X18_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.10 2020-05-18 89.56 0.96 0.04 ok
6XJV_R Q8IYU8 Calcium uptake protein 2, mitochondrial EM 4.17 2020-06-24 74.19 0.95 0.04 ok
6W4S_F Q9NP59 Solute carrier family 40 member 1 EM 3.20 2020-03-11 80.25 0.96 0.03 ok
6XWG_D P10276 Retinoic acid receptor alpha X-ray 2.40 2020-01-23 78.12 0.96 0.03 ok
6XJX_A Q8NE86 Calcium uniporter protein, mitochondrial EM 4.60 2020-06-24 79.12 0.96 0.03 ok
6X3S_A P47870 Gamma-aminobutyric acid receptor subunit b EM 3.12 2020-05-21 76.50 0.96 0.03 ok
7JPS_B Q13416 Origin recognition complex subunit 2 EM 4.40 2020-08-09 64.38 0.96 0.03 ok
6X3W_B P14867 Gamma-aminobutyric acid receptor subunit a EM 3.30 2020-05-21 81.69 0.97 0.02 ok
6WBV_A Q9NP59 Solute carrier family 40 member 1 EM 2.50 2020-03-27 80.25 0.97 0.02 ok
6XWH_C P19793 Retinoic acid receptor RXR-alpha X-ray 2.10 2020-01-23 75.38 0.97 0.02 ok
6X3U_A P47870 Gamma-aminobutyric acid receptor subunit b EM 3.50 2020-05-21 76.50 0.97 0.02 ok
6X3U_B P14867 Gamma-aminobutyric acid receptor subunit a EM 3.50 2020-05-21 81.69 0.97 0.02 ok
6X3T_B P14867 Gamma-aminobutyric acid receptor subunit a EM 2.55 2020-05-21 81.69 0.97 0.02 ok
6T7V_A Q14145 Kelch-like ECH-associated protein 1 X-ray 2.60 2019-10-23 0.00 97.31 1.00 0.98 99.56 0.38 0.02 ok
6X3X_B P14867 Gamma-aminobutyric acid receptor subunit a EM 2.92 2020-05-21 81.69 0.98 0.02 ok
6X3V_B P14867 Gamma-aminobutyric acid receptor subunit a EM 3.50 2020-05-21 81.69 0.98 0.02 ok
6T7Z_A Q14145 Kelch-like ECH-associated protein 1 X-ray 2.00 2019-10-23 0.00 97.35 1.00 0.99 99.82 0.35 0.02 ok
7JPS_C Q9UBD5 Origin recognition complex subunit 3 EM 4.40 2020-08-09 80.19 0.98 0.02 ok
6X40_B P14867 Gamma-aminobutyric acid receptor subunit a EM 2.86 2020-05-21 81.69 0.98 0.02 ok
6X3Z_B P14867 Gamma-aminobutyric acid receptor subunit a EM 3.23 2020-05-21 81.69 0.98 0.02 ok
7JPS_A Q13415 Origin recognition complex subunit 1 EM 4.40 2020-08-09 67.38 0.98 0.02 ok
7JPR_A Q13415 Origin recognition complex subunit 1 EM 4.00 2020-08-09 67.38 0.98 0.02 ok
6X3S_B P14867 Gamma-aminobutyric acid receptor subunit a EM 3.12 2020-05-21 81.69 0.98 0.01 ok
6XWG_C P19793 Retinoic acid receptor RXR-alpha X-ray 2.40 2020-01-23 75.38 0.98 0.01 ok
6X3S_E P18507 Gamma-aminobutyric acid type A receptor su EM 3.12 2020-05-21 77.19 0.98 0.01 ok
7JPP_A Q13415 Origin recognition complex subunit 1 EM 3.70 2020-08-09 67.38 0.98 0.01 ok
6UUQ_A Q08209 Serine/threonine-protein phosphatase 2B ca X-ray 1.85 2019-10-31 85.50 0.98 0.01 ok
7JPP_C Q9UBD5 Origin recognition complex subunit 3 EM 3.70 2020-08-09 80.19 0.98 0.01 ok
6X3Z_E P18507 Gamma-aminobutyric acid receptor subunit g EM 3.23 2020-05-21 77.19 0.98 0.01 ok
6X40_E P18507 Gamma-aminobutyric acid receptor subunit g EM 2.86 2020-05-21 77.19 0.98 0.01 ok
6X3U_E P18507 Gamma-aminobutyric acid receptor subunit g EM 3.50 2020-05-21 77.19 0.98 0.01 ok
6X3T_A P47870 Gamma-aminobutyric acid receptor subunit b EM 2.55 2020-05-21 76.50 0.98 0.01 ok
7A06_A P35790 Choline kinase alpha X-ray 1.80 2020-08-06 82.31 0.99 0.01 ok
6X3W_E P18507 Gamma-aminobutyric acid receptor subunit g EM 3.30 2020-05-21 77.19 0.99 0.01 ok
6X3Z_A P47870 Gamma-aminobutyric acid receptor subunit b EM 3.23 2020-05-21 76.50 0.99 0.01 ok
6XD3_I P51946 Cyclin-H EM 3.30 2020-06-09 86.38 0.99 0.01 ok
6XBZ_I P51946 Cyclin-H EM 2.80 2020-06-07 86.38 0.99 0.01 ok
6X3V_E P18507 Gamma-aminobutyric acid receptor subunit g EM 3.50 2020-05-21 77.19 0.99 0.01 ok
6X3X_E P18507 Gamma-aminobutyric acid receptor subunit g EM 2.92 2020-05-21 77.19 0.99 0.01 ok
6X3W_A P47870 Gamma-aminobutyric acid receptor subunit b EM 3.30 2020-05-21 76.50 0.99 0.01 ok
6X1A_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.50 2020-05-18 97.06 0.99 0.01 ok
6YJ3_A P00918 Carbonic anhydrase 2 X-ray 1.55 2020-04-02 97.38 0.99 0.01 ok
7A04_A P35790 Choline kinase alpha X-ray 2.15 2020-08-06 82.31 0.99 0.01 ok
6X3T_E P18507 Gamma-aminobutyric acid type A receptor su EM 2.55 2020-05-21 77.19 0.99 0.01 ok
6X40_A P47870 Gamma-aminobutyric acid receptor subunit b EM 2.86 2020-05-21 76.50 0.99 0.01 ok
7CFM_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.00 2020-06-27 97.06 0.99 0.01 ok
6X3X_A P47870 Gamma-aminobutyric acid receptor subunit b EM 2.92 2020-05-21 76.50 0.99 0.01 ok
6X3V_A P47870 Gamma-aminobutyric acid receptor subunit b EM 3.50 2020-05-21 76.50 0.99 0.01 ok
7CVP_A O43175 D-3-phosphoglycerate dehydrogenase X-ray 2.50 2020-08-26 92.94 0.99 0.01 ok
7CFN_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.00 2020-06-27 97.06 0.99 0.01 ok
6X19_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.10 2020-05-18 97.06 1.00 0.00 ok
6YKH_A P00918 Carbonic anhydrase 2 X-ray 1.10 2020-04-06 97.38 1.00 0.00 ok
6YKC_A P00918 Carbonic anhydrase 2 X-ray 1.20 2020-04-06 97.38 1.00 0.00 ok
6X18_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.10 2020-05-18 97.06 1.00 0.00 ok
6WET_AaA P22413 Ectonucleotide pyrophosphatase/phosphodies X-ray 2.60 2020-04-02 90.69 1.00 0.00 ok
6WEU_AbA P22413 Ectonucleotide pyrophosphatase/phosphodies X-ray 2.65 2020-04-03 90.69 1.00 0.00 ok
6WEW_AbA P22413 Ectonucleotide pyrophosphatase/phosphodies X-ray 2.73 2020-04-03 90.69 1.00 0.00 ok
6WEV_AbA P22413 Ectonucleotide pyrophosphatase/phosphodies X-ray 2.90 2020-04-03 90.69 1.00 0.00 ok
6WFJ_AcA P22413 Ectonucleotide pyrophosphatase/phosphodies X-ray 2.50 2020-04-03 90.69 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.