Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2021-12-15

102
structures analysed (14 full · 13.7%)
32.9%
confidently wrong
00.0%
novel sequences
00.0%
novel & wrong
0.944
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 3 of 102 structures (2.9%) are confidently wrong; median TM-score is 0.944.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.944 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7OB4_A P02766 Transthyretin EM 3.22 2021-04-21 0.00 98.01 0.23 0.48 0.00 22.84 0.94 wrong
7SZ7_A P00533 Epidermal growth factor receptor EM 3.40 2021-11-25 0.40 91.57 0.53 0.88 1.67 25.36 0.84 ok
7MP6_A P21359 Isoform I of Neurofibromin EM 6.25 2021-05-04 0.40 84.89 0.54 0.75 0.49 33.11 0.81 ok
7M74_A Q13131 5'-AMP-activated protein kinase catalytic EM 3.93 2021-03-26 2.10 91.58 0.64 0.81 2.76 22.65 0.80 ok
7MP5_A P21359 Isoform I of Neurofibromin EM 5.60 2021-05-04 0.40 87.32 0.55 0.92 2.46 23.74 0.74 ok
7PQP_O P10636 Isoform Tau-F of Microtubule-associated pr EM 4.10 2021-09-18 0.00 61.16 0.16 0.74 0.00 119.07 0.61 ok
7PQC_O P10636 Isoform Tau-F of Microtubule-associated pr EM 4.10 2021-09-16 0.00 61.16 0.15 0.71 0.00 114.88 0.61 ok
7SHT_B P01854 Immunoglobulin heavy constant epsilon EM 7.29 2021-10-11 1.00 84.95 0.60 0.78 9.81 15.49 0.60 ok
7PY2_A Q13148 TAR DNA-binding protein 43 EM 2.59 2021-10-08 0.00 43.75 0.26 0.38 0.95 29.23 0.41 ok
7RUA_D P46379 Large proline-rich protein BAG6 EM 3.40 2021-08-16 0.00 76.04 0.49 0.81 27.75 6.54 0.30 wrong
7RU9_D P46379 Large proline-rich protein BAG6 EM 3.30 2021-08-16 0.00 76.25 0.49 0.83 30.30 6.24 0.28 wrong
7RUA_E P11441 Ubiquitin-like protein 4A EM 3.40 2021-08-16 79.44 0.79 0.17 ok
7M74_B O43741 5'-AMP-activated protein kinase subunit be EM 3.93 2021-03-26 77.75 0.78 0.17 ok
7NA7_A P63096 Guanine nucleotide-binding protein G(i) su EM 2.70 2021-06-20 93.75 0.82 0.16 ok
7MOC_A P21359 Isoform I of Neurofibromin EM 4.56 2021-05-01 78.00 0.79 0.16 ok
7NA8_A P63096 Guanine nucleotide-binding protein G(i) su EM 2.70 2021-06-20 93.75 0.83 0.16 ok
7RU9_E P11441 Ubiquitin-like protein 4A EM 3.30 2021-08-16 79.44 0.80 0.16 ok
7RUC_H P11441 Ubiquitin-like protein 4A EM 3.60 2021-08-16 79.44 0.81 0.15 ok
7P00_P P20366 Substance P EM 2.71 2021-06-29 58.73 0.21 0.60 47.73 3.93 0.14 ok
7RUC_D P46379 Large proline-rich protein BAG6 EM 3.60 2021-08-16 0.00 71.23 0.62 0.87 63.37 2.68 0.11 ok
7SZ7_C P01135 Transforming growth factor alpha EM 3.40 2021-11-25 66.44 0.84 0.11 ok
7PGK_A Q96QV1 Hedgehog-interacting protein X-ray 2.75 2021-08-14 79.75 0.89 0.09 ok
7EHZ_A P40261 Nicotinamide N-methyltransferase X-ray 2.50 2021-03-30 96.06 0.91 0.09 ok
7SHT_A P12319 High affinity immunoglobulin epsilon recep EM 7.29 2021-10-11 84.38 0.90 0.08 ok
7NA7_L Q9UBU3 Ghrelin-27 EM 2.70 2021-06-20 50.30 0.28 0.71 60.42 2.63 0.08 ok
7VSI_B Q13113 PDZK1-interacting protein 1 EM 2.95 2021-10-26 64.75 0.87 0.08 ok
7LI8_A P31645 Sodium-dependent serotonin transporter EM 3.90 2021-01-26 84.69 0.91 0.08 ok
7LI6_A P31645 Sodium-dependent serotonin transporter EM 3.50 2021-01-26 84.69 0.92 0.07 ok
7LI9_A P31645 Sodium-dependent serotonin transporter EM 3.90 2021-01-26 84.69 0.92 0.07 ok
7EGU_A P40261 Nicotinamide N-methyltransferase X-ray 1.90 2021-03-26 96.06 0.93 0.07 ok
7DN9_B P84077 ADP-ribosylation factor 1 X-ray 3.29 2020-12-09 85.94 0.92 0.07 ok
7DN8_B P84077 ADP-ribosylation factor 1 X-ray 2.61 2020-12-09 85.94 0.92 0.07 ok
7FEM_D Q9BYF1 Angiotensin-converting enzyme 2 EM 4.10 2021-07-21 90.69 0.93 0.07 ok
7P00_R P25103 Substance-P receptor EM 2.71 2021-06-29 78.38 0.92 0.06 ok
7SHU_A P01854 Immunoglobulin heavy constant epsilon X-ray 2.75 2021-10-11 76.56 0.92 0.06 ok
7E5N_A P09758 Tumor-associated calcium signal transducer X-ray 3.20 2021-02-19 82.69 0.92 0.06 ok
7SLA_A P13866 Sodium/glucose cotransporter 1 EM 3.15 2021-10-23 84.38 0.93 0.06 ok
7E5M_A P09758 Tumor-associated calcium signal transducer X-ray 3.20 2021-02-19 82.69 0.93 0.06 ok
7P02_R P25103 Substance-P receptor EM 2.87 2021-06-29 78.38 0.93 0.06 ok
7PGL_A Q96QV1 Hedgehog-interacting protein X-ray 2.63 2021-08-14 79.75 0.93 0.06 ok
7NA8_R Q92847 Growth hormone secretagogue receptor type EM 2.70 2021-06-20 81.62 0.93 0.05 ok
7SHY_A P01854 IgE Fc X-ray 3.00 2021-10-11 76.56 0.93 0.05 ok
7NA7_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.70 2021-06-20 89.56 0.94 0.05 ok
7NA7_R Q92847 Growth hormone secretagogue receptor type EM 2.70 2021-06-20 81.62 0.94 0.05 ok
7RU9_C Q7L5D6 Golgi to ER traffic protein 4 homolog EM 3.30 2021-08-16 87.56 0.94 0.05 ok
7P6X_A Q9Y265 RuvB-like 1 EM 4.10 2021-07-18 87.56 0.94 0.05 ok
7RUA_C Q7L5D6 Golgi to ER traffic protein 4 homolog EM 3.40 2021-08-16 87.56 0.94 0.05 ok
7RUC_C Q7L5D6 Golgi to ER traffic protein 4 homolog EM 3.60 2021-08-16 87.56 0.94 0.05 ok
7LKY_A O43189 Isoform 1 of PHD finger protein 1 X-ray 1.85 2021-02-03 71.00 0.93 0.05 ok
7SL8_A P13866 Sodium/glucose cotransporter 1 EM 3.40 2021-10-23 84.38 0.94 0.05 ok
7CRE_A P61978 Heterogeneous nuclear ribonucleoprotein K X-ray 3.00 2020-08-13 64.38 0.94 0.04 ok
7SL9_A Q8N695 Sodium-coupled monocarboxylate transporter EM 3.50 2021-10-23 85.75 0.95 0.04 ok
7MGW_A P31645 Sodium-dependent serotonin transporter EM 3.50 2021-04-13 84.69 0.95 0.04 ok
7NA8_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.70 2021-06-20 89.56 0.96 0.04 ok
7P00_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.71 2021-06-29 89.56 0.96 0.04 ok
7KXI_A Q16186 Proteasomal ubiquitin receptor ADRM1 NMR 2020-12-03 62.28 0.94 0.04 ok
7SI0_A P01854 IgE Fc X-ray 3.00 2021-10-12 76.56 0.95 0.04 ok
7LI7_A P31645 Sodium-dependent serotonin transporter EM 4.10 2021-01-26 84.69 0.96 0.04 ok
7LML_A Q15109 Advanced glycosylation end product-specifi X-ray 2.15 2021-02-05 82.81 0.96 0.03 ok
7P6X_D Q9Y230 RuvB-like 2 EM 4.10 2021-07-18 84.12 0.96 0.03 ok
7PGM_A Q96QV1 Hedgehog-interacting protein X-ray 2.70 2021-08-14 79.75 0.96 0.03 ok
7M74_G P54619 5'-AMP-activated protein kinase subunit ga EM 3.93 2021-03-26 86.56 0.97 0.03 ok
7P02_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.87 2021-06-29 89.56 0.97 0.03 ok
7AXS_A P61964 WD repeat-containing protein 5 X-ray 1.88 2020-11-10 93.31 0.97 0.02 ok
7AXQ_A P61964 WD repeat-containing protein 5 X-ray 1.56 2020-11-10 93.31 0.97 0.02 ok
7RPV_A Q9BYF1 Processed angiotensin-converting enzyme 2 X-ray 3.54 2021-08-04 90.69 0.98 0.02 ok
7AXX_A P61964 WD repeat-containing protein 5 X-ray 1.79 2020-11-10 93.31 0.98 0.02 ok
7PGN_A Q96QV1 Hedgehog-interacting protein X-ray 2.40 2021-08-14 79.75 0.98 0.02 ok
7VSI_A P31639 Sodium/glucose cotransporter 2 EM 2.95 2021-10-26 83.81 0.98 0.02 ok
7RY5_AAA P29373 Cellular retinoic acid-binding protein 2 X-ray 2.00 2021-08-24 96.75 0.98 0.02 ok
7S3G_A P11926 Ornithine decarboxylase X-ray 1.66 2021-09-06 88.00 0.98 0.02 ok
7S3F_A P11926 Ornithine decarboxylase X-ray 2.49 2021-09-06 88.00 0.98 0.01 ok
7LIA_A P31645 Sodium-dependent serotonin transporter EM 3.30 2021-01-26 84.69 0.99 0.01 ok
7P11_A O00214 Isoform 2 of Galectin-8 X-ray 2.10 2021-07-01 90.69 0.99 0.01 ok
7P1M_A O00214 Galectin-8 X-ray 1.52 2021-07-02 90.69 0.99 0.01 ok
7KZH_A Q7Z2W4 Zinc finger CCCH-type antiviral protein 1 X-ray 2.49 2020-12-10 69.44 0.99 0.01 ok
7SSE_A Q9Y4B6 DDB1- and CUL4-associated factor 1 X-ray 1.62 2021-11-10 74.94 0.99 0.01 ok
7KTA_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.84 2020-11-24 88.56 0.99 0.01 ok
7KTE_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.48 2020-11-24 88.56 0.99 0.01 ok
6XEE_A P18031 Tyrosine-protein phosphatase non-receptor X-ray 2.50 2020-06-12 81.25 0.99 0.01 ok
7KT3_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.88 2020-11-24 88.56 0.99 0.01 ok
7KT7_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.76 2020-11-24 88.56 0.99 0.01 ok
7KTF_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.49 2020-11-24 88.56 0.99 0.01 ok
7P11_B O00214 Galectin-8 X-ray 2.10 2021-07-01 90.69 0.99 0.01 ok
7KT9_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.48 2020-11-24 88.56 0.99 0.01 ok
7KT8_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.70 2020-11-24 88.56 0.99 0.01 ok
7KTN_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.33 2020-11-24 88.56 0.99 0.01 ok
7PQS_A Q96SB4 SRSF protein kinase 1 X-ray 2.20 2021-09-20 70.88 0.99 0.01 ok
7KTG_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.45 2020-11-24 88.56 0.99 0.01 ok
7AXP_A P61964 WD repeat-containing protein 5 X-ray 2.43 2020-11-10 93.31 0.99 0.01 ok
7KT5_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.46 2020-11-24 88.56 0.99 0.01 ok
7KT4_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.92 2020-11-24 88.56 0.99 0.01 ok
7KT6_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.87 2020-11-24 88.56 0.99 0.01 ok
7P02_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.87 2021-06-29 97.06 1.00 0.00 ok
7NA8_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.70 2021-06-20 97.06 1.00 0.00 ok
7P00_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.71 2021-06-29 97.06 1.00 0.00 ok
7NA7_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.70 2021-06-20 97.06 1.00 0.00 ok
6XED_A P18031 Tyrosine-protein phosphatase non-receptor X-ray 1.79 2020-06-12 81.25 1.00 0.00 ok
6XE8_A P18031 Tyrosine-protein phosphatase non-receptor X-ray 1.95 2020-06-12 81.25 1.00 0.00 ok
6XEG_A P18031 Tyrosine-protein phosphatase non-receptor X-ray 2.55 2020-06-12 81.25 1.00 0.00 ok
6XEA_A P18031 Tyrosine-protein phosphatase non-receptor X-ray 1.55 2020-06-12 81.25 1.00 0.00 ok
6XEF_A P18031 Tyrosine-protein phosphatase non-receptor X-ray 2.05 2020-06-12 81.25 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.