Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2019-10-23

72
structures analysed (50 full · 69.4%)
00.0%
confidently wrong
912.5%
novel sequences
00.0%
novel & wrong
0.962
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 0 of 72 structures (0.0%) are confidently wrong; median TM-score is 0.962.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.962 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6U4N_B P49023 Paxillin NMR 2019-08-26 59.70 92.09 0.57 0.73 40.77 5.58 0.28 ok
6HSX_L P00734 Prothrombin X-ray 1.56 2018-10-02 83.94 0.74 0.22 ok
6PYH_B P05019 Insulin-like growth factor I EM 4.30 2019-07-29 0.00 72.05 0.63 0.73 39.04 5.66 0.22 ok
6PGV_A Q8TAC2 Josephin-2 X-ray 2.30 2019-06-24 74.80 novel 95.02 0.92 0.94 53.12 7.94 0.21 ok
6SNZ_A P02545 Prelamin-A/C X-ray 2.60 2019-08-28 100.00 novel 95.44 0.83 0.99 52.34 3.26 0.19 ok
6SAZ_B Q9UGM5 Fetuin-B X-ray 3.00 2019-07-18 100.00 novel 89.29 0.94 0.86 50.64 9.50 0.18 ok
6U4M_A P49023 Paxillin NMR 2019-08-26 59.70 92.09 0.75 0.75 61.15 3.48 0.16 ok
6U4N_A Q96AC1 Fermitin family homolog 2 NMR 2019-08-26 2.70 88.31 0.80 0.76 62.23 3.17 0.13 ok
6NTY_A Q96DH6 RNA-binding protein Musashi homolog 2 X-ray 2.10 2019-01-30 20.50 88.57 0.89 0.88 75.91 2.16 0.10 ok
6OQ1_C P0CG47 Ubiquitin X-ray 2.20 2019-04-25 0.00 94.12 0.91 0.92 81.91 2.35 0.08 ok
6IUO_A P22455 Fibroblast growth factor receptor 4 X-ray 2.30 2018-11-29 1.00 88.93 0.93 0.89 82.55 2.75 0.08 ok
6OQ2_D P0CG47 Ubiquitin NMR 2019-04-25 0.00 94.12 0.90 0.88 84.87 2.13 0.08 ok
6JCQ_R Q8IZA0 Dyslexia-associated protein KIAA0319-like EM 3.30 2019-01-30 64.60 88.66 0.90 0.82 82.69 1.74 0.07 ok
6ITJ_A P11362 Fibroblast growth factor receptor 1 X-ray 1.99 2018-11-23 0.00 85.91 0.93 0.87 85.38 3.96 0.07 ok
6HSX_H P00734 Prothrombin X-ray 1.56 2018-10-02 83.94 0.92 0.06 ok
6MVL_A Q9H7M9 V-type immunoglobulin domain-containing su X-ray 1.61 2018-10-26 73.38 0.91 0.06 ok
6OQ2_B P0CG47 Ubiquitin NMR 2019-04-25 1.40 94.12 0.93 0.91 92.76 1.82 0.06 ok
6N0Q_A P15056 Serine/threonine-protein kinase B-raf X-ray 2.04 2018-11-07 0.00 89.57 0.95 0.91 87.65 1.91 0.06 ok
6KNU_A P10828 Thyroid hormone receptor beta X-ray 2.70 2019-08-07 0.40 95.16 0.96 0.90 89.98 1.46 0.06 ok
6KKU_A Q9UP95 Solute carrier family 12 member 4 EM 3.50 2019-07-27 100.00 novel 90.45 0.98 0.92 90.97 1.36 0.06 ok
6NEP_A Q96M98 Parkin coregulated gene protein X-ray 2.10 2018-12-18 100.00 novel 95.31 0.95 0.89 90.29 1.29 0.06 ok
6NDU_A Q96M98 Parkin coregulated gene protein X-ray 2.10 2018-12-14 100.00 novel 95.31 0.95 0.89 90.15 1.27 0.05 ok
6NCA_A P04439 HLA class I histocompatibility antigen, A- X-ray 3.30 2018-12-11 0.00 96.82 0.98 0.96 92.27 0.92 0.05 ok
6UCC_A Q96M98 Parkin coregulated gene protein X-ray 2.60 2019-09-16 100.00 novel 95.37 0.96 0.90 91.86 1.20 0.05 ok
6MSV_A P02751 Fibronectin X-ray 2.40 2018-10-18 69.62 0.93 0.05 ok
6KKT_A Q9UP95 Solute carrier family 12 member 4 EM 2.90 2019-07-27 100.00 novel 90.45 0.98 0.95 92.92 1.24 0.05 ok
6SZE_A O43353 Receptor-interacting serine/threonine-prot X-ray 2.94 2019-10-02 0.00 93.14 0.97 0.93 93.16 1.25 0.05 ok
6KKR_A Q9UP95 Solute carrier family 12 member 4 EM 2.90 2019-07-27 100.00 novel 90.45 0.98 0.95 93.62 1.26 0.05 ok
6KKB_X P10828 Thyroid hormone receptor beta X-ray 1.70 2019-07-24 0.00 95.27 0.97 0.93 93.62 1.06 0.05 ok
6OQ1_A P0CG47 Ubiquitin X-ray 2.20 2019-04-25 1.40 94.12 0.94 0.94 93.09 1.41 0.05 ok
6PZ4_A P56817 Beta-secretase 1 X-ray 1.85 2019-07-31 0.00 96.78 0.98 0.95 94.47 1.28 0.05 ok
6KNV_A P10828 Thyroid hormone receptor beta X-ray 2.80 2019-08-07 0.40 95.44 0.97 0.92 94.36 1.05 0.05 ok
6KKE_A P10828 Thyroid hormone receptor beta X-ray 2.58 2019-07-25 0.50 95.30 0.98 0.93 94.73 1.02 0.04 ok
6KNW_A P10828 Thyroid hormone receptor beta X-ray 2.67 2019-08-07 0.40 95.27 0.98 0.93 94.55 1.01 0.04 ok
6NEP_B Q5JSS6 Meiosis expressed gene 1 protein homolog X-ray 2.10 2018-12-18 12.50 86.95 0.94 0.90 93.45 0.92 0.04 ok
6NDU_B Q5JSS6 Meiosis expressed gene 1 protein homolog X-ray 2.10 2018-12-14 12.50 86.95 0.94 0.91 94.35 0.89 0.04 ok
6OQ2_E P0CG47 Ubiquitin NMR 2019-04-25 0.00 95.14 0.95 0.91 97.95 0.80 0.04 ok
6MSL_B P05106 Integrin beta-3 X-ray 3.10 2018-10-16 87.00 0.95 0.04 ok
6MSU_B P05106 Integrin beta-3 X-ray 3.11 2018-10-18 87.00 0.95 0.04 ok
6UCC_B Q5JSS6 Meiosis expressed gene 1 protein homolog X-ray 2.60 2019-09-16 12.50 86.95 0.95 0.92 94.64 0.82 0.04 ok
6ORR_A P40261 NNMT protein X-ray 2.25 2019-04-30 0.00 96.54 0.94 0.95 97.02 1.08 0.04 ok
6PGV_B P0CG47 Polyubiquitin-B X-ray 2.30 2019-06-24 0.00 94.34 0.97 0.98 97.67 1.29 0.03 ok
6HZU_A P23458 Tyrosine-protein kinase JAK1 X-ray 2.20 2018-10-24 85.56 0.96 0.03 ok
6NWL_B Q9UBK2 Peroxisome proliferator-activated receptor X-ray 1.59 2019-02-06 60.13 0.65 0.96 93.75 0.94 0.03 ok
6J6M_A Q06187 Tyrosine-protein kinase BTK X-ray 1.25 2019-01-15 0.40 90.95 0.99 0.96 97.19 0.86 0.03 ok
6PCV_A Q8TCU6 Phosphatidylinositol (3,4,5) trisphosphate EM 3.20 2019-06-18 0.00 88.57 1.00 0.96 98.11 0.61 0.03 ok
6OQ1_E P0CG47 Ubiquitin X-ray 2.20 2019-04-25 0.00 95.66 0.97 0.97 97.89 0.56 0.03 ok
6KE4_A P02794 Ferritin heavy chain X-ray 2.30 2019-07-03 1.70 98.10 0.99 0.96 98.08 0.66 0.03 ok
6PF1_A Q09472 Histone acetyltransferase p300 X-ray 2.32 2019-06-21 0.40 95.11 0.99 0.98 98.73 0.62 0.02 ok
6NCA_a P61769 Beta-2-microglobulin X-ray 3.30 2018-12-11 0.00 96.78 0.99 0.97 99.50 0.45 0.02 ok
6PGU_A Q09472 Histone acetyltransferase p300 X-ray 1.72 2019-06-24 0.40 95.05 0.99 0.99 99.28 0.53 0.02 ok
6KNV_C Q15596 Nuclear receptor coactivator 2 X-ray 2.80 2019-08-07 44.53 0.71 0.92 93.18 0.87 0.02 ok
6KKE_C Q15596 SRC2-3 X-ray 2.58 2019-07-25 44.53 0.76 0.95 95.45 0.77 0.02 ok
6KNW_C Q15596 Nuclear receptor coactivator 2 X-ray 2.67 2019-08-07 44.41 0.72 0.95 95.00 0.77 0.02 ok
6MSU_A P06756 Integrin alpha-V X-ray 3.11 2018-10-18 88.31 0.98 0.02 ok
6NWK_B Q9UBK2 Peroxisome proliferator-activated receptor X-ray 1.65 2019-02-06 60.13 0.65 0.99 97.92 0.54 0.02 ok
6MSL_A P06756 Integrin alpha-V X-ray 3.10 2018-10-16 88.31 0.98 0.02 ok
6KE2_A P02794 Ferritin heavy chain X-ray 1.80 2019-07-03 1.10 98.15 1.00 0.99 99.56 0.33 0.02 ok
6HZV_A P52333 Tyrosine-protein kinase JAK3 X-ray 2.46 2018-10-24 85.69 0.98 0.02 ok
6KKB_D Q15596 SRC2-3 X-ray 1.70 2019-07-24 44.53 0.70 0.97 97.73 0.59 0.02 ok
6MS7_A P37231 Peroxisome proliferator-activated receptor X-ray 1.43 2018-10-16 76.12 0.98 0.01 ok
6IMR_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 1.50 2018-10-23 67.44 0.99 0.01 ok
6IM6_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 1.70 2018-10-22 67.44 0.99 0.01 ok
6IND_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 1.87 2018-10-24 67.44 0.99 0.01 ok
6IMI_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 1.46 2018-10-23 67.44 0.99 0.01 ok
6IMD_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 1.50 2018-10-22 67.44 0.99 0.01 ok
6IMT_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 1.48 2018-10-23 67.44 0.99 0.00 ok
6IMO_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 1.55 2018-10-23 67.44 0.99 0.00 ok
6IMB_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 1.55 2018-10-22 67.44 0.99 0.00 ok
6INK_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 1.70 2018-10-25 67.44 0.99 0.00 ok
6INM_A Q08499 cAMP-specific 3',5'-cyclic phosphodiestera X-ray 2.00 2018-10-26 67.44 0.99 0.00 ok
6MQ8_A Q9Y253 DNA polymerase eta X-ray 1.97 2018-10-09 76.88 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.