Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2019-11-06

56
structures analysed (52 full · 92.9%)
00.0%
confidently wrong
11.8%
novel sequences
00.0%
novel & wrong
0.968
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 0 of 56 structures (0.0%) are confidently wrong; median TM-score is 0.968.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.968 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6NZD_H Q8NFG4 Folliculin EM 3.60 2019-02-13 1.40 90.71 0.51 0.83 13.76 10.29 0.53 ok
6SHS_A P05067 Amyloid-beta precursor protein EM 4.40 2019-08-08 0.00 46.83 0.40 0.53 6.88 15.01 0.32 ok
6SOZ_C P02787 Serotransferrin X-ray 3.42 2019-08-30 0.00 95.13 0.85 0.96 39.59 5.69 0.30 ok
6SOY_C P02787 Serotransferrin X-ray 2.75 2019-08-30 0.00 95.12 0.85 0.96 39.95 5.51 0.29 ok
6NZD_F Q7L523 Ras-related GTP-binding protein A EM 3.60 2019-02-13 0.00 95.76 0.81 0.80 46.04 3.90 0.22 ok
6NZD_A Q6IAA8 Ragulator complex protein LAMTOR1 EM 3.60 2019-02-13 0.70 95.60 0.76 0.91 64.81 5.10 0.14 ok
6IUP_A P22455 Fibroblast growth factor receptor 4 X-ray 2.00 2018-11-29 1.00 87.80 0.90 0.86 70.75 4.16 0.12 ok
6QB6_A Q07820 Induced myeloid leukemia cell differentiat X-ray 2.24 2018-12-20 0.00 88.75 0.92 0.87 68.40 5.36 0.12 ok
6NZD_I Q9P278 Folliculin-interacting protein 2 EM 3.60 2019-02-13 100.00 novel 89.41 0.95 0.77 76.22 2.25 0.10 ok
6N7Y_F P14324 Farnesyl pyrophosphate synthase X-ray 2.00 2018-11-28 0.00 97.01 0.96 0.96 84.82 1.51 0.08 ok
6E37_B P68400 TYR-PRO-GLY-GLY-SER-THR-PRO-VAL-SER-SER-AL X-ray 2.53 2018-07-13 39.52 0.23 0.76 56.25 3.46 0.07 ok
6J15_C Q15116 Programmed cell death protein 1 X-ray 2.60 2018-12-27 0.00 93.13 0.93 0.93 86.14 1.70 0.07 ok
6OIM_A P01116 GTPase KRas X-ray 1.65 2019-04-09 0.00 95.14 0.94 0.89 85.54 1.75 0.07 ok
6N82_F P14324 Farnesyl pyrophosphate synthase X-ray 2.00 2018-11-28 0.00 96.67 0.97 0.97 86.80 1.34 0.07 ok
6OAG_F P14324 Farnesyl pyrophosphate synthase X-ray 2.30 2019-03-16 0.00 96.63 0.97 0.97 86.95 1.30 0.07 ok
6N7Z_F P14324 Farnesyl pyrophosphate synthase X-ray 2.55 2018-11-28 0.00 97.00 0.97 0.96 87.13 1.30 0.06 ok
6N83_F P14324 Farnesyl pyrophosphate synthase X-ray 2.00 2018-11-28 0.00 96.80 0.97 0.96 87.24 1.33 0.06 ok
6RA7_A Q9UKE5 TRAF2 and NCK-interacting protein kinase X-ray 1.20 2019-04-05 0.40 85.00 0.95 0.91 88.00 2.45 0.06 ok
6NZD_B Q9Y2Q5 Ragulator complex protein LAMTOR2 EM 3.60 2019-02-13 0.00 91.42 0.94 0.92 92.20 1.72 0.05 ok
6O4I_A P49419 Alpha-aminoadipic semialdehyde dehydrogena X-ray 1.75 2019-02-28 0.20 98.45 0.98 0.98 97.30 1.90 0.05 ok
6NZD_G Q9HB90 Ras-related GTP-binding protein C EM 3.60 2019-02-13 0.60 79.29 0.97 0.88 88.38 1.22 0.05 ok
6MPB_A Q15758 Neutral amino acid transporter B(0) EM 3.84 2018-10-05 78.31 0.94 0.04 ok
6J14_G Q15116 Programmed cell death protein 1 X-ray 1.40 2018-12-27 0.00 94.68 0.95 0.96 95.00 0.90 0.04 ok
6MP6_A Q15758 Neutral amino acid transporter B(0) EM 3.54 2018-10-05 78.31 0.94 0.04 ok
6QB4_A Q07820 Induced myeloid leukemia cell differentiat X-ray 2.38 2018-12-20 0.00 90.99 0.96 0.93 93.49 0.97 0.04 ok
6NZD_D Q0VGL1 Ragulator complex protein LAMTOR4 EM 3.60 2019-02-13 0.00 90.38 0.93 0.90 92.50 1.23 0.04 ok
6J04_A Q9GZQ8 Microtubule-associated proteins 1A/1B ligh X-ray 1.90 2018-12-21 0.90 93.62 0.97 0.95 95.94 0.92 0.04 ok
6NZD_E O43504 Hepatitis B virus x interacting protein EM 3.60 2019-02-13 0.00 96.56 0.95 0.95 94.23 0.90 0.04 ok
6QFC_A Q07820 Induced myeloid leukemia cell differentiat X-ray 1.96 2019-01-09 0.00 90.99 0.96 0.94 94.19 0.94 0.04 ok
6O68_A P37231 Peroxisome proliferator-activated receptor X-ray 2.78 2019-03-05 0.00 93.84 0.98 0.95 95.59 0.97 0.04 ok
6T1M_A Q03111 Protein ENL X-ray 1.85 2019-10-04 0.00 95.51 0.97 0.95 95.25 1.14 0.04 ok
6SHO_A O15392 Baculoviral IAP repeat-containing protein X-ray 3.20 2019-08-07 0.00 96.30 0.98 0.97 96.67 0.65 0.04 ok
6T1N_A Q03111 Protein ENL X-ray 1.95 2019-10-04 0.00 95.73 0.97 0.96 96.45 1.10 0.03 ok
6T1O_A Q03111 Protein ENL X-ray 1.90 2019-10-04 0.00 95.73 0.97 0.96 96.10 1.10 0.03 ok
6QB3_A Q07820 Induced myeloid leukemia cell differentiat X-ray 1.90 2018-12-20 0.00 90.99 0.98 0.96 97.54 0.70 0.03 ok
6O67_A P37231 Peroxisome proliferator-activated receptor X-ray 2.52 2019-03-05 0.00 94.23 0.99 0.97 97.86 0.68 0.03 ok
6MZ0_A Q9NUW8 Tyrosyl-DNA phosphodiesterase 1 X-ray 1.97 2018-11-02 0.00 95.52 0.99 0.97 97.77 0.62 0.03 ok
6MYZ_A Q9NUW8 Tyrosyl-DNA phosphodiesterase 1 X-ray 1.66 2018-11-02 0.00 95.42 0.99 0.97 97.66 0.62 0.03 ok
6K7T_B P61769 Beta-2-microglobulin X-ray 1.60 2019-06-08 0.00 97.00 0.98 0.98 98.48 0.50 0.03 ok
6T1J_A Q03111 Protein ENL X-ray 1.97 2019-10-04 0.00 95.22 0.98 0.98 98.08 0.58 0.03 ok
6T1I_A Q03111 Protein ENL X-ray 1.80 2019-10-04 0.00 95.22 0.99 0.98 98.43 0.57 0.03 ok
6URC_A O75460 Serine/threonine-protein kinase/endoribonu X-ray 2.20 2019-10-23 72.69 0.97 0.02 ok
6T1L_A Q03111 Protein ENL X-ray 2.00 2019-10-04 0.00 95.51 0.99 0.98 98.42 0.52 0.02 ok
6NZD_C Q9UHA4 Ragulator complex protein LAMTOR3 EM 3.60 2019-02-13 0.00 96.29 0.99 0.97 98.35 0.63 0.02 ok
6E37_A O15294 O-GlcNAc transferase subunit p110 X-ray 2.53 2018-07-13 93.06 0.98 0.02 ok
6PW3_A Q6PKG0 La-related protein 1 X-ray 2.34 2019-07-22 1.30 92.74 0.99 0.97 98.09 0.60 0.02 ok
6OAH_F P14324 Farnesyl pyrophosphate synthase X-ray 2.20 2019-03-16 0.00 96.60 1.00 0.98 99.13 0.44 0.02 ok
6O4L_A P49419 Alpha-aminoadipic semialdehyde dehydrogena X-ray 1.85 2019-02-28 0.20 98.48 1.00 0.99 99.61 0.36 0.02 ok
6U3X_A Q8NBP7 Proprotein convertase subtilisin/kexin typ X-ray 2.64 2019-08-22 0.00 96.64 0.99 0.99 99.73 0.33 0.02 ok
6U2N_A Q8NBP7 Proprotein convertase subtilisin/kexin typ X-ray 2.15 2019-08-20 0.00 96.64 0.99 1.00 100.00 0.30 0.02 ok
6O4K_A P49419 Alpha-aminoadipic semialdehyde dehydrogena X-ray 2.06 2019-02-28 0.20 98.45 1.00 1.00 99.95 0.28 0.02 ok
6U36_A Q8NBP7 Proprotein convertase subtilisin/kexin typ X-ray 2.70 2019-08-21 0.00 96.64 0.99 0.99 99.73 0.30 0.02 ok
6U2P_A Q8NBP7 Proprotein convertase subtilisin/kexin typ X-ray 2.04 2019-08-20 0.00 96.64 0.99 1.00 100.00 0.30 0.02 ok
6U26_A Q8NBP7 Proprotein convertase subtilisin/kexin typ X-ray 1.53 2019-08-19 0.00 96.64 0.99 1.00 100.00 0.30 0.02 ok
6U2X_A P49419 Alpha-aminoadipic semialdehyde dehydrogena X-ray 2.15 2019-08-20 0.20 98.45 1.00 0.99 99.75 0.29 0.02 ok
6U38_A Q8NBP7 Proprotein convertase subtilisin/kexin typ X-ray 2.73 2019-08-21 0.00 96.64 0.99 1.00 99.73 0.27 0.01 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.