Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2022-06-08

90
structures analysed (18 full · 20.0%)
55.6%
confidently wrong
55.6%
novel sequences
44.4%
novel & wrong
0.951
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 5 of 90 structures (5.6%) are confidently wrong; median TM-score is 0.951.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.951 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7QOO_H Q9H3R5 Centromere protein H EM 4.60 2021-12-24 100.00 novel 88.79 0.40 0.88 2.86 19.74 0.78 wrong
7QOO_R Q13352 Centromere protein R EM 4.60 2021-12-24 100.00 novel 88.51 0.31 0.55 3.52 21.21 0.77 wrong
7QOO_Q Q7L2Z9 Centromere protein Q EM 4.60 2021-12-24 100.00 novel 83.97 0.37 0.82 0.00 23.03 0.77 wrong
7RAM_D P16234 Platelet-derived growth factor receptor al EM 3.43 2021-07-02 68.30 81.84 0.62 0.85 6.66 14.27 0.61 ok
7QOO_K Q9BS16 Centromere protein K EM 4.60 2021-12-24 100.00 novel 83.46 0.40 0.85 5.83 12.25 0.59 wrong
7TW2_A P02730 Band 3 anion transport protein EM 4.80 2022-02-06 0.00 87.61 0.66 0.88 11.06 11.55 0.56 ok
7TW6_A P02730 Band 3 anion transport protein EM 5.60 2022-02-06 0.00 85.90 0.65 0.85 13.61 13.19 0.53 ok
7TW3_A P02730 Band 3 anion transport protein EM 4.40 2022-02-06 0.00 85.90 0.65 0.85 13.61 13.19 0.53 ok
7TW5_A P02730 Band 3 anion transport protein EM 5.70 2022-02-06 0.00 85.90 0.65 0.84 13.77 13.18 0.53 ok
7N5W_A O95365 Zinc finger and BTB domain-containing prot X-ray 2.24 2021-06-06 52.30 81.42 0.59 0.79 10.29 10.92 0.52 ok
7TVZ_A P02730 Band 3 anion transport protein EM 3.60 2022-02-06 0.00 84.83 0.65 0.85 13.44 13.12 0.52 ok
7TW0_A P02730 Band 3 anion transport protein EM 4.60 2022-02-06 0.00 85.90 0.67 0.84 20.06 11.89 0.44 ok
7TW1_A P02730 Band 3 anion transport protein EM 4.60 2022-02-06 0.00 85.90 0.69 0.82 22.29 11.44 0.41 ok
7QOO_U Q71F23 Centromere protein U EM 4.60 2021-12-24 100.00 novel 88.44 0.63 0.85 22.58 13.23 0.40 ok
7EYF_A O75694 Nuclear pore complex protein Nup155 EM 5.30 2021-05-30 0.00 87.96 0.64 0.55 23.10 8.09 0.39 ok
7QLF_A P01375 Tumor necrosis factor NMR 2021-12-20 91.14 0.24 0.52 43.75 4.04 0.22 wrong
7SR8_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.30 2021-11-08 89.56 0.76 0.21 ok
7QOO_I Q92674 Centromere protein I EM 4.60 2021-12-24 73.75 0.76 0.17 ok
7WH3_A P27105 Stomatin NMR 2021-12-29 84.31 0.80 0.16 ok
7S15_R P43220 Glucagon-like peptide 1 receptor EM 3.80 2021-09-01 81.50 0.82 0.14 ok
7U8C_BA2 Q13421 Mesothelin, cleaved form X-ray 1.74 2022-03-08 58.96 0.35 0.73 50.00 3.90 0.13 ok
7N5V_A O95365 Zinc finger and BTB domain-containing prot X-ray 3.08 2021-06-06 55.78 0.77 0.13 ok
7Q6J_A Q8TB36 Ganglioside-induced differentiation-associ X-ray 2.20 2021-11-08 87.31 0.85 0.13 ok
7QOO_O Q9BU64 Centromere protein O EM 4.60 2021-12-24 85.19 0.86 0.12 ok
7N5U_A O95365 Zinc finger and BTB domain-containing prot X-ray 2.86 2021-06-06 55.78 0.80 0.11 ok
7UE9_C P01024 Complement C3dg fragment X-ray 1.75 2022-03-21 79.75 0.87 0.10 ok
7YWD_A Q8TB36 Ganglioside-induced differentiation-associ X-ray 3.20 2022-02-13 87.31 0.88 0.10 ok
7OPW_B P03372 Estrogen receptor X-ray 1.81 2021-06-01 66.44 0.85 0.10 ok
7Q6K_A Q8TB36 Ganglioside-induced differentiation-associ X-ray 3.41 2021-11-08 87.31 0.89 0.10 ok
7SK2_A P30531 Sodium- and chloride-dependent GABA transp EM 3.82 2021-10-19 87.94 0.90 0.09 ok
7NZE_EEE P02458 Collagen alpha-1(II) chain X-ray 2.05 2021-03-24 41.55 0.32 0.84 51.92 3.48 0.09 ok
7QOO_W Q5EE01 Centromere protein W EM 4.60 2021-12-24 89.69 0.91 0.08 ok
7QOO_N Q96H22 Centromere protein N EM 4.60 2021-12-24 85.56 0.91 0.08 ok
7QOO_P Q6IPU0 Centromere protein P EM 4.60 2021-12-24 85.00 0.92 0.07 ok
7SR8_R O43614 Hypocretin receptor type 2 EM 3.30 2021-11-08 78.94 0.91 0.07 ok
7QOO_T Q96BT3 Centromere protein T EM 4.60 2021-12-24 56.12 0.88 0.07 ok
7XIJ_A Q92793 Isoform 2 of CREB-binding protein X-ray 1.82 2022-04-13 52.53 0.88 0.07 ok
7QOO_L Q8N0S6 Centromere protein L EM 4.60 2021-12-24 83.06 0.93 0.06 ok
7XV7_A Q9C0D3 Protein zyg-11 homolog B X-ray 2.60 2022-05-21 92.31 0.95 0.05 ok
7F0N_A P62979 Ubiquitin-40S ribosomal protein S27a X-ray 1.60 2021-06-06 89.56 0.95 0.05 ok
7QOO_M Q9NSP4 Centromere protein M EM 4.60 2021-12-24 89.19 0.95 0.04 ok
7VRE_A P00533 Epidermal growth factor receptor X-ray 2.51 2021-10-22 75.94 0.95 0.04 ok
7RE5_A Q14721 Potassium voltage-gated channel subfamily X-ray 2.50 2021-07-12 61.94 0.94 0.04 ok
7NZE_BBB A2BFX2 HLA class II histocompatibility antigen DR X-ray 2.05 2021-03-24 85.31 0.96 0.04 ok
7TW5_G P16157 Ankyrin-1 EM 5.70 2022-02-06 69.75 0.95 0.04 ok
7R1Y_A O75694 Nuclear pore complex protein Nup155 EM 3.00 2022-02-03 83.12 0.96 0.03 ok
7F07_A P06730 Eukaryotic translation initiation factor 4 X-ray 2.25 2021-06-03 90.94 0.96 0.03 ok
7TW6_G P16157 Ankyrin-1 EM 5.60 2022-02-06 69.75 0.95 0.03 ok
7TW3_G P16157 Ankyrin-1 EM 4.40 2022-02-06 69.75 0.95 0.03 ok
7F05_A O14958 Calsequestrin-2 X-ray 2.30 2021-06-03 90.50 0.96 0.03 ok
7TW5_E P16452 Protein 4.2 EM 5.70 2022-02-06 89.00 0.96 0.03 ok
7SPD_A Q14721 Potassium voltage-gated channel subfamily X-ray 2.70 2021-11-02 61.94 0.95 0.03 ok
7TW6_E P16452 Protein 4.2 EM 5.60 2022-02-06 89.00 0.96 0.03 ok
7TW3_E P16452 Protein 4.2 EM 4.40 2022-02-06 89.00 0.96 0.03 ok
7VRA_A P00533 Epidermal growth factor receptor X-ray 2.41 2021-10-22 75.94 0.96 0.03 ok
7PAD_B O43924 Retinal rod rhodopsin-sensitive cGMP 3',5' X-ray 1.49 2021-07-29 96.25 0.97 0.03 ok
7TW0_E P16452 Protein 4.2 EM 4.60 2022-02-06 89.00 0.97 0.03 ok
7OPW_A P31947 14-3-3 protein sigma X-ray 1.81 2021-06-01 92.88 0.97 0.03 ok
7TW1_E P16452 Protein 4.2 EM 4.60 2022-02-06 89.00 0.97 0.03 ok
7TVZ_E P16452 Protein 4.2 EM 3.60 2022-02-06 89.00 0.97 0.03 ok
7PAE_B O43924 Retinal rod rhodopsin-sensitive cGMP 3',5' X-ray 1.85 2021-07-29 96.25 0.97 0.03 ok
7PAC_B O43924 Retinal rod rhodopsin-sensitive cGMP 3',5' X-ray 2.05 2021-07-29 96.25 0.97 0.03 ok
7NZE_AAA P01903 HLA class II histocompatibility antigen, D X-ray 2.05 2021-03-24 89.19 0.97 0.03 ok
7FIC_A O14965 Aurora kinase A X-ray 2.32 2021-07-31 75.06 0.97 0.03 ok
7SU9_A A2BF26 MHC class I antigen X-ray 1.99 2021-11-16 80.44 0.97 0.02 ok
7EZW_A P06730 Eukaryotic translation initiation factor 4 X-ray 2.35 2021-06-02 90.94 0.98 0.02 ok
7R2G_A Q9Y4E8 Ubiquitin carboxyl-terminal hydrolase 15 X-ray 1.98 2022-02-04 75.38 0.97 0.02 ok
7V62_A P22059 Oxysterol-binding protein 1 X-ray 3.25 2021-08-19 75.06 0.98 0.02 ok
7VP9_A Q16740 ATP-dependent Clp protease proteolytic sub X-ray 2.55 2021-10-15 82.31 0.98 0.02 ok
7OOT_A Q15306 Interferon regulatory factor 4 X-ray 2.25 2021-05-28 71.56 0.98 0.02 ok
7B1T_A O60885 Bromodomain-containing protein 4 X-ray 1.92 2020-11-25 55.31 0.97 0.02 ok
7SJQ_A Q9NZQ7 Programmed cell death 1 ligand 1 X-ray 2.00 2021-10-18 88.25 0.98 0.02 ok
7WWZ_A O60885 Isoform C of Bromodomain-containing protei X-ray 1.16 2022-02-14 55.31 0.97 0.01 ok
7UBO_A Q58F21 Bromodomain testis-specific protein X-ray 1.82 2022-03-15 62.44 0.98 0.01 ok
7SU9_B P61769 Beta-2-microglobulin X-ray 1.99 2021-11-16 94.06 0.99 0.01 ok
7P1N_A P22303 Acetylcholinesterase X-ray 2.95 2021-07-02 92.94 0.99 0.01 ok
7ROU_A P54577 Tyrosine--tRNA ligase, cytoplasmic X-ray 1.70 2021-08-02 90.81 0.99 0.01 ok
7WX2_A Q92793 CREB-binding protein X-ray 1.24 2022-02-14 52.53 0.98 0.01 ok
7A4Q_A P68400 Casein kinase II subunit alpha X-ray 1.42 2020-08-20 88.94 0.99 0.01 ok
7U9S_A P14920 D-amino-acid oxidase X-ray 2.10 2022-03-11 96.19 0.99 0.01 ok
7U9U_A P14920 D-amino-acid oxidase X-ray 1.66 2022-03-11 96.19 0.99 0.01 ok
7Q1U_A Q5VTY9 Protein-cysteine N-palmitoyltransferase HH EM 2.70 2021-10-21 92.94 0.99 0.01 ok
7QOO_C Q03188 Centromere protein C EM 4.60 2021-12-24 48.03 0.99 0.01 ok
7SR8_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.30 2021-11-08 97.06 0.99 0.01 ok
7P1N_aa P22303 Acetylcholinesterase X-ray 2.95 2021-07-02 92.94 1.00 0.00 ok
7RNZ_A P00918 Carbonic anhydrase 2 X-ray 1.30 2021-07-30 97.38 1.00 0.00 ok
7RNY_A P00918 Carbonic anhydrase 2 X-ray 1.29 2021-07-30 97.38 1.00 0.00 ok
7RAD_A P30837 Aldehyde dehydrogenase X, mitochondrial X-ray 2.30 2021-07-01 95.50 1.00 0.00 ok
7MJD_A P30837 Aldehyde dehydrogenase X, mitochondrial X-ray 2.12 2021-04-20 95.50 1.00 0.00 ok
7MJC_A P30837 Aldehyde dehydrogenase X, mitochondrial X-ray 2.68 2021-04-20 95.50 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.