Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2024-06-19

112
structures analysed (9 full · 8.0%)
54.5%
confidently wrong
21.8%
novel sequences
10.9%
novel & wrong
0.943
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 5 of 112 structures (4.5%) are confidently wrong; median TM-score is 0.943.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.943 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
8RNU_A Q9Y287 Integral membrane protein 2B EM 3.40 2024-01-11 100.00 novel 90.92 0.55 0.69 8.86 14.16 0.66 ok
8JQ1_A Q01101 Insulinoma-associated protein 1 NMR 2023-06-13 0.00 76.93 0.40 0.64 14.45 12.49 0.48 wrong
8JPY_A Q01101 Insulinoma-associated protein 1 NMR 2023-06-13 0.00 76.93 0.40 0.64 14.45 12.49 0.48 wrong
8WZ2_L Q8CE23 Orexigenic neuropeptide QRFP EM 2.73 2023-11-01 100.00 novel 70.98 0.43 0.78 27.00 6.24 0.28 wrong
8WSS_L P20382 Pro-MCH EM 3.01 2023-10-17 71.00 0.14 0.52 26.47 5.65 0.26 wrong
8QH1_L Q6PJF2 IGK@ protein X-ray 2.65 2023-09-06 92.25 0.75 0.23 ok
8QH0_L Q6PJF2 IGK@ protein X-ray 1.87 2023-09-06 92.25 0.77 0.21 ok
8WST_L P20382 Pro-MCH EM 2.40 2023-10-17 69.62 0.23 0.56 36.67 4.85 0.21 ok
8QQE_A Q14565 Meiotic recombination protein DMC1/LIM15 h X-ray 3.46 2023-10-04 90.81 0.81 0.17 ok
8T51_E Q9NZC2 Triggering receptor expressed on myeloid c X-ray 1.90 2023-06-12 0.00 39.38 0.33 0.41 27.94 6.84 0.17 ok
8BWI_A Q9GZX9 Twisted gastrulation protein homolog 1 X-ray 3.40 2022-12-06 80.38 0.81 0.15 ok
8WSS_A P63096 Guanine nucleotide-binding protein G(i) su EM 3.01 2023-10-17 93.75 0.84 0.15 ok
8BWA_A Q9GZX9 Twisted gastrulation protein homolog 1 X-ray 3.61 2022-12-06 80.38 0.81 0.15 ok
8BWD_A Q9GZX9 Twisted gastrulation protein homolog 1 X-ray 2.63 2022-12-06 80.38 0.82 0.14 ok
8RMN_A Q5JW98 Calcium homeostasis modulator protein 4 EM 3.80 2024-01-08 74.50 0.81 0.14 ok
8RMM_A Q5JW98 Calcium homeostasis modulator protein 4 EM 3.26 2024-01-08 74.50 0.81 0.14 ok
8RML_A Q5JW98 Calcium homeostasis modulator protein 4 EM 3.84 2024-01-08 74.50 0.81 0.14 ok
9FBF_B Q15788 Nuclear receptor coactivator 1 X-ray 3.01 2024-05-13 46.72 0.71 0.14 ok
8ZR5_A P63092 Guanine nucleotide-binding protein G(s) su EM 3.31 2024-06-04 91.31 0.86 0.13 ok
8ZRK_A P63092 Guanine nucleotide-binding protein G(s) su EM 2.82 2024-06-04 91.31 0.86 0.13 ok
8RMK_A Q9HA72 Calcium homeostasis modulator protein 2 EM 3.07 2024-01-08 81.12 0.85 0.12 ok
8ZR5_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 3.31 2024-06-04 89.56 0.87 0.11 ok
9EZ2_B Q15596 Nuclear receptor coactivator 2 X-ray 1.80 2024-04-10 47.59 0.79 0.10 ok
9EZ1_B Q15596 Nuclear receptor coactivator 2 X-ray 1.95 2024-04-10 47.59 0.79 0.10 ok
9ATN_B Q76L83 Polycomb group protein ASXL2 NMR 2024-02-27 82.03 0.33 0.86 71.05 2.38 0.09 wrong
8WST_R Q969V1 Melanin-concentrating hormone receptor 2 EM 2.40 2023-10-17 88.88 0.90 0.09 ok
8WSS_R Q99705 Melanin-concentrating hormone receptor 1 EM 3.01 2023-10-17 84.44 0.90 0.09 ok
8BWL_C Q9GZX9 Twisted gastrulation protein homolog 1 X-ray 1.96 2022-12-06 80.38 0.90 0.08 ok
8UKV_A P00533 Epidermal growth factor receptor X-ray 2.94 2023-10-15 75.94 0.90 0.08 ok
8BWN_C Q9GZX9 Twisted gastrulation protein homolog 1 X-ray 2.57 2022-12-07 80.38 0.90 0.08 ok
8ZR5_C Q8TDV5 Glucose-dependent insulinotropic receptor EM 3.31 2024-06-04 86.75 0.91 0.08 ok
8T4I_B Q03519 Antigen peptide transporter 2 EM 5.10 2023-06-09 82.69 0.91 0.08 ok
8T4F_B Q03519 Antigen peptide transporter 2 EM 3.50 2023-06-09 82.69 0.91 0.08 ok
8BWM_C Q9GZX9 Twisted gastrulation protein homolog 1 X-ray 2.50 2022-12-07 80.38 0.91 0.08 ok
8ZRK_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.82 2024-06-04 89.56 0.92 0.07 ok
8ZRK_R Q8TDV5 Glucose-dependent insulinotropic receptor EM 2.82 2024-06-04 86.75 0.92 0.07 ok
8T4H_B Q03519 Antigen peptide transporter 2 EM 3.80 2023-06-09 82.69 0.92 0.07 ok
8T4I_A Q03518 Antigen peptide transporter 1 EM 5.10 2023-06-09 78.50 0.92 0.06 ok
8T4F_A Q03518 Antigen peptide transporter 1 EM 3.50 2023-06-09 78.50 0.92 0.06 ok
8WZ2_R Q96P65 Pyroglutamylated RF-amide peptide receptor EM 2.73 2023-11-01 78.75 0.93 0.06 ok
8T4J_A Q03518 Antigen peptide transporter 1 EM 3.90 2023-06-09 78.50 0.93 0.06 ok
8PJG_B P01911 HLA class II histocompatibility antigen, D X-ray 1.83 2023-06-23 88.44 0.94 0.05 ok
8VOV_A P55072 Transitional endoplasmic reticulum ATPase EM 3.60 2024-01-16 82.56 0.94 0.05 ok
9BU1_A P03372 Estrogen receptor X-ray 1.75 2024-05-16 66.44 0.92 0.05 ok
9BQE_A P03372 Estrogen receptor X-ray 1.98 2024-05-09 66.44 0.93 0.05 ok
8RML_C Q9HA72 Calcium homeostasis modulator protein 2 EM 3.84 2024-01-08 81.12 0.94 0.05 ok
8U32_A Q15116 Programmed cell death protein 1 X-ray 2.51 2023-09-07 74.12 0.93 0.05 ok
9EYR_B Q15788 Nuclear receptor coactivator 1 X-ray 2.56 2024-04-09 61.30 0.69 0.87 87.50 1.58 0.05 ok
8T4G_B Q03519 Antigen peptide transporter 2 EM 3.50 2023-06-09 82.69 0.94 0.05 ok
8PJE_B P01911 HLA class II histocompatibility antigen, D X-ray 1.70 2023-06-23 88.44 0.95 0.05 ok
8U31_A Q15116 Programmed cell death protein 1 X-ray 2.73 2023-09-07 74.12 0.94 0.05 ok
8PY3_A Q8IXJ6 NAD-dependent protein deacetylase sirtuin- X-ray 1.65 2023-07-24 81.69 0.94 0.05 ok
8VLS_A P55072 Transitional endoplasmic reticulum ATPase EM 2.90 2024-01-12 82.56 0.94 0.05 ok
8POD_A Q04771 Activin receptor type-1 X-ray 2.59 2023-07-04 83.12 0.94 0.05 ok
8BWL_A P43026 Growth/differentiation factor 5 X-ray 1.96 2022-12-06 70.00 0.93 0.05 ok
8T4H_A Q03518 Antigen peptide transporter 1 EM 3.80 2023-06-09 78.50 0.94 0.04 ok
8BWM_A P43026 Growth/differentiation factor 5 X-ray 2.50 2022-12-07 70.00 0.94 0.04 ok
8YR3_A Q9NP58 ATP-binding cassette sub-family B member 6 EM 3.20 2024-03-20 83.06 0.95 0.04 ok
8RMM_C Q9HA72 Calcium homeostasis modulator protein 2 EM 3.26 2024-01-08 81.12 0.95 0.04 ok
8T4G_A Q03518 Antigen peptide transporter 1 EM 3.50 2023-06-09 78.50 0.94 0.04 ok
8T4E_B Q03519 Antigen peptide transporter 2 EM 3.50 2023-06-09 82.69 0.95 0.04 ok
8BWN_A P43026 Growth/differentiation factor 5 X-ray 2.57 2022-12-07 70.00 0.94 0.04 ok
8PJF_B P01911 HLA class II histocompatibility antigen, D X-ray 1.48 2023-06-23 88.44 0.95 0.04 ok
8JEZ_A Q9UHI7 Solute carrier family 23 member 1 EM 2.60 2023-05-16 81.81 0.95 0.04 ok
8VKU_A P55072 Transitional endoplasmic reticulum ATPase EM 3.50 2024-01-09 82.56 0.95 0.04 ok
8PI8_A P20823 Hepatocyte nuclear factor 1-alpha X-ray 2.30 2023-06-21 56.97 0.93 0.04 ok
8GD7_A O75417 DNA polymerase theta X-ray 3.24 2023-03-03 59.34 0.94 0.04 ok
8T4E_A Q03518 Antigen peptide transporter 1 EM 3.50 2023-06-09 78.50 0.95 0.04 ok
8X71_A Q06830 Peroxiredoxin-1 X-ray 1.58 2023-11-22 97.19 0.97 0.03 ok
8X73_A Q06830 Peroxiredoxin-1 X-ray 1.61 2023-11-22 97.19 0.97 0.03 ok
8PJF_A P01903 HLA class II histocompatibility antigen, D X-ray 1.48 2023-06-23 89.19 0.96 0.03 ok
8T4Y_A O60741 Potassium/sodium hyperpolarization-activat EM 3.58 2023-06-12 68.94 0.95 0.03 ok
8RP8_C Q08722 Leukocyte surface antigen CD47 X-ray 2.00 2024-01-12 86.31 0.97 0.03 ok
8YR4_A Q9NP58 ATP-binding cassette sub-family B member 6 EM 3.10 2024-03-20 83.06 0.97 0.03 ok
8PJG_A P01903 HLA class II histocompatibility antigen, D X-ray 1.83 2023-06-23 89.19 0.97 0.03 ok
8T4J_B Q03519 Antigen peptide transporter 2 EM 3.90 2023-06-09 82.69 0.97 0.03 ok
8URF_A P07307 Asialoglycoprotein receptor 2 X-ray 1.90 2023-10-25 78.75 0.96 0.03 ok
8PJE_A P01903 HLA class II histocompatibility antigen, D X-ray 1.70 2023-06-23 89.19 0.97 0.03 ok
8PI7_A P20823 Hepatocyte nuclear factor 1-alpha X-ray 3.20 2023-06-21 56.97 0.96 0.02 ok
8ZM2_A Q15119 [Pyruvate dehydrogenase (acetyl-transferri X-ray 2.34 2024-05-22 90.75 0.98 0.02 ok
9EO0_A Q9NZQ7 Programmed cell death 1 ligand 1 X-ray 2.50 2024-03-14 88.25 0.98 0.02 ok
8XXW_A Q9BYF1 Processed angiotensin-converting enzyme 2 EM 3.03 2024-01-19 90.69 0.98 0.02 ok
9F9A_A Q96NY9 Crossover junction endonuclease MUS81 X-ray 2.91 2024-05-07 77.94 0.97 0.02 ok
8PI9_A P20823 Hepatocyte nuclear factor 1-alpha X-ray 2.80 2023-06-21 56.97 0.96 0.02 ok
8ZM1_A Q15119 [Pyruvate dehydrogenase (acetyl-transferri X-ray 2.35 2024-05-22 90.75 0.98 0.02 ok
9F99_A Q96NY9 Crossover junction endonuclease MUS81 X-ray 2.80 2024-05-07 77.94 0.97 0.02 ok
8W0S_A Q15125 3-beta-hydroxysteroid-Delta(8),Delta(7)-is EM 2.80 2024-02-14 95.56 0.98 0.02 ok
8QWL_A P04637 Cellular tumor antigen p53 X-ray 1.65 2023-10-19 75.06 0.98 0.01 ok
8Y65_A Q9NRM0 Solute carrier family 2, facilitated gluco EM 3.51 2024-02-01 82.62 0.98 0.01 ok
8W0R_A Q15125 3-beta-hydroxysteroid-Delta(8),Delta(7)-is EM 2.80 2024-02-14 95.56 0.99 0.01 ok
8TS0_A P07306 Asialoglycoprotein receptor 1 X-ray 1.70 2023-08-10 86.19 0.99 0.01 ok
8SWC_A O60930 Ribonuclease H1 X-ray 2.68 2023-05-18 79.56 0.98 0.01 ok
8RPB_P Q9NZQ7 Programmed cell death 1 ligand 1 X-ray 2.79 2024-01-15 88.25 0.99 0.01 ok
8QWN_A P04637 Cellular tumor antigen p53 X-ray 1.44 2023-10-19 75.06 0.99 0.01 ok
9F99_B Q96AY2 Crossover junction endonuclease EME1 X-ray 2.80 2024-05-07 67.50 0.98 0.01 ok
8RAK_A Q02127 Dihydroorotate dehydrogenase (quinone), mi X-ray 1.85 2023-12-01 96.12 0.99 0.01 ok
8QWK_A P04637 Cellular tumor antigen p53 X-ray 1.69 2023-10-19 75.06 0.99 0.01 ok
8Y66_A Q9NRM0 Solute carrier family 2, facilitated gluco EM 3.28 2024-02-01 82.62 0.99 0.01 ok
9F9A_B Q96AY2 Crossover junction endonuclease EME1 X-ray 2.91 2024-05-07 67.50 0.99 0.01 ok
9F9M_B Q96AY2 Crossover junction endonuclease EME1 X-ray 2.47 2024-05-08 67.50 0.99 0.01 ok
9F9M_A Q96NY9 Crossover junction endonuclease MUS81 X-ray 2.47 2024-05-08 77.94 0.99 0.01 ok
8PIA_A P20823 Hepatocyte nuclear factor 1-alpha X-ray 2.80 2023-06-21 56.97 0.99 0.01 ok
8POD_B P62942 Peptidyl-prolyl cis-trans isomerase FKBP1A X-ray 2.59 2023-07-04 96.25 0.99 0.01 ok
8ZR5_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 3.31 2024-06-04 97.06 0.99 0.01 ok
8ZRK_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.82 2024-06-04 97.06 0.99 0.01 ok
8W0T_A P28330 Long-chain specific acyl-CoA dehydrogenase X-ray 2.50 2024-02-14 92.81 0.99 0.00 ok
8QWP_A P04637 Cellular tumor antigen p53 X-ray 2.10 2023-10-19 75.06 0.99 0.00 ok
8QWM_A P04637 Cellular tumor antigen p53 X-ray 1.54 2023-10-19 75.06 0.99 0.00 ok
8QWO_A P04637 Cellular tumor antigen p53 X-ray 1.38 2023-10-19 75.06 0.99 0.00 ok
8W0Z_A P28330 Long-chain specific acyl-CoA dehydrogenase X-ray 2.00 2024-02-14 92.81 1.00 0.00 ok
8F4L_A P02794 Ferritin heavy chain EM 2.40 2022-11-11 95.31 1.00 0.00 ok
8W0U_A P28330 Long-chain specific acyl-CoA dehydrogenase X-ray 2.80 2024-02-14 92.81 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.