Live Stats, next update: Wed 02 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2019-09-04

107
structures analysed (99 full · 92.5%)
21.9%
confidently wrong
109.3%
novel sequences
00.0%
novel & wrong
0.964
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 2 of 107 structures (1.9%) are confidently wrong; median TM-score is 0.964.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.964 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
6PXV_A P06213 Insulin receptor EM 3.20 2019-07-27 0.20 87.54 0.49 0.90 0.18 19.59 0.81 wrong
6JT2_B Q02153 Guanylate cyclase soluble subunit beta-1 EM 3.80 2019-04-08 0.00 88.50 0.53 0.85 2.55 18.75 0.75 ok
6QVW_A Q12778 Forkhead box protein O1 NMR 2019-03-05 0.90 81.47 0.66 0.75 4.20 17.67 0.69 ok
6PXW_A P06213 Insulin receptor EM 3.10 2019-07-28 0.20 87.26 0.59 0.88 5.74 18.10 0.67 ok
6SC2_D Q96EX3 WD repeat-containing protein 34 EM 3.90 2019-07-23 75.00 novel 87.57 0.75 0.68 6.67 18.83 0.63 ok
6JT2_A Q02108 Guanylate cyclase soluble subunit alpha-1 EM 3.80 2019-04-08 0.50 88.88 0.61 0.86 10.33 12.45 0.57 ok
6MUN_A P55036 26S proteasome non-ATPase regulatory subun NMR 2018-10-23 0.00 63.38 0.35 0.72 4.28 14.68 0.50 ok
6SC2_C Q8WVS4 WD repeat-containing protein 60 EM 3.90 2019-07-23 79.20 novel 84.95 0.80 0.67 21.56 12.08 0.40 ok
6PX5_X P00734 Prothrombin X-ray 2.40 2019-07-24 0.00 87.00 0.61 0.84 30.36 7.73 0.31 ok
6SC2_E Q8TCX1 Cytoplasmic dynein 2 light intermediate ch EM 3.90 2019-07-23 100.00 novel 88.43 0.78 0.70 36.46 8.60 0.30 ok
6QH6_B P63010 AP-2 complex subunit beta X-ray 5.00 2019-01-15 0.00 91.53 0.79 0.86 36.25 5.03 0.27 ok
6QH7_B P63010 AP-2 complex subunit beta X-ray 3.40 2019-01-15 0.00 91.53 0.80 0.87 36.11 5.00 0.27 ok
6S0A_A P27918 Properdin X-ray 2.52 2019-06-14 0.00 92.47 0.82 0.96 53.49 4.55 0.20 ok
6P9U_A P00734 Prothrombin X-ray 3.30 2019-06-10 0.00 92.23 0.68 0.83 53.33 4.16 0.19 ok
6S0A_B P27918 Properdin X-ray 2.52 2019-06-14 0.00 87.60 0.69 0.92 50.47 3.73 0.19 ok
6S0B_A P27918 Properdin X-ray 2.31 2019-06-14 0.00 91.34 0.82 0.96 52.31 3.91 0.19 ok
6R0X_E O95866 Megakaryocyte and platelet inhibitory rece X-ray 3.13 2019-03-13 100.00 novel 92.47 0.89 0.61 64.90 4.34 0.19 ok
6QIG_A Q76LX8 A disintegrin and metalloproteinase with t X-ray 2.80 2019-01-18 0.30 89.73 0.91 0.95 58.52 2.72 0.15 ok
6S8S_B Q96F86 Enhancer of mRNA-decapping protein 3 X-ray 2.21 2019-07-10 0.00 71.94 0.49 0.80 51.35 4.15 0.15 wrong
6S08_A P27918 Properdin X-ray 2.03 2019-06-14 0.00 92.82 0.89 0.99 69.17 2.21 0.11 ok
6QH5_B P63010 AP-2 complex subunit beta X-ray 2.56 2019-01-15 0.00 89.90 0.94 0.86 71.46 3.20 0.11 ok
6PXW_C A6XGL2 Insulin EM 3.10 2019-07-28 14.00 42.83 0.36 0.41 44.79 3.94 0.10 ok
6PXV_D A6XGL2 Insulin EM 3.20 2019-07-27 14.00 42.83 0.36 0.41 44.79 3.94 0.10 ok
6PX5_B P00734 Prothrombin X-ray 2.40 2019-07-24 0.00 90.94 0.89 0.78 78.63 3.05 0.10 ok
6REY_E P28066 Proteasome subunit alpha type-5 EM 3.00 2019-04-12 0.00 95.45 0.93 0.90 78.52 2.98 0.10 ok
6RH5_A Q8NC96 Adaptin ear-binding coat-associated protei NMR 2019-04-18 1.60 88.13 0.85 0.85 75.75 2.76 0.10 ok
6RH6_A Q8NC96 Adaptin ear-binding coat-associated protei NMR 2019-04-18 1.60 88.13 0.84 0.82 76.69 2.36 0.09 ok
6O0V_A Q6SZW1 Sterile alpha and TIR motif-containing pro X-ray 2.07 2019-02-17 100.00 novel 88.50 0.92 0.89 80.85 2.48 0.08 ok
6P9U_B P00734 Prothrombin X-ray 3.30 2019-06-10 0.40 90.99 0.92 0.81 84.90 2.52 0.08 ok
6RGQ_D O14818 Proteasome subunit alpha type-7 EM 2.60 2019-04-17 0.00 95.27 0.95 0.90 87.07 2.54 0.07 ok
6PL2_A P04629 High affinity nerve growth factor receptor X-ray 2.59 2019-06-30 0.00 86.82 0.95 0.88 84.68 2.28 0.07 ok
6RGQ_B P25787 Proteasome subunit alpha type-2 EM 2.60 2019-04-17 0.00 95.38 0.96 0.93 86.90 2.72 0.07 ok
6PL3_A P04629 High affinity nerve growth factor receptor X-ray 3.00 2019-06-30 0.00 87.29 0.95 0.89 85.31 2.08 0.07 ok
6S0B_B P27918 Properdin X-ray 2.31 2019-06-14 0.00 91.52 0.90 0.94 83.98 1.27 0.07 ok
6N46_A O00444 Serine/threonine-protein kinase PLK4 X-ray 3.71 2018-11-17 1.80 90.01 0.94 0.92 84.91 1.44 0.07 ok
6SC2_G Q9NP97 Dynein light chain roadblock-type 1 EM 3.90 2019-07-23 0.00 93.81 0.90 0.89 88.71 1.26 0.07 ok
6OV3_A O95484 Claudin-9 X-ray 3.25 2019-05-06 32.30 87.31 0.93 0.84 86.03 1.65 0.07 ok
6S8S_A P26196 Probable ATP-dependent RNA helicase DDX6 X-ray 2.21 2019-07-10 0.00 94.17 0.94 0.90 92.56 1.96 0.06 ok
6S08_B P27918 Properdin X-ray 2.03 2019-06-14 0.00 91.47 0.92 0.93 87.86 1.18 0.06 ok
6REY_C P25789 Proteasome subunit alpha type-4 EM 3.00 2019-04-12 0.00 94.83 0.95 0.89 89.98 1.46 0.06 ok
6MUN_B Q9UHD9 Ubiquilin-2 NMR 2018-10-23 61.03 0.90 0.06 ok
6N0P_A P15056 Serine/threonine-protein kinase B-raf X-ray 2.37 2018-11-07 0.00 87.95 0.94 0.88 87.87 2.16 0.06 ok
6MER_A Q9Y5G1 Protocadherin gamma-B3 X-ray 3.00 2018-09-06 75.38 0.92 0.06 ok
6MCQ_B Q9H8S9 MOB kinase activator 1A X-ray 2.57 2018-09-01 88.25 0.94 0.06 ok
6P50_C P16871 Interleukin-7 receptor subunit alpha X-ray 2.90 2019-05-29 0.00 94.47 0.93 0.89 92.50 1.31 0.06 ok
6MCP_B Q9H8S9 MOB kinase activator 1A X-ray 2.50 2018-09-01 88.25 0.94 0.06 ok
6RGQ_C P25789 Proteasome subunit alpha type-4 EM 2.60 2019-04-17 0.00 94.12 0.97 0.94 93.12 1.98 0.05 ok
6OV2_A O95484 Claudin-9 X-ray 3.20 2019-05-06 32.30 87.32 0.94 0.87 87.91 1.44 0.05 ok
6REY_D O14818 Proteasome subunit alpha type-7 EM 3.00 2019-04-12 0.00 96.14 0.97 0.89 92.62 1.15 0.05 ok
6REY_c Q14997 Proteasome activator complex subunit 4 EM 3.00 2019-04-12 80.30 novel 91.41 0.99 0.91 93.30 1.24 0.05 ok
6MEQ_A Q9Y5G1 Protocadherin gamma-B3 X-ray 2.90 2018-09-06 75.38 0.93 0.05 ok
6GG3_A P14618 Pyruvate kinase PKM X-ray 3.72 2018-05-02 96.81 0.95 0.05 ok
6PTE_A P04439 HLA class I histocompatibility antigen, A- X-ray 1.90 2019-07-15 0.00 96.82 0.98 0.97 94.73 0.84 0.04 ok
6RGQ_E P28066 Proteasome subunit alpha type-5 EM 2.60 2019-04-17 0.00 94.87 0.97 0.93 94.74 1.22 0.04 ok
6O0U_A Q6SZW1 Sterile alpha and TIR motif-containing pro X-ray 3.03 2019-02-17 100.00 novel 88.67 0.96 0.93 95.18 1.34 0.04 ok
6P1P_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.75 2019-05-20 0.00 96.63 0.99 0.96 96.43 1.50 0.04 ok
6O1B_A Q6SZW1 Sterile alpha and TIR motif-containing pro X-ray 1.67 2019-02-18 100.00 novel 88.75 0.95 0.90 92.45 1.50 0.04 ok
6REY_G P25788 Proteasome subunit alpha type-3 EM 3.00 2019-04-12 0.00 95.70 0.98 0.95 95.87 0.89 0.04 ok
6PTB_A P04439 HLA class I histocompatibility antigen, A- X-ray 2.15 2019-07-15 0.00 96.82 0.99 0.98 96.73 0.69 0.04 ok
6O0R_A Q6SZW1 Sterile alpha and TIR motif-containing pro X-ray 1.80 2019-02-17 100.00 novel 88.67 0.96 0.94 95.36 1.24 0.04 ok
6O0Q_A Q6SZW1 Sterile alpha and TIR motif-containing pro X-ray 1.80 2019-02-17 100.00 novel 88.67 0.96 0.93 95.36 1.22 0.04 ok
6P67_G P16871 Interleukin-7 receptor subunit alpha X-ray 2.90 2019-06-03 0.00 94.86 0.98 0.94 96.03 0.75 0.04 ok
6REY_I Q99436 Proteasome subunit beta type-7 EM 3.00 2019-04-12 0.00 96.00 0.98 0.98 96.72 0.74 0.04 ok
6OPD_A P04439 HLA class I histocompatibility antigen, A- X-ray 1.79 2019-04-24 0.00 96.82 0.99 0.97 98.27 0.69 0.04 ok
6P1W_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.75 2019-05-20 0.00 96.67 0.99 0.96 97.03 1.17 0.04 ok
6P1M_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.65 2019-05-20 0.00 96.72 0.99 0.97 97.00 0.75 0.04 ok
6REY_F P25786 Proteasome subunit alpha type-1 EM 3.00 2019-04-12 0.00 96.60 0.98 0.96 96.40 0.89 0.03 ok
6REY_A P60900 Proteasome subunit alpha type-6 EM 3.00 2019-04-12 0.00 96.86 0.98 0.94 96.90 0.79 0.03 ok
6KC4_A P16591 Tyrosine-protein kinase Fer X-ray 1.37 2019-06-27 0.00 91.04 0.96 0.95 95.54 0.82 0.03 ok
6REY_B P25787 Proteasome subunit alpha type-2 EM 3.00 2019-04-12 0.00 96.09 0.99 0.96 97.78 0.64 0.03 ok
6P1T_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.70 2019-05-20 0.00 96.68 0.99 0.97 97.48 0.97 0.03 ok
6P1V_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.95 2019-05-20 0.00 96.69 0.99 0.97 97.39 0.93 0.03 ok
6P1N_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.60 2019-05-20 0.00 96.68 0.99 0.97 97.78 0.96 0.03 ok
6RGQ_A P60900 Proteasome subunit alpha type-6 EM 2.60 2019-04-17 0.00 96.57 0.98 0.95 97.29 0.81 0.03 ok
6REY_L P28074 Proteasome subunit beta type-5 EM 3.00 2019-04-12 0.00 95.69 0.99 0.96 99.00 0.57 0.03 ok
6P1O_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.65 2019-05-20 0.00 96.69 0.99 0.98 98.24 0.91 0.03 ok
6P1R_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.70 2019-05-20 0.00 96.69 0.99 0.98 98.16 0.91 0.03 ok
6P1Q_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.90 2019-05-20 0.00 96.61 0.99 0.98 98.32 0.91 0.03 ok
6S0B_C P01024 Complement C3 X-ray 2.31 2019-06-14 0.00 82.02 0.98 0.95 97.66 0.92 0.03 ok
6RGQ_G P25788 Proteasome subunit alpha type-3 EM 2.60 2019-04-17 0.00 96.38 0.99 0.97 98.22 0.55 0.03 ok
6RGQ_I Q99436 Proteasome subunit beta type-7 EM 2.60 2019-04-17 0.00 96.07 0.99 0.98 98.52 0.57 0.03 ok
6P1U_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.75 2019-05-20 0.00 96.71 0.99 0.98 98.39 0.70 0.03 ok
6RGQ_N P28070 Proteasome subunit beta type-4 EM 2.60 2019-04-17 0.00 96.26 0.99 0.96 98.23 0.73 0.03 ok
6RGQ_L P28074 Proteasome subunit beta type-5 EM 2.60 2019-04-17 0.00 95.69 0.99 0.97 99.12 0.54 0.03 ok
6O0T_A Q6SZW1 Sterile alpha and TIR motif-containing pro X-ray 2.80 2019-02-17 29.80 96.23 0.99 0.98 98.93 0.50 0.03 ok
6PTB_B P61769 Beta-2-microglobulin X-ray 2.15 2019-07-15 0.00 96.78 0.98 0.98 99.00 0.56 0.03 ok
6P1S_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.75 2019-05-20 0.00 96.72 0.99 0.98 98.85 0.64 0.03 ok
6REY_J P49720 Proteasome subunit beta type-3 EM 3.00 2019-04-12 0.00 97.44 0.99 0.97 99.51 0.47 0.03 ok
6O0S_A Q6SZW1 Sterile alpha and TIR motif-containing pro X-ray 2.70 2019-02-17 29.80 96.23 0.99 0.98 98.93 0.48 0.03 ok
6RGQ_F P25786 Proteasome subunit alpha type-1 EM 2.60 2019-04-17 0.00 97.01 0.99 0.97 98.50 0.50 0.03 ok
6RGQ_J P49720 Proteasome subunit beta type-3 EM 2.60 2019-04-17 0.00 97.44 0.99 0.98 99.51 0.43 0.02 ok
6OPD_B P61769 Beta-2-microglobulin X-ray 1.79 2019-04-24 0.00 96.78 0.98 0.97 98.25 0.58 0.02 ok
6REY_M P20618 Proteasome subunit beta type-1 EM 3.00 2019-04-12 0.00 97.20 0.99 0.98 99.65 0.41 0.02 ok
6REY_H P28072 Proteasome subunit beta type-6 EM 3.00 2019-04-12 0.00 96.06 0.99 0.98 99.75 0.41 0.02 ok
6SC2_I P63167 Dynein light chain 1, cytoplasmic EM 3.90 2019-07-23 0.00 96.84 0.98 0.97 99.13 0.48 0.02 ok
6REY_K P49721 Proteasome subunit beta type-2 EM 3.00 2019-04-12 0.00 97.70 0.99 0.98 99.87 0.38 0.02 ok
6PTE_B P61769 Beta-2-microglobulin X-ray 1.90 2019-07-15 0.00 96.78 0.99 0.98 98.50 0.57 0.02 ok
6QVL_A P34897 Serine hydroxymethyltransferase, mitochond X-ray 2.28 2019-03-03 0.00 97.91 1.00 0.99 99.23 0.52 0.02 ok
6RGQ_H P28072 Proteasome subunit beta type-6 EM 2.60 2019-04-17 0.00 95.61 0.99 0.98 99.13 0.44 0.02 ok
6REY_N P28070 Proteasome subunit beta type-4 EM 3.00 2019-04-12 0.00 96.30 0.99 0.98 99.51 0.38 0.02 ok
6RGQ_M P20618 Proteasome subunit beta type-1 EM 2.60 2019-04-17 0.00 97.25 1.00 0.98 99.88 0.37 0.02 ok
6QVG_A P34897 Serine hydroxymethyltransferase, mitochond X-ray 2.32 2019-03-01 0.00 97.91 0.99 0.99 99.01 0.53 0.02 ok
6RGQ_K P49721 Proteasome subunit beta type-2 EM 2.60 2019-04-17 0.00 97.70 1.00 0.99 99.74 0.33 0.02 ok
6SNY_B Q9UNN8 Endothelial protein C receptor X-ray 3.11 2019-08-27 0.00 96.57 0.99 0.99 99.41 0.43 0.02 ok
6OZE_A Q8N8Q3 Endonuclease V X-ray 1.50 2019-05-15 2.60 96.77 1.00 1.00 99.90 0.28 0.01 ok
6HGT_A O75164 Lysine-specific demethylase 4A X-ray 2.33 2018-08-23 71.81 1.00 0.00 ok
6HG8_A P09622 Dihydrolipoyl dehydrogenase, mitochondrial X-ray 1.76 2018-08-22 94.00 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.