Live Stats, next update: Wed 09 Sep
Human PDBs Analysed
Confidently Wrong
Novel + Confidently Wrong
DB size
Visitors
Full statistics →
New PDB Depositions vs. Their Blind AlphaFold Predictions — A Running Test of “Is Folding Solved?”

Release week 2022-01-19

105
structures analysed (12 full · 11.4%)
11.0%
confidently wrong
11.0%
novel sequences
00.0%
novel & wrong
0.964
median TM-score

Zoomed into the red "confidently wrong" box above (pLDDT ≥ 70, TM < 0.5) — the structures AlphaFold got confidently wrong.

The worst offenders ranked, one row per protein (AlphaFold has one model per sequence, so repeat depositions are collapsed — “×N” marks how many structures of that protein exist; the worst is shown). Each row joins what AlphaFold claimed (blue, pLDDT/100) to what the experiment showed (red, TM-score) — the longer the bar, the bigger the miss. Hover a dot to preview its Cα-deviation ribbon; click to open the full entry.

How to read this

Every point is one experimental protein structure. The horizontal axis is AlphaFold's own confidence in its prediction (mean pLDDT, 0–100). The vertical axis is how well that blind prediction actually matches the experiment (TM-score, 0–1; above 0.5 means the same fold, above 0.9 near-identical). Marker size grows with the FRAUD score (confidence-weighted error).

Cutoff: the shaded red box is the "confidently wrong" zone — AlphaFold was confident (mean pLDDT above 70) yet the fold is wrong (TM-score below 0.5). A predictor that had truly solved folding would leave that box empty.

Take-home: 1 of 105 structures (1.0%) are confidently wrong; median TM-score is 0.964.

Read moreShow less — how each metric is calculated

TM-score: how similar the two 3D shapes are overall, 0–1 (a random pair scores ~0.17, an identical fold ~1). Length-normalised so large and small proteins compare fairly. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) — dᵢ is the gap between the i-th aligned Cα atoms after best-fit superposition, and d₀ = 1.24(L−15)^⅓ − 1.8 sets the distance scale for length L. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264; computed with TM-align, doi:10.1093/nar/gki524.

pLDDT: AlphaFold's own confidence in each residue, 0–100 (higher = surer). It is the model predicting its own accuracy before ever seeing the experiment. We plot the per-structure mean. pLDDT = (1/N) Σᵢ pLDDTᵢ, where pLDDTᵢ is the network's confidence output for residue i.

FRAUD score: the headline number — how wrong the prediction was, weighted by how confident AlphaFold was, so a big error it was sure about counts most. FRAUD = (1/N) Σᵢ (pLDDTᵢ/100) · min(Δᵢ,15)/15, where Δᵢ is residue i's Cα distance from the experiment (Å) after superposition, capped at 15 Å. Runs 0 (perfect) to 1.

Novelty: how little AlphaFold had to go on — 100 minus the highest sequence identity between this protein and any structure released before the 2018-04-30 training cutoff. High = genuinely unseen (100% = nothing similar was ever in the training set). novelty = 100 − maxₚ identity(s, p) over pre-cutoff PDB chains p, with identity = 100 × (matching aligned residues)/(alignment length), from an MMseqs2 search.

Homology: the point colour. High novelty (above 70%) flags the sequence as novel (amber) — AlphaFold had no close template; otherwise a pre-cutoff homolog existed (blue) it could have learned the fold from. novel ⇔ novelty > 70%.

What the metrics mean

TM-score (0–1): overall fold match — above 0.5 is the same fold, above 0.9 near-identical. Cα-RMSD (Å): average backbone distance after best-fit superposition — lower is better (under 2 Å is excellent). lDDT (0–1): local accuracy measured without superposition — above 0.8 is good. Each bar counts how many structures fall in that range.

Take-home: median TM-score 0.964 — most predictions match the experimental fold well, with a long tail that do not.

Read moreShow less — how each metric is calculated

TM-score: overall shape match, 0–1 (above 0.5 = same fold, above 0.9 near-identical), length-normalised. TM = (1/L) Σᵢ 1/(1 + (dᵢ/d₀)²) with dᵢ the aligned-Cα gap after superposition and d₀ = 1.24(L−15)^⅓ − 1.8. Ref: Zhang & Skolnick, Proteins 2004 doi:10.1002/prot.20264.

Cα-RMSD: the average straight-line distance between matching backbone Cα atoms once the two structures are best-fit superposed (Å; lower is better, under ~2 Å excellent). RMSD = √( (1/N) Σᵢ |Pᵢ − (R·Qᵢ + t)|² ), with Pᵢ/Qᵢ the experimental/model Cα coordinates and R,t the rotation and translation from Kabsch superposition.

lDDT: local accuracy with no superposition — the fraction of short-range inter-residue distances the model reproduces, so it is not fooled by a single wrongly-placed domain. lDDT = (1/N) Σᵢ ¼ Σ_t 1[ |d_exp − d_model| < t ] over thresholds t ∈ {0.5, 1, 2, 4} Å and all residue pairs within 15 Å.

Trend over time

The blue line is the mean TM-score of the structures by their deposit month; the red bars count how many were confidently wrong. Binning by deposit date (rather than by when we processed them) gives an even timeline, tracking whether AlphaFold's accuracy on newly-deposited structures is holding steady, improving, or slipping as the PDB keeps growing. Months with fewer than 5 structures are omitted so each point is a meaningful average. A dashed trend line is drawn only if the change over time is statistically significant.

Read moreShow less — how each metric is calculated

Mean TM-score: the month's average shape-match score. TM̄ = (1/M) Σ TM over the M structures deposited that month.

Trend line: a monotonic-trend test over the monthly means — Mann-Kendall (Kendall's τ) for significance, with a robust Theil-Sen slope for the line. Rank-based, so it tolerates the skewed TM distribution and noisy low-count months. Shown only when p < 0.05; otherwise a note reports that no significant trend was found.

Confidently wrong: the count that were both confident and wrong. count( mean pLDDT > 70 AND TM < 0.5 ).

Matched structures

PDBUniProtProteinMethodÅDeposited Novelty %pLDDTTMlDDTGDT_TSRMSDFRAUDFlag
7T2I_A P21675 Transcription initiation factor TFIID subu X-ray 1.89 2021-12-04 0.00 89.67 0.55 0.90 3.64 16.53 0.72 ok
7T36_A P21675 Transcription initiation factor TFIID subu X-ray 1.65 2021-12-07 0.00 89.49 0.54 0.89 3.71 16.59 0.72 ok
7QJW_A P10636 Microtubule-associated protein tau EM 2.81 2021-12-17 0.00 67.98 0.25 0.45 0.67 24.31 0.65 ok
7DTH_A P61218 DNA-directed RNA polymerases I, II, and II NMR 2021-01-05 0.00 78.42 0.56 0.56 3.94 22.55 0.64 ok
7S1T_B Q96AP0 Adrenocortical dysplasia protein homolog X-ray 2.90 2021-09-02 0.00 66.03 0.39 0.78 7.09 15.20 0.50 ok
7RPM_A P36544 Neuronal acetylcholine receptor subunit al NMR 2021-08-03 50.80 69.50 0.60 0.60 14.96 17.33 0.36 ok
7LF4_D Q04206 Transcription factor p65 X-ray 2.85 2021-01-15 0.00 87.45 0.29 0.56 42.86 4.43 0.23 wrong
7W2Z_A P09471 Guanine nucleotide-binding protein G(o) su EM 2.80 2021-11-24 94.50 0.77 0.22 ok
7ROQ_A O95477 Phospholipid-transporting ATPase ABCA1 EM 4.10 2021-08-01 73.25 0.76 0.17 ok
7LET_C Q04206 Transcription factor p65 X-ray 2.40 2021-01-15 72.19 0.76 0.17 ok
7RRA_A P33897 ATP-binding cassette sub-family D member 1 EM 4.40 2021-08-09 80.62 0.79 0.17 ok
7LFC_B P19838 Nuclear factor NF-kappa-B p105 subunit X-ray 2.10 2021-01-16 57.09 0.36 0.57 37.50 4.31 0.16 ok
7MRZ_A O95390 Growth/differentiation factor 11 X-ray 3.00 2021-05-10 73.12 0.80 0.15 ok
7LF4_B P19838 Nuclear factor NF-kappa-B p105 subunit X-ray 2.85 2021-01-15 57.00 0.43 0.57 40.91 3.95 0.14 ok
7SIL_A P41180 Isoform 1 of Extracellular calcium-sensing EM 2.70 2021-10-14 75.69 0.82 0.14 ok
7F83_A Q92847 Growth hormone secretagogue receptor type X-ray 2.94 2021-07-01 52.20 88.94 0.68 0.81 68.24 3.89 0.14 ok
7SIM_A P41180 Isoform 1 of Extracellular calcium-sensing EM 2.70 2021-10-14 75.69 0.82 0.14 ok
7W2Z_L Q9UBU3 Appetite-regulating hormone EM 2.80 2021-11-24 49.86 0.36 0.48 45.00 3.86 0.12 ok
7SIN_A P41180 Isoform 1 of Extracellular calcium-sensing EM 5.90 2021-10-14 75.69 0.87 0.10 ok
7NDX_B Q9Y266 Nuclear migration protein nudC X-ray 2.54 2021-02-02 100.00 novel 55.88 0.66 0.88 63.89 3.34 0.08 ok
7NTO_A Q8IZ69 tRNA (uracil-5-)-methyltransferase homolog X-ray 1.23 2021-03-10 81.56 0.90 0.08 ok
7VY6_E P08174 Complement decay-accelerating factor EM 3.02 2021-11-13 78.25 0.89 0.08 ok
7VY5_E P08174 Complement decay-accelerating factor EM 3.15 2021-11-13 78.25 0.90 0.08 ok
7RR9_A P33897 ATP-binding cassette sub-family D member 1 EM 3.50 2021-08-09 80.62 0.90 0.08 ok
7W2Z_R Q92847 Growth hormone secretagogue receptor type EM 2.80 2021-11-24 81.62 0.91 0.07 ok
7KY0_A P00533 Epidermal growth factor receptor X-ray 3.10 2020-12-06 75.94 0.91 0.07 ok
7W2Z_G P59768 Guanine nucleotide-binding protein G(I)/G( EM 2.80 2021-11-24 89.56 0.93 0.06 ok
7TE7_A P03372 Estrogen receptor X-ray 1.85 2022-01-04 66.44 0.91 0.06 ok
7SCZ_K P09874 Poly [ADP-ribose] polymerase 1 EM 3.50 2021-09-29 82.38 0.93 0.06 ok
7SCZ_C P04908 Histone H2A EM 3.50 2021-09-29 90.75 0.94 0.06 ok
7DV5_U O95342 Bile salt export pump EM 3.70 2021-01-12 83.12 0.94 0.05 ok
7W14_E P78310 Coxsackievirus and adenovirus receptor EM 2.20 2021-11-19 79.31 0.94 0.05 ok
7S1O_A Q9NUX5 Protection of telomeres protein 1 X-ray 2.55 2021-09-02 87.38 0.94 0.05 ok
7PKI_A Q9BYF1 Processed angiotensin-converting enzyme 2 X-ray 2.94 2021-08-25 90.69 0.95 0.05 ok
7VPG_B P52948 Isoform 3 of Nuclear pore complex protein X-ray 2.49 2021-10-17 55.72 0.91 0.05 ok
7SLZ_A Q8IVV7 Glucose-induced degradation protein 4 homo X-ray 1.97 2021-10-25 74.38 0.94 0.05 ok
7VPH_B P52948 Isoform 3 of Nuclear pore complex protein X-ray 2.80 2021-10-17 55.72 0.92 0.05 ok
7VYM_E P78310 Coxsackievirus and adenovirus receptor EM 3.68 2021-11-14 79.31 0.94 0.04 ok
7VYK_E P78310 Coxsackievirus and adenovirus receptor EM 2.79 2021-11-14 79.31 0.94 0.04 ok
7VXZ_E P78310 Coxsackievirus and adenovirus receptor EM 3.19 2021-11-13 79.31 0.95 0.04 ok
7VYL_E P78310 Coxsackievirus and adenovirus receptor EM 2.79 2021-11-14 79.31 0.95 0.04 ok
7Q9Q_BBB O43924 Retinal rod rhodopsin-sensitive cGMP 3',5' X-ray 1.45 2021-11-14 96.25 0.96 0.04 ok
7LBX_A Q00059 Transcription factor A, mitochondrial X-ray 2.70 2021-01-09 85.38 0.96 0.03 ok
7WBQ_A Q9BYF1 Angiotensin-converting enzyme 2 X-ray 3.34 2021-12-17 90.69 0.96 0.03 ok
7WBL_A Q9BYF1 Angiotensin-converting enzyme 2 EM 3.40 2021-12-17 90.69 0.96 0.03 ok
7FCZ_A Q13546 Receptor-interacting serine/threonine-prot X-ray 2.21 2021-07-15 69.75 0.95 0.03 ok
7Q9S_AAA O43924 Retinal rod rhodopsin-sensitive cGMP 3',5' X-ray 1.85 2021-11-14 96.25 0.97 0.03 ok
7DXD_A Q13507 Short transient receptor potential channel EM 3.90 2021-01-18 78.31 0.96 0.03 ok
7NTN_A Q8IZ69 tRNA (uracil-5-)-methyltransferase homolog X-ray 2.02 2021-03-10 81.56 0.96 0.03 ok
7RUN_A P07949 Proto-oncogene tyrosine-protein kinase rec X-ray 3.51 2021-08-17 78.81 0.96 0.03 ok
7S1U_A Q9NUX5 Protection of telomeres protein 1 X-ray 2.55 2021-09-02 87.38 0.97 0.03 ok
7LBW_A Q00059 Transcription factor A, mitochondrial X-ray 2.84 2021-01-09 85.38 0.97 0.03 ok
7SJ9_M Q9UPY8 Microtubule-associated protein RP/EB famil EM 3.80 2021-10-16 79.00 0.97 0.03 ok
7FD0_A Q13546 Receptor-interacting serine/threonine-prot X-ray 2.00 2021-07-15 69.75 0.96 0.03 ok
7KXZ_A P00533 Epidermal growth factor receptor X-ray 2.40 2020-12-06 75.94 0.96 0.03 ok
7SJ8_B Q13509 Tubulin beta-3 chain EM 3.60 2021-10-16 91.44 0.97 0.03 ok
7SJA_B Q13509 Tubulin beta-3 chain EM 3.80 2021-10-16 91.44 0.97 0.03 ok
7SJ7_B Q13509 Tubulin beta-3 chain EM 3.80 2021-10-16 91.44 0.97 0.03 ok
7SJ9_B Q13509 Tubulin beta-3 chain EM 3.80 2021-10-16 91.44 0.97 0.02 ok
7S1T_A Q9NUX5 Protection of telomeres protein 1 X-ray 2.90 2021-09-02 87.38 0.97 0.02 ok
7NDX_A P25685 DnaJ homolog subfamily B member 1 X-ray 2.54 2021-02-02 82.62 0.97 0.02 ok
7DTO_A P07355 Annexin A2 X-ray 2.80 2021-01-06 94.25 0.97 0.02 ok
7Q6V_A Q6PL18 ATPase family AAA domain-containing protei X-ray 1.96 2021-11-09 61.53 0.96 0.02 ok
7WBP_A Q9BYF1 Angiotensin-converting enzyme 2 X-ray 3.00 2021-12-17 90.69 0.97 0.02 ok
7Q6W_A Q6PL18 ATPase family AAA domain-containing protei X-ray 1.96 2021-11-09 61.53 0.96 0.02 ok
7ERE_A P30043 Flavin reductase (NADPH) X-ray 1.60 2021-05-06 97.75 0.98 0.02 ok
7Q6U_A Q6PL18 ATPase family AAA domain-containing protei X-ray 1.95 2021-11-09 61.53 0.96 0.02 ok
7Q6T_A Q6PL18 ATPase family AAA domain-containing protei X-ray 2.05 2021-11-09 61.53 0.96 0.02 ok
7ER8_A P30043 Flavin reductase (NADPH) X-ray 1.45 2021-05-06 97.75 0.98 0.02 ok
7ER9_A P30043 Flavin reductase (NADPH) X-ray 1.45 2021-05-06 97.75 0.98 0.02 ok
7ER6_A P30043 Flavin reductase (NADPH) X-ray 1.60 2021-05-06 97.75 0.98 0.02 ok
7ERA_A P30043 Flavin reductase (NADPH) X-ray 1.35 2021-05-06 97.75 0.98 0.02 ok
7ERD_A P30043 Flavin reductase (NADPH) X-ray 2.00 2021-05-06 97.75 0.98 0.02 ok
7ERB_A P30043 Flavin reductase (NADPH) X-ray 1.50 2021-05-06 97.75 0.98 0.02 ok
7ERC_A P30043 Flavin reductase (NADPH) X-ray 1.50 2021-05-06 97.75 0.98 0.02 ok
7SCZ_B P62805 Histone H4 EM 3.50 2021-09-29 89.81 0.98 0.02 ok
7KLX_A P18031 Tyrosine-protein phosphatase non-receptor X-ray 1.84 2020-11-01 81.25 0.98 0.01 ok
7R9C_A O60885 Bromodomain-containing protein 4 X-ray 1.50 2021-06-29 55.31 0.98 0.01 ok
7F8R_A O00299 Chloride intracellular channel protein 1 X-ray 2.51 2021-07-02 94.19 0.99 0.01 ok
7SCZ_D P06899 Histone H2B type 1-J EM 3.50 2021-09-29 85.50 0.98 0.01 ok
7ER7_A P30043 Flavin reductase (NADPH) X-ray 1.70 2021-05-06 97.75 0.99 0.01 ok
7Q9R_BBB O43924 Retinal rod rhodopsin-sensitive cGMP 3',5' X-ray 2.50 2021-11-14 96.25 0.99 0.01 ok
7KEY_A P18031 Tyrosine-protein phosphatase non-receptor X-ray 1.77 2020-10-13 81.25 0.99 0.01 ok
7KT0_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.36 2020-11-24 88.56 0.99 0.01 ok
7SCZ_A P68431 Histone H3.1 EM 3.50 2021-09-29 86.06 0.99 0.01 ok
7RXS_A O60885 Bromodomain-containing protein 4 X-ray 1.43 2021-08-23 55.31 0.98 0.01 ok
7E2O_A P37231 Peroxisome proliferator-activated receptor X-ray 3.20 2021-02-06 76.12 0.99 0.01 ok
7LF4_A O00629 Importin subunit alpha-3 X-ray 2.85 2021-01-15 86.06 0.99 0.01 ok
7RXT_A O60885 Bromodomain-containing protein 4 X-ray 1.68 2021-08-23 55.31 0.98 0.01 ok
7SJA_A P68363 Tubulin alpha-1B chain EM 3.80 2021-10-16 91.56 0.99 0.01 ok
7LAF_A O15296 Polyunsaturated fatty acid lipoxygenase AL X-ray 2.44 2021-01-06 95.19 0.99 0.01 ok
7SJ9_A P68363 Tubulin alpha-1B chain EM 3.80 2021-10-16 91.56 0.99 0.01 ok
7SJ8_A P68363 Tubulin alpha-1B chain EM 3.60 2021-10-16 91.56 0.99 0.01 ok
7SJ7_A P68363 Tubulin alpha-1B chain EM 3.80 2021-10-16 91.56 0.99 0.01 ok
7RXR_A O60885 Bromodomain-containing protein 4 X-ray 1.41 2021-08-23 55.31 0.99 0.01 ok
7LFC_A O00629 Importin subunit alpha-3 X-ray 2.10 2021-01-16 86.06 0.99 0.01 ok
7KT1_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.67 2020-11-24 88.56 0.99 0.01 ok
7KSZ_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.42 2020-11-24 88.56 0.99 0.01 ok
7KQX_A P14174 Macrophage migration inhibitory factor X-ray 1.60 2020-11-18 98.56 0.99 0.01 ok
7VPG_A P78406 mRNA export factor X-ray 2.49 2021-10-17 92.88 0.99 0.01 ok
7KT2_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.50 2020-11-24 88.56 0.99 0.01 ok
7KSU_A Q9NP87 DNA-directed DNA/RNA polymerase mu X-ray 1.65 2020-11-24 88.56 0.99 0.01 ok
7W2Z_B P62873 Guanine nucleotide-binding protein G(I)/G( EM 2.80 2021-11-24 97.06 0.99 0.00 ok
7L5C_A Q9Y316 Protein MEMO1 X-ray 2.55 2020-12-21 97.56 1.00 0.00 ok
7VPH_A P78406 mRNA export factor X-ray 2.80 2021-10-17 92.88 1.00 0.00 ok

Click a column header to sort. FRAUD = confidence-weighted error; a structure is flagged confidently wrong when mean pLDDT > 70 yet TM-score < 0.5.