With only 15/100 on the AI-Readiness Index, towardsdatascience.com is at severe risk of being overlooked by AI-powered search and answer engines. Compared to other infrastructure sites (avg score: 57), towardsdatascience.com is trailing the benchmark, indicating room for competitive improvement. The low ghost ratio (0%) confirms that what crawlers see matches what users see — a hallmark of strong SSR implementation. Heavy markup overhead (31.3× bloat) forces AI systems to wade through excess code before finding useful information. Only 1 schema block is present — adding Organization, WebSite, and Breadcrumb schemas would significantly improve structured data coverage. Most AI crawlers are restricted by robots.txt, limiting how AI-powered search engines can index and surface this content.
🧮 Score Transparency — How is this calculated?
📊 ACRI Sub-Scores (AI Readiness Detail)
towardsdatascience.com punches above its weight in AI — AI visibility exceeds Google ranking. This is a competitive moat worth protecting. ACRI measures technical crawler readiness. Read the methodology →
Why towardsdatascience.com ranks here
Fastest improvements
- Allow GPTBot in robots.txt so AI crawlers can access your pages (see Crawl Access).
- Allow ClaudeBot (many assistants rely on it) — blocking it often correlates with “AI invisibility.”
- Reduce token bloat (navigation/footer/code) so agents reach your main content faster (see Token Bloat).
- Create an
llms.txtfile so AI crawlers can discover your content structure without heavy crawling. Generate llms.txt → - Run a full entropy audit to find which DOM regions waste the most tokens. Run Entropy Audit →
Traditional SEO
49/100 25 % of Global Score 🟢 High Confidence📝 Title Tag
Optimal range: 30–60 characters for SERP display.
📋 Meta Description
Optimal range: 120–160 characters for snippet control.
🔤 Heading Hierarchy
- ✗ Exactly 1 <h1> tag — found 0
- ✓ Has <h2> headings — found 32
- ✗ <h2> not before <h1>
🔍 Indexability
- ✓ Canonical tag present →
https://towardsdatascience.com/ - ✓ No noindex directive
- ✓ Meta viewport set
- ✓ HTML lang attribute →
en-US - ➖ Hreflang tags — N/A (single language site)
- ✓ Googlebot allowed by robots.txt
🌐 Social / OpenGraph
- ✓ og:title — Towards Data Science
- ✓ og:description — Your home for data science and AI. The world’s leading publication for data science, data analytics, data engineering, machine learning, and artificial intelligence professionals.
- ✓ og:image — preview
- ✓ twitter:card — summary_large_image
📐 How the SEO Pillar score is calculated
SEO Pillar = Title (20 pts) + Meta Desc (20 pts) + Heading Hierarchy (20 pts) + Indexability (20 pts) + Social/OG (20 pts)
Each sub-score is derived from the checks above. Canonical tag, lang attribute, og:image, and a single H1 are the highest-impact items.
AI Readiness / GEO
60/100 40 % of Global Score 🟢 High ConfidenceThis pillar aggregates citation share, hallucination risk, bot access, schema health, and content extractability. The individual diagnostic sections below contribute to this score.
Is AI lying about your brand? This panel measures how likely LLMs are to hallucinate facts when extracting information from your page.
🤖 Bot Access Matrix
Allow: / under User-agent: GPTBot in your robots.txt.📊 Structure & Information Density Docs
🏷️ Schema Health Docs
Schema Coverage Map
📐 AI Efficiency Metrics Docs
Token Bloat Research
Multimodal Readiness
TDM Rights
🔥 Structural Entropy Check Research
🔬 AI-Crawler Simulation
See your website the way AI crawlers do. CSS stripped, structure labeled, content chunked.
Toggle to "AI Agent View" to see what GPTBot, ClaudeBot, and other AI crawlers actually extract from this page.
AI Answer Preview
NEWSee how AI models summarize your site. Left: your actual content. Right: what the LLM extracts and says about you.
The LLM Interpretation
AI-VERIFIEDSEODiff AI analyzed the extracted content of towardsdatascience.com and produced this structured business intelligence. Fields marked SEMANTIC VOID indicate information the AI could not find — a critical gap in your site’s machine-readability.
🔧 Tech Stack
Performance & Speed
59/100 20 % of Global Score 🟢 High Confidence⏱️ Time to First Byte
Google considers <200 ms "good". AI crawlers may have even shorter timeouts.
📦 Page Weight
DOM nodes
HTML payload
🗄️ Cache & CDN
- ✓ Cache-Control header →
max-age=600, must-revalidate - ✓ CDN cache status →
DYNAMIC - ✓ CDN detected → cloudflare
🔬 Tracker Tax
tracker scripts
third-party domains
token overhead
📐 How the Performance Pillar score is calculated
Perf Pillar = TTFB (35 pts) + Page Weight (25 pts) + Cache/CDN (20 pts) + Tracker Tax (20 pts)
TTFB <200 ms = full marks. DOM >3000 or payload >300 KB incurs heavy penalties. Tracker scripts beyond 5 reduce score.
Architecture & Trust
68/100 15 % of Global Score 🟢 High Confidence🗺️ Sitemap & Robots
- ✓ Sitemap declared in robots.txt →
https://towardsdatascience.com/sitemap_index.xml - ✓ Googlebot allowed
- ✗ GPTBot allowed
- ✗ ClaudeBot allowed
🔗 Linking
internal links
external links
🔒 Security & Trust
- ✗ HSTS header (Strict-Transport-Security)
- ✗ Content-Security-Policy header
- ✓ HTTP status 200 OK (got 200)
♿ Accessibility Signals
- ✓ HTML lang attribute → en-US
- ✓ Meta viewport for mobile
- ✗ Single H1 for screen readers
📐 How the Architecture Pillar score is calculated
Arch Pillar = Sitemap & Robots (30 pts) + Linking (25 pts) + Security (25 pts) + Accessibility (20 pts)
Having a valid sitemap, allowing AI bots, HSTS, and a good internal link count are the highest-impact items.
🏅 AI-Verified Trust Badge
Your site scores 47/100. Reach 80+ to unlock the green "AI-Verified" badge. Fix the issues below to improve your score.
<a href="https://seodiff.io/radar/domains/towardsdatascience.com" rel="noopener"><img src="https://seodiff.io/api/v1/badge?domain=towardsdatascience.com" alt="AI-Verified by SEODiff" width="280" height="52"></a>
💡 Paste in your site footer, GitHub README, or email signature. Badge updates automatically as your score changes.
� Deep Crawl Analysis 1009 pages · Deep-10
Poorly formatted tables or pricing grids on 35 pages will be split incorrectly during RAG chunking, causing AI models to hallucinate prices and features.
| Page | Type | ACRI | Token Bloat | Words | Status |
|---|---|---|---|---|---|
| pricing | 85 | 9.9× | 4925 | 💰 Pricing | |
| pricing | 85 | 9.8× | 4802 | 💰 Pricing | |
| pricing | 85 | 9.4× | 4976 | 💰 Pricing | |
| blog | 85 | 8.3× | 5964 | ✓ | |
| pricing | 85 | 9.3× | 5171 | 💰 Pricing | |
| other | 85 | 8.9× | 5467 | ✓ | |
| other | 85 | 9.0× | 5531 | ✓ | |
| product | 85 | 8.7× | 5557 | ✓ | |
| other | 85 | 9.6× | 5400 | ✓ | |
| other | 85 | 9.9× | 4655 | ✓ | |
| blog | 85 | 9.7× | 4938 | ✓ | |
| pricing | 85 | 8.8× | 5494 | 💰 Pricing | |
| product | 85 | 5.9× | 8850 | ✓ | |
| pricing | 85 | 5.9× | 9656 | 💰 Pricing | |
| blog | 85 | 5.5× | 9766 | ✓ | |
| pricing | 85 | 7.9× | 6240 | 💰 Pricing | |
| pricing | 75 | 11.5× | 4620 | ⚠️ RAG Fracture | |
| pricing | 75 | 10.4× | 4564 | 💰 Pricing | |
| docs | 75 | 11.7× | 3843 | ✓ | |
| pricing | 75 | 11.2× | 3952 | 💰 Pricing |
| Path | Pages | Avg ACRI | Ghost % | Bloat | Top Issue |
|---|---|---|---|---|---|
| /building-interactive-data-visualizations-with-python-the-art-of-storytelling-ceb43db67488/ | 1 | 75 | 0% | 11.3× | High JS Bloat |
| /the-power-of-democracy-in-feature-selection-dfb75f970b6e/ | 1 | 72 | 0% | 15.2× | High JS Bloat |
| /exploring-the-most-popular-machine-learning-and-deep-learning-github-repositories-90b9ecf12be7/ | 1 | 72 | 0% | 14.4× | High JS Bloat |
| /python-documentation-testing-with-doctest-the-easy-way-c024556313ca/ | 1 | 75 | 0% | 10.1× | High JS Bloat |
| /ensuring-correct-use-of-transformers-in-scikit-learn-pipelines-393566db7bfa/ | 1 | 72 | 0% | 16.6× | High JS Bloat |
| /solve-problems-like-a-physicist-c42b795161c0/ | 1 | 72 | 0% | 16.7× | High JS Bloat |
| /weve-only-scratched-the-surface-of-the-full-potential-for-the-data-warehouse-a53d18aae170/ | 1 | 67 | 0% | 21.7× | High JS Bloat |
| /the-5-fundamentals-you-need-to-efficiently-self-teach-data-science-81b5d103cb0e/ | 1 | 67 | 0% | 22.1× | High JS Bloat |
| /is-public-speaking-the-cryptonite-of-data-scientists-bb7dac5925d6/ | 1 | 67 | 0% | 21.4× | High JS Bloat |
| /dynamic-eda-for-qatar-world-cup-teams-8945970f16be/ | 1 | 67 | 0% | 27.7× | High JS Bloat |
| /figuring-out-the-most-unusual-segments-in-data-af5fbeacb2b2/ | 1 | 75 | 0% | 14.0× | High JS Bloat |
| /data-lineage-explained-to-my-grandmother-6545cad08c41/ | 1 | 72 | 0% | 18.7× | High JS Bloat |
| /covid-19-mortality-triage-with-streamlit-pycaret-and-shap-a8f0dca64c7d/ | 1 | 67 | 0% | 25.8× | High JS Bloat |
| /project-management-the-right-way-57ce2d8b56bd/ | 1 | 67 | 0% | 20.4× | High JS Bloat |
| /securing-your-containerised-models-and-workloads-3bff4d90a07b/ | 1 | 67 | 0% | 21.8× | High JS Bloat |
Scores update automatically each month. Create a free account for on-demand re-crawls (3/month free).
🔌 API Access
Pull this data programmatically. All sub-page metrics are available via our public API.
curl https://seodiff.io/api/v1/deep10/domain/towardsdatascience.comGet your free API key — 100 requests/month included.
🔗 Similar infrastructure Sites
Domains with a similar tech stack, industry, and AI readiness profile to towardsdatascience.com. Compare side-by-side.
| Domain | ACRI | AI Score | Tech Stack | Token Bloat | Schema | |
|---|---|---|---|---|---|---|
| towardsdatascience.com (this site) | 47 | 15 | WordPress | 31.3× | 1 | — |
| videoslot.com | 72 | 79 | WordPress | 3.8× | 1 | Compare → |
| topcinema.media | 72 | 81 | WordPress | 7.7× | 1 | Compare → |
| bbqexperiencecenter.be | 72 | 81 | WordPress | 13.4× | 1 | Compare → |
| taos.org | 72 | 85 | WordPress | 6.9× | 1 | Compare → |
| rlive.md | 72 | 82 | WordPress | 3.2× | 1 | Compare → |
📊 Semantic Share of Voice
How often would an AI cite towardsdatascience.com when users ask about topics in this domain's niche? We run entity queries through our 188k-page search index and measure citation probability.
Analyzing citation landscape…
Bait & Switch Delta
B 15 PAGESCompares your homepage rendering quality with inner pages. A high drift score means AI crawlers see a polished homepage but degraded inner content — the "bait & switch" that erodes trust.
Worst Inner Pages
E-E-A-T Trust Signals
C 50/100Trust indicators extracted from surface pages. These signals help AI systems verify your site's Experience, Expertise, Authoritativeness, and Trustworthiness.
Citation Profile
54 DOMAINSOutbound citation patterns across surface-crawled pages. Sites that cite diverse, authoritative sources signal higher E-E-A-T to AI systems.
AI trust scores for the domains towardsdatascience.com links to. Citing high-trust sources lifts your own credibility signal.
Remediation Patches
COPY-PASTEAuto-generated code fixes tailored to towardsdatascience.com. Copy and paste these into your codebase to improve AI visibility. These patches are mathematically proven to increase extraction accuracy →
User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: /
User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: /
<!-- Move inline CSS to external stylesheets --> <link rel="stylesheet" href="/css/main.css"> <!-- Move inline scripts to external files with defer --> <script src="/js/app.js" defer></script> <!-- Remove duplicate navigation blocks --> <!-- Keep only ONE <nav> in the <header> --> <!-- Ensure <main> wraps your primary content --> <main> <!-- Your content here — this is what AI sees first --> </main>
<script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "FAQPage",
"mainEntity": [
{
"@type": "Question",
"name": "What is Towardsdatascience?",
"acceptedAnswer": {
"@type": "Answer",
"text": "Add your answer here — describe what Towardsdatascience does in 1-2 sentences."
}
},
{
"@type": "Question",
"name": "How does Towardsdatascience work?",
"acceptedAnswer": {
"@type": "Answer",
"text": "Explain the key features and how users interact with Towardsdatascience."
}
}
]
}
</script>
Projected Impact
ROI EST.If you apply the patches above, here's the estimated improvement for towardsdatascience.com:
*Estimates based on SEODiff's scoring model. Actual results depend on implementation quality.
📋 Data Export
Download scores and metadata for audits, client reports, or CI/CD pipelines. Exports contain computed metrics only (no copyrighted content).
All data is generated automatically and updated with each crawl. JSON exports contain scores and metadata only (no copyrighted content).
Is this your company?
Monitor your AI visibility score weekly and get alerted when changes happen.
Start Free →