The Global AI Blocklist Index

Which websites are blocking AI crawlers? Updated daily.

1173281
Domains Indexed
9.2%
Block GPTBot
8.6%
Block ClaudeBot
7.7%
Block CCBot
8.4%
Block Google-Extended

🏆 Most-Blocked Sites

All SaaS News E-commerce Finance
Bot filter: All Blocks GPTBot Blocks ClaudeBot Blocks Any Blocks All
#DomainGPTBotClaudeBotCCBotGoogle-ExtTechScoreLast Crawled
1 google.com ✅ ✅ ✅ ✅ Custom / Proprietary 51 Apr 3, 2026
2 microsoft.com ✅ ✅ ✅ ✅ Adobe Experience Manager 75 Mar 20, 2026
3 mail.ru ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
4 gtld-servers.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
5 facebook.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 17, 2026
6 googleapis.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 18, 2026
7 cloudflare.com ✅ ✅ ✅ ✅ Astro 73 Apr 3, 2026
8 apple.com ✅ ✅ ✅ ✅ Custom / Proprietary 76 Mar 21, 2026
9 youtube.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Mar 17, 2026
10 amazonaws.com ✅ ✅ ✅ ✅ Custom / Proprietary 70 Mar 19, 2026
11 dzen.ru ✅ ✅ ✅ ✅ Custom / Proprietary 44 Mar 18, 2026
12 instagram.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
13 gstatic.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
14 akamai.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
15 office.com ✅ ✅ ✅ ✅ Custom / Proprietary 75 Mar 21, 2026
16 twitter.com ❌ ❌ ❌ ❌ Express 15 Mar 16, 2026
17 googlevideo.com ✅ ✅ ✅ ✅ Custom / Proprietary 53 Mar 19, 2026
18 live.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Mar 18, 2026
19 linkedin.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
20 fbcdn.net ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 17, 2026
21 googletagmanager.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 18, 2026
22 akadns.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
23 akamaiedge.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
24 amazon.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
25 microsoftonline.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
26 workers.dev ✅ ✅ ✅ ✅ Astro 63 Mar 20, 2026
27 azure.com ✅ ✅ ✅ ✅ Express 71 Mar 21, 2026
28 googleusercontent.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 18, 2026
29 wikipedia.org ✅ ✅ ✅ ✅ MediaWiki 85 Mar 18, 2026
30 windowsupdate.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 4, 2026
31 doubleclick.net ✅ ✅ ✅ ✅ Custom / Proprietary 71 Mar 18, 2026
32 digicert.com ✅ ✅ ✅ ✅ Custom / Proprietary 59 Mar 21, 2026
33 bing.com ✅ ✅ ✅ ✅ Express 10 Mar 18, 2026
34 netflix.com ❌ ❌ ❌ ❌ Next.js 15 Mar 26, 2026
35 whatsapp.net ❌ ❌ ✅ ❌ Express 15 Mar 21, 2026
36 fastly.net ✅ ✅ ✅ ✅ Gatsby 72 Mar 18, 2026
37 domaincontrol.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
38 apple-dns.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
39 office.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 4, 2026
40 wordpress.org ✅ ✅ ✅ ✅ WordPress 82 Mar 14, 2026
41 e2ro.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
42 aaplimg.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
43 appsflyersdk.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 18, 2026
44 youtu.be ✅ ✅ ✅ ✅ Custom / Proprietary 10 Mar 18, 2026
45 icloud.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Mar 18, 2026
46 pinterest.com ❌ ❌ ❌ ❌ Express 10 Mar 17, 2026
47 sharepoint.com ✅ ✅ ✅ ✅ Custom / Proprietary 60 Mar 21, 2026
48 yahoo.com ✅ ✅ ✅ ✅ Custom / Proprietary 62 Mar 18, 2026
49 trafficmanager.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
50 ripn.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
51 whatsapp.com ❌ ❌ ✅ ❌ Express 15 Mar 20, 2026
52 googlesyndication.com ✅ ✅ ✅ ✅ Custom / Proprietary 51 Mar 18, 2026
53 goo.gl ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 21, 2026
54 windows.net ✅ ✅ ✅ ✅ Express 72 Mar 21, 2026
55 skype.com ✅ ✅ ✅ ✅ Custom / Proprietary 59 Mar 21, 2026
56 akam.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
57 x.com ❌ ❌ ❌ ❌ Express 15 Mar 19, 2026
58 msn.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Mar 18, 2026
59 cloudfront.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
60 gandi.net ✅ ✅ ✅ ✅ PrestaShop 74 Mar 21, 2026
61 spotify.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Mar 17, 2026
62 pv-cdn.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
63 ntp.org ✅ ✅ ✅ ✅ Hugo 69 Mar 18, 2026
64 tiktok.com ✅ ✅ ✅ ✅ Custom / Proprietary 59 Mar 21, 2026
65 vimeo.com ❌ ❌ ✅ ❌ Next.js 15 Mar 18, 2026
66 tiktokcdn.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
67 adobe.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
68 venmo.com ✅ ✅ ✅ ✅ Custom / Proprietary 70 Mar 21, 2026
69 gvt1.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
70 cloudflare.net ✅ ✅ ✅ ✅ Custom / Proprietary 13 Mar 18, 2026
71 roblox.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Mar 18, 2026
72 gvt2.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
73 ytimg.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
74 tiktokv.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 18, 2026
75 yandex.net ✅ ✅ ✅ ✅ Custom / Proprietary 10 Mar 17, 2026
76 googledomains.com ✅ ✅ ✅ ✅ Squarespace 69 Mar 18, 2026
77 zoom.us ✅ ✅ ✅ ✅ Custom / Proprietary 78 Mar 21, 2026
78 nic.ru ✅ ✅ ✅ ✅ Custom / Proprietary 10 Mar 18, 2026
79 wa.me ✅ ✅ ✅ ✅ Custom / Proprietary 64 Mar 15, 2026
80 qq.com ✅ ✅ ✅ ✅ Custom / Proprietary 69 Mar 21, 2026
81 yandex.ru ✅ ✅ ✅ ✅ Custom / Proprietary 44 Mar 18, 2026
82 edgekey.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
83 nginx.org ✅ ✅ ✅ ✅ Custom / Proprietary 72 Mar 18, 2026
84 google-analytics.com ✅ ✅ ✅ ✅ Custom / Proprietary 71 Mar 18, 2026
85 office365.com ❌ ❌ ❌ ❌ Adobe Experience Manager 15 Mar 19, 2026
86 opera.com ✅ ✅ ✅ ✅ Custom / Proprietary 76 Mar 18, 2026
87 cloudflare-dns.com ✅ ✅ ✅ ✅ Custom / Proprietary 67 Mar 20, 2026
88 baidu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 19, 2026
89 root-servers.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
90 samsung.com ✅ ✅ ✅ ✅ Adobe Experience Manager 77 Mar 21, 2026
91 chatgpt.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 21, 2026
92 bit.ly ✅ ✅ ✅ ✅ Gatsby 78 Mar 17, 2026
93 nginx.com ✅ ✅ ✅ ✅ Custom / Proprietary 60 Mar 18, 2026
94 vedcdnlb.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 3, 2026
95 edgesuite.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 4, 2026
96 wordpress.com ✅ ✅ ✅ ✅ WordPress 83 Mar 18, 2026
97 okcdn.ru ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 16, 2026
98 intuit.com ✅ ✅ ✅ ✅ Next.js 81 Mar 18, 2026
99 ui.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Mar 21, 2026
100 windows.com ✅ ✅ ✅ ✅ Custom / Proprietary 74 Mar 20, 2026

Want the full dataset?

Download the complete CSV with all indexed domains. Free for all users.

Sign Up Free →