The Global AI Blocklist Index

Which websites are blocking AI crawlers? Updated daily.

1173281
Domains Indexed
9.2%
Block GPTBot
8.6%
Block ClaudeBot
7.7%
Block CCBot
8.4%
Block Google-Extended

🏆 Most-Blocked Sites

All SaaS News E-commerce Finance
Bot filter: All Blocks GPTBot Blocks ClaudeBot Blocks Any Blocks All
#DomainGPTBotClaudeBotCCBotGoogle-ExtTechScoreLast Crawled
1 mail.ru ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
2 facebook.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 17, 2026
3 instagram.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
4 gstatic.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
5 twitter.com ❌ ❌ ❌ ❌ Express 15 Mar 16, 2026
6 linkedin.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
7 fbcdn.net ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 17, 2026
8 amazon.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
9 netflix.com ❌ ❌ ❌ ❌ Next.js 15 Mar 26, 2026
10 whatsapp.net ❌ ❌ ✅ ❌ Express 15 Mar 21, 2026
11 pinterest.com ❌ ❌ ❌ ❌ Express 10 Mar 17, 2026
12 whatsapp.com ❌ ❌ ✅ ❌ Express 15 Mar 20, 2026
13 x.com ❌ ❌ ❌ ❌ Express 15 Mar 19, 2026
14 vimeo.com ❌ ❌ ✅ ❌ Next.js 15 Mar 18, 2026
15 office365.com ❌ ❌ ❌ ❌ Adobe Experience Manager 15 Mar 19, 2026
16 baidu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 19, 2026
17 chatgpt.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 21, 2026
18 reddit.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 26, 2026
19 snapchat.com ❌ ❌ ❌ ❌ Next.js 10 Mar 17, 2026
20 gravatar.com ❌ ✅ ❌ ❌ WordPress 53 Mar 20, 2026
21 nytimes.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
22 flickr.com ❌ ❌ ❌ ❌ Webflow 15 Mar 20, 2026
23 soundcloud.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
24 myfritz.net ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
25 forbes.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 20, 2026
26 t.co ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
27 bbc.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
28 bbc.co.uk ❌ ❌ ❌ ❌ Gatsby 15 Mar 21, 2026
29 weather.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
30 meraki.com ❌ ❌ ❌ ❌ WordPress 15 Mar 18, 2026
31 linktr.ee ❌ ❌ ❌ ❌ WordPress 15 Mar 18, 2026
32 ea.com ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026
33 alibaba.com ❌ ✅ ✅ ❌ Custom / Proprietary 44 Mar 21, 2026
34 bilibili.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
35 amazon.co.uk ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
36 weibo.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
37 naver.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
38 cookielaw.org ❌ ❌ ❌ ❌ Adobe Experience Manager 15 Mar 21, 2026
39 vk.ru ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
40 bloomberg.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 20, 2026
41 telegraph.co.uk ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
42 go.com ❌ ✅ ✅ ❌ Express 50 Mar 18, 2026
43 netflix.net ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
44 globo.com ❌ ✅ ❌ ❌ Svelte/SvelteKit 62 Mar 21, 2026
45 trustpilot.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
46 amazon.de ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 19, 2026
47 aol.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
48 quora.com ❌ ❌ ❌ ❌ Custom / Proprietary 4 Mar 18, 2026
49 cnbc.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 16, 2026
50 goodreads.com ❌ ✅ ❌ ✅ Custom / Proprietary 55 Mar 21, 2026
51 imgsmail.ru ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
52 yahoo.co.jp ❌ ✅ ✅ ❌ Custom / Proprietary 67 Mar 21, 2026
53 t-online.de ❌ ❌ ✅ ✅ Next.js 15 Mar 21, 2026
54 amazon.co.jp ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
55 sohu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
56 uol.com.br ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
57 usatoday.com ❌ ❌ ❌ ❌ Next.js 10 Mar 18, 2026
58 sharethrough.com ❌ ❌ ❌ ✅ Cloudflare Pages 15 Mar 18, 2026
59 tandfonline.com ❌ ✅ ✅ ✅ Custom / Proprietary 11 Mar 21, 2026
60 nintendo.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
61 force.com ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
62 shutterstock.com ❌ ✅ ❌ ✅ Custom / Proprietary 10 Mar 18, 2026
63 amazon.fr ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
64 cbsnews.com ❌ ✅ ✅ ✅ Custom / Proprietary 63 Mar 21, 2026
65 ted.com ❌ ❌ ❌ ✅ Next.js 15 Mar 20, 2026
66 wattpad.com ❌ ✅ ✅ ✅ Custom / Proprietary 71 Mar 18, 2026
67 amazon.ca ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
68 vkontakte.ru ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
69 pinimg.com ❌ ❌ ❌ ❌ Express 10 Mar 18, 2026
70 techcrunch.com ❌ ❌ ❌ ❌ WordPress 15 Mar 13, 2026
71 wp.pl ❌ ✅ ❌ ✅ Custom / Proprietary 59 Mar 21, 2026
72 quantserve.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
73 spiegel.de ❌ ❌ ❌ ✅ Express 15 Mar 21, 2026
74 hihonorcloud.com ❌ ❌ ❌ ❌ Vue.js 15 Mar 18, 2026
75 fb.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
76 apnews.com ❌ ❌ ❌ ✅ Cloudflare Pages 15 Mar 20, 2026
77 nbcnews.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
78 amazon.in ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
79 creativecdn.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
80 xiaohongshu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
81 amazon.es ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
82 adform.net ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
83 amazon.it ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
84 latimes.com ❌ ❌ ✅ ✅ Custom / Proprietary 15 Mar 21, 2026
85 hbr.org ❌ ✅ ❌ ❌ Next.js 58 Mar 21, 2026
86 threads.com ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026
87 disneyplus.com ❌ ✅ ✅ ❌ Next.js 58 Mar 21, 2026
88 academia.edu ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
89 figma.com ❌ ✅ ❌ ❌ Next.js 68 Mar 24, 2026
90 news.com.au ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
91 webmd.com ❌ ❌ ❌ ✅ Vue.js 15 Mar 20, 2026
92 healthline.com ❌ ❌ ❌ ✅ Next.js 15 Mar 15, 2026
93 salesforceliveagent.com ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
94 megafon.ru ❌ ✅ ✅ ✅ Next.js 68 Mar 15, 2026
95 skroutz.gr ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
96 mailchi.mp ❌ ❌ ❌ ❌ Adobe Experience Manager 15 Mar 20, 2026
97 amazon.com.br ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026
98 btloader.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 20, 2026
99 coupang.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 20, 2026
100 huffpost.com ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026

Want the full dataset?

Download the complete CSV with all indexed domains. Free for all users.

Sign Up Free →