The Global AI Blocklist Index

Which websites are blocking AI crawlers? Updated daily.

1173281
Domains Indexed
9.2%
Block GPTBot
8.6%
Block ClaudeBot
7.7%
Block CCBot
8.4%
Block Google-Extended

🏆 Most-Blocked Sites

All SaaS News E-commerce Finance
Bot filter: All Blocks GPTBot Blocks ClaudeBot Blocks Any Blocks All
#DomainGPTBotClaudeBotCCBotGoogle-ExtTechScoreLast Crawled
1 mail.ru ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
2 facebook.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 17, 2026
3 instagram.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
4 gstatic.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
5 twitter.com ❌ ❌ ❌ ❌ Express 15 Mar 16, 2026
6 linkedin.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
7 fbcdn.net ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 17, 2026
8 amazon.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
9 netflix.com ❌ ❌ ❌ ❌ Next.js 15 Mar 26, 2026
10 whatsapp.net ❌ ❌ ✅ ❌ Express 15 Mar 21, 2026
11 pinterest.com ❌ ❌ ❌ ❌ Express 10 Mar 17, 2026
12 whatsapp.com ❌ ❌ ✅ ❌ Express 15 Mar 20, 2026
13 x.com ❌ ❌ ❌ ❌ Express 15 Mar 19, 2026
14 vimeo.com ❌ ❌ ✅ ❌ Next.js 15 Mar 18, 2026
15 office365.com ❌ ❌ ❌ ❌ Adobe Experience Manager 15 Mar 19, 2026
16 baidu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 19, 2026
17 chatgpt.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 21, 2026
18 reddit.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 26, 2026
19 snapchat.com ❌ ❌ ❌ ❌ Next.js 10 Mar 17, 2026
20 tumblr.com ✅ ❌ ❌ ❌ WordPress 61 Mar 21, 2026
21 nytimes.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
22 flickr.com ❌ ❌ ❌ ❌ Webflow 15 Mar 20, 2026
23 soundcloud.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
24 myfritz.net ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
25 forbes.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 20, 2026
26 t.co ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
27 bbc.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
28 bbc.co.uk ❌ ❌ ❌ ❌ Gatsby 15 Mar 21, 2026
29 weather.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
30 canva.com ✅ ❌ ✅ ✅ Custom / Proprietary 19 Mar 24, 2026
31 meraki.com ❌ ❌ ❌ ❌ WordPress 15 Mar 18, 2026
32 linktr.ee ❌ ❌ ❌ ❌ WordPress 15 Mar 18, 2026
33 ea.com ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026
34 bilibili.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
35 amazon.co.uk ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
36 weibo.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
37 washingtonpost.com ✅ ❌ ❌ ✅ Custom / Proprietary 3 Mar 27, 2026
38 naver.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
39 wsj.com ✅ ❌ ❌ ❌ Custom / Proprietary 8 Mar 18, 2026
40 cookielaw.org ❌ ❌ ❌ ❌ Adobe Experience Manager 15 Mar 21, 2026
41 vk.ru ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
42 bloomberg.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 20, 2026
43 telegraph.co.uk ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
44 businessinsider.com ✅ ❌ ❌ ✅ Cloudflare Pages 60 Mar 20, 2026
45 netflix.net ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
46 unsplash.com ✅ ❌ ✅ ✅ Custom / Proprietary 16 Mar 20, 2026
47 trustpilot.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
48 amazon.de ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 19, 2026
49 aol.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
50 statista.com ✅ ❌ ✅ ✅ Custom / Proprietary 70 Mar 18, 2026
51 quora.com ❌ ❌ ❌ ❌ Custom / Proprietary 4 Mar 18, 2026
52 cnbc.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 16, 2026
53 imgsmail.ru ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
54 t-online.de ❌ ❌ ✅ ✅ Next.js 15 Mar 21, 2026
55 slideshare.net ✅ ❌ ❌ ✅ Next.js 62 Mar 18, 2026
56 amazon.co.jp ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
57 sohu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
58 ft.com ✅ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
59 uol.com.br ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
60 usatoday.com ❌ ❌ ❌ ❌ Next.js 10 Mar 18, 2026
61 sharethrough.com ❌ ❌ ❌ ✅ Cloudflare Pages 15 Mar 18, 2026
62 nintendo.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
63 force.com ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
64 amazon.fr ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
65 ted.com ❌ ❌ ❌ ✅ Next.js 15 Mar 20, 2026
66 amazon.ca ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
67 vkontakte.ru ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
68 pinimg.com ❌ ❌ ❌ ❌ Express 10 Mar 18, 2026
69 techcrunch.com ❌ ❌ ❌ ❌ WordPress 15 Mar 13, 2026
70 quantserve.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
71 spiegel.de ❌ ❌ ❌ ✅ Express 15 Mar 21, 2026
72 hihonorcloud.com ❌ ❌ ❌ ❌ Vue.js 15 Mar 18, 2026
73 lemonde.fr ✅ ❌ ❌ ❌ Express 49 Mar 20, 2026
74 fb.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
75 apnews.com ❌ ❌ ❌ ✅ Cloudflare Pages 15 Mar 20, 2026
76 nbcnews.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
77 amazon.in ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
78 creativecdn.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
79 xiaohongshu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
80 amazon.es ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
81 adform.net ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
82 amazon.it ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
83 people.com ✅ ❌ ❌ ❌ Express 8 Mar 18, 2026
84 theverge.com ✅ ❌ ❌ ❌ Custom / Proprietary 13 Mar 19, 2026
85 latimes.com ❌ ❌ ✅ ✅ Custom / Proprietary 15 Mar 21, 2026
86 investopedia.com ✅ ❌ ❌ ❌ Express 8 Mar 21, 2026
87 threads.com ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026
88 academia.edu ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
89 news.com.au ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
90 webmd.com ❌ ❌ ❌ ✅ Vue.js 15 Mar 20, 2026
91 bild.de ✅ ❌ ❌ ❌ Express 49 Mar 21, 2026
92 healthline.com ❌ ❌ ❌ ✅ Next.js 15 Mar 15, 2026
93 salesforceliveagent.com ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
94 ebay.co.uk ✅ ❌ ❌ ✅ Custom / Proprietary 10 Mar 16, 2026
95 skroutz.gr ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
96 mailchi.mp ❌ ❌ ❌ ❌ Adobe Experience Manager 15 Mar 20, 2026
97 amazon.com.br ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026
98 theatlantic.com ✅ ❌ ❌ ❌ Next.js 62 Mar 21, 2026
99 btloader.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 20, 2026
100 coupang.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 20, 2026

Want the full dataset?

Download the complete CSV with all indexed domains. Free for all users.

Sign Up Free →