The Global AI Blocklist Index

Which websites are blocking AI crawlers? Updated daily.

1173281
Domains Indexed
9.2%
Block GPTBot
8.6%
Block ClaudeBot
7.7%
Block CCBot
8.4%
Block Google-Extended

🏆 Most-Blocked Sites

All SaaS News E-commerce Finance
Bot filter: All Blocks GPTBot Blocks ClaudeBot Blocks Any Blocks All
#DomainGPTBotClaudeBotCCBotGoogle-ExtTechScoreLast Crawled
1 mail.ru ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
2 facebook.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 17, 2026
3 instagram.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
4 gstatic.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
5 twitter.com ❌ ❌ ❌ ❌ Express 15 Mar 16, 2026
6 linkedin.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
7 fbcdn.net ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 17, 2026
8 amazon.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
9 netflix.com ❌ ❌ ❌ ❌ Next.js 15 Mar 26, 2026
10 whatsapp.net ❌ ❌ ✅ ❌ Express 15 Mar 21, 2026
11 pinterest.com ❌ ❌ ❌ ❌ Express 10 Mar 17, 2026
12 whatsapp.com ❌ ❌ ✅ ❌ Express 15 Mar 20, 2026
13 x.com ❌ ❌ ❌ ❌ Express 15 Mar 19, 2026
14 vimeo.com ❌ ❌ ✅ ❌ Next.js 15 Mar 18, 2026
15 office365.com ❌ ❌ ❌ ❌ Adobe Experience Manager 15 Mar 19, 2026
16 baidu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 19, 2026
17 chatgpt.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 21, 2026
18 reddit.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 26, 2026
19 snapchat.com ❌ ❌ ❌ ❌ Next.js 10 Mar 17, 2026
20 gravatar.com ❌ ✅ ❌ ❌ WordPress 53 Mar 20, 2026
21 amazonvideo.com ✅ ✅ ❌ ✅ Custom / Proprietary 68 Mar 19, 2026
22 tumblr.com ✅ ❌ ❌ ❌ WordPress 61 Mar 21, 2026
23 nytimes.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
24 flickr.com ❌ ❌ ❌ ❌ Webflow 15 Mar 20, 2026
25 soundcloud.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
26 myfritz.net ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
27 forbes.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 20, 2026
28 t.co ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
29 bbc.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
30 bbc.co.uk ❌ ❌ ❌ ❌ Gatsby 15 Mar 21, 2026
31 weather.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
32 canva.com ✅ ❌ ✅ ✅ Custom / Proprietary 19 Mar 24, 2026
33 meraki.com ❌ ❌ ❌ ❌ WordPress 15 Mar 18, 2026
34 linktr.ee ❌ ❌ ❌ ❌ WordPress 15 Mar 18, 2026
35 who.int ✅ ✅ ❌ ✅ Cloudflare Pages 83 Mar 21, 2026
36 ea.com ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026
37 alibaba.com ❌ ✅ ✅ ❌ Custom / Proprietary 44 Mar 21, 2026
38 bilibili.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
39 amazon.co.uk ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
40 weibo.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
41 washingtonpost.com ✅ ❌ ❌ ✅ Custom / Proprietary 3 Mar 27, 2026
42 naver.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
43 wsj.com ✅ ❌ ❌ ❌ Custom / Proprietary 8 Mar 18, 2026
44 cookielaw.org ❌ ❌ ❌ ❌ Adobe Experience Manager 15 Mar 21, 2026
45 vk.ru ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
46 bloomberg.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 20, 2026
47 telegraph.co.uk ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
48 go.com ❌ ✅ ✅ ❌ Express 50 Mar 18, 2026
49 businessinsider.com ✅ ❌ ❌ ✅ Cloudflare Pages 60 Mar 20, 2026
50 netflix.net ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
51 globo.com ❌ ✅ ❌ ❌ Svelte/SvelteKit 62 Mar 21, 2026
52 unsplash.com ✅ ❌ ✅ ✅ Custom / Proprietary 16 Mar 20, 2026
53 trustpilot.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
54 amazon.de ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 19, 2026
55 aol.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
56 calendly.com ✅ ✅ ❌ ✅ Next.js 73 Mar 16, 2026
57 statista.com ✅ ❌ ✅ ✅ Custom / Proprietary 70 Mar 18, 2026
58 quora.com ❌ ❌ ❌ ❌ Custom / Proprietary 4 Mar 18, 2026
59 cnbc.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 16, 2026
60 goodreads.com ❌ ✅ ❌ ✅ Custom / Proprietary 55 Mar 21, 2026
61 imgsmail.ru ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
62 yahoo.co.jp ❌ ✅ ✅ ❌ Custom / Proprietary 67 Mar 21, 2026
63 t-online.de ❌ ❌ ✅ ✅ Next.js 15 Mar 21, 2026
64 slideshare.net ✅ ❌ ❌ ✅ Next.js 62 Mar 18, 2026
65 amazon.co.jp ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
66 sohu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
67 ft.com ✅ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
68 uol.com.br ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
69 usatoday.com ❌ ❌ ❌ ❌ Next.js 10 Mar 18, 2026
70 tripadvisor.com ✅ ✅ ✅ ❌ Custom / Proprietary 11 Mar 18, 2026
71 sharethrough.com ❌ ❌ ❌ ✅ Cloudflare Pages 15 Mar 18, 2026
72 tandfonline.com ❌ ✅ ✅ ✅ Custom / Proprietary 11 Mar 21, 2026
73 nintendo.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
74 force.com ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
75 shutterstock.com ❌ ✅ ❌ ✅ Custom / Proprietary 10 Mar 18, 2026
76 amazon.fr ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
77 cbsnews.com ❌ ✅ ✅ ✅ Custom / Proprietary 63 Mar 21, 2026
78 ted.com ❌ ❌ ❌ ✅ Next.js 15 Mar 20, 2026
79 wattpad.com ❌ ✅ ✅ ✅ Custom / Proprietary 71 Mar 18, 2026
80 amazon.ca ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
81 vkontakte.ru ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
82 pinimg.com ❌ ❌ ❌ ❌ Express 10 Mar 18, 2026
83 techcrunch.com ❌ ❌ ❌ ❌ WordPress 15 Mar 13, 2026
84 wp.pl ❌ ✅ ❌ ✅ Custom / Proprietary 59 Mar 21, 2026
85 quantserve.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
86 spiegel.de ❌ ❌ ❌ ✅ Express 15 Mar 21, 2026
87 hihonorcloud.com ❌ ❌ ❌ ❌ Vue.js 15 Mar 18, 2026
88 lemonde.fr ✅ ❌ ❌ ❌ Express 49 Mar 20, 2026
89 fb.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
90 apnews.com ❌ ❌ ❌ ✅ Cloudflare Pages 15 Mar 20, 2026
91 nbcnews.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
92 amazon.in ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
93 creativecdn.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
94 xiaohongshu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
95 amazon.es ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
96 adform.net ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
97 amazon.it ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
98 people.com ✅ ❌ ❌ ❌ Express 8 Mar 18, 2026
99 theverge.com ✅ ❌ ❌ ❌ Custom / Proprietary 13 Mar 19, 2026
100 latimes.com ❌ ❌ ✅ ✅ Custom / Proprietary 15 Mar 21, 2026

Want the full dataset?

Download the complete CSV with all indexed domains. Free for all users.

Sign Up Free →