The Global AI Blocklist Index

Which websites are blocking AI crawlers? Updated daily.

1173281
Domains Indexed
9.2%
Block GPTBot
8.6%
Block ClaudeBot
7.7%
Block CCBot
8.4%
Block Google-Extended

🏆 Most-Blocked Sites

All SaaS News E-commerce Finance
Bot filter: All Blocks GPTBot Blocks ClaudeBot Blocks Any Blocks All
#DomainGPTBotClaudeBotCCBotGoogle-ExtTechScoreLast Crawled
1 mail.ru ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
2 facebook.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 17, 2026
3 instagram.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
4 gstatic.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
5 twitter.com ❌ ❌ ❌ ❌ Express 15 Mar 16, 2026
6 linkedin.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
7 fbcdn.net ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 17, 2026
8 netflix.com ❌ ❌ ❌ ❌ Next.js 15 Mar 26, 2026
9 x.com ❌ ❌ ❌ ❌ Express 15 Mar 19, 2026
10 office365.com ❌ ❌ ❌ ❌ Adobe Experience Manager 15 Mar 19, 2026
11 baidu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 19, 2026
12 chatgpt.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 21, 2026
13 reddit.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 26, 2026
14 flickr.com ❌ ❌ ❌ ❌ Webflow 15 Mar 20, 2026
15 myfritz.net ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
16 forbes.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 20, 2026
17 t.co ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
18 meraki.com ❌ ❌ ❌ ❌ WordPress 15 Mar 18, 2026
19 linktr.ee ❌ ❌ ❌ ❌ WordPress 15 Mar 18, 2026
20 weibo.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
21 naver.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
22 vk.ru ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
23 netflix.net ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
24 trustpilot.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
25 quora.com ❌ ❌ ❌ ❌ Custom / Proprietary 4 Mar 18, 2026
26 imgsmail.ru ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
27 sohu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
28 vkontakte.ru ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
29 quantserve.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
30 hihonorcloud.com ❌ ❌ ❌ ❌ Vue.js 15 Mar 18, 2026
31 fb.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
32 creativecdn.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
33 xiaohongshu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
34 adform.net ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
35 threads.com ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026
36 news.com.au ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
37 mailchi.mp ❌ ❌ ❌ ❌ Adobe Experience Manager 15 Mar 20, 2026
38 btloader.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 20, 2026
39 coupang.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 20, 2026
40 daum.net ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
41 namu.wiki ❌ ❌ ❌ ❌ Custom / Proprietary 4 Mar 21, 2026
42 fmkorea.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
43 yzwtz.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
44 exhentai.org ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
45 ak2yy.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
46 pla3.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
47 gfpxw.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
48 3ckz.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
49 zonatmo.com ❌ ❌ ❌ ❌ Custom / Proprietary 4 Mar 17, 2026
50 bpexch.net ❌ ❌ ❌ ❌ Cloudflare Pages 15 Mar 21, 2026
51 exclusive-spin.com ❌ ❌ ❌ ❌ Cloudflare Pages 5 Mar 21, 2026
52 aka.ms ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
53 mega.nz ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
54 adrta.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
55 secureserver.net ❌ ❌ ❌ ❌ Express 4 Mar 17, 2026
56 armgs.team ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
57 threads.net ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026
58 clevertap-prod.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
59 weibo.cn ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
60 avito.st ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
61 thesun.co.uk ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
62 variety.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 21, 2026
63 qcloud.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
64 lok-lok.cc ❌ ❌ ❌ ❌ Custom / Proprietary 14 Mar 17, 2026
65 outbidplacardshowman.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
66 xhur.life ❌ ❌ ❌ ❌ Custom / Proprietary 14 Mar 17, 2026
67 ad.gt ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 17, 2026
68 lnkd.in ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 23, 2026
69 kakao.com ❌ ❌ ❌ ❌ Nuxt.js 15 Mar 19, 2026
70 xhcopy.life ❌ ❌ ❌ ❌ Custom / Proprietary 14 Mar 21, 2026
71 openssl.org ❌ ❌ ❌ ❌ Hugo 15 Mar 17, 2026
72 sogou.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 19, 2026
73 smi2.ru ❌ ❌ ❌ ❌ Next.js 15 Mar 20, 2026
74 adsco.re ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
75 sap.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 21, 2026
76 rollingstone.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 17, 2026
77 redditmedia.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 21, 2026
78 ad-score.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
79 hollywoodreporter.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 21, 2026
80 permutive.app ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 19, 2026
81 rutarget.ru ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
82 entrust.net ❌ ❌ ❌ ❌ Cloudflare Pages 5 Mar 18, 2026
83 huntress.io ❌ ❌ ❌ ❌ Ruby on Rails 15 Mar 17, 2026
84 distmed.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
85 nextdoor.com ❌ ❌ ❌ ❌ WordPress 10 Mar 18, 2026
86 urldefense.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
87 thetimes.co.uk ❌ ❌ ❌ ❌ Gatsby 15 Mar 21, 2026
88 cuny.edu ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
89 yandexadexchange.net ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 21, 2026
90 jwpltx.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
91 macomnet.ru ❌ ❌ ❌ ❌ Webflow 15 Mar 17, 2026
92 kahoot.it ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
93 fortinet.com ❌ ❌ ❌ ❌ Adobe Experience Manager 15 Mar 15, 2026
94 system-monitor.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
95 hellotalk8.com ❌ ❌ ❌ ❌ WordPress 15 Mar 20, 2026
96 thetimes.com ❌ ❌ ❌ ❌ Gatsby 15 Mar 21, 2026
97 acint.net ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 17, 2026
98 paypal.me ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 18, 2026
99 billboard.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 17, 2026
100 rs6.net ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026

Want the full dataset?

Download the complete CSV with all indexed domains. Free for all users.

Sign Up Free →