The Global AI Blocklist Index

Which websites are blocking AI crawlers? Updated daily.

1173385
Domains Indexed
9.2%
Block GPTBot
8.6%
Block ClaudeBot
7.7%
Block CCBot
8.4%
Block Google-Extended

🏆 Most-Blocked Sites

All SaaS News E-commerce Finance
Bot filter: All Blocks GPTBot Blocks ClaudeBot Blocks Any Blocks All
#DomainGPTBotClaudeBotCCBotGoogle-ExtTechScoreLast Crawled
1 apple.com ✅ ✅ ✅ ✅ Custom / Proprietary 76 Mar 21, 2026
2 macromedia.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 16, 2026
3 taboola.com ✅ ✅ ✅ ✅ WordPress 84 Mar 18, 2026
4 roku.com ✅ ✅ ✅ ✅ Cloudflare Pages 74 Mar 21, 2026
5 wikimedia.org ✅ ✅ ✅ ✅ MediaWiki 65 Mar 18, 2026
6 media-amazon.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 8, 2026
7 mzstatic.com ✅ ✅ ✅ ✅ Custom / Proprietary 76 Mar 21, 2026
8 washingtonpost.com ✅ ❌ ❌ ✅ Custom / Proprietary 3 Apr 7, 2026
9 branch.io ✅ ✅ ✅ ✅ WordPress 86 Mar 19, 2026
10 paloaltonetworks.com ✅ ✅ ✅ ✅ Express 67 Mar 18, 2026
11 onetrust.com ✅ ✅ ✅ ✅ Adobe Experience Manager 82 Mar 21, 2026
12 rakuten.com ✅ ✅ ✅ ✅ Next.js 72 Mar 17, 2026
13 russianpost.ru ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 21, 2026
14 news.com.au ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 18, 2026
15 pbs.org ❌ ✅ ❌ ✅ Next.js 73 Mar 20, 2026
16 immedia-semi.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 6, 2026
17 meethue.com ✅ ✅ ✅ ✅ Magento 73 Mar 15, 2026
18 unrulymedia.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Mar 18, 2026
19 usnews.com ❌ ❌ ❌ ❌ Custom / Proprietary 3 Mar 21, 2026
20 jagran.com ✅ ✅ ✅ ✅ Next.js 82 Mar 13, 2026
21 apple.news ✅ ✅ ✅ ✅ Custom / Proprietary 68 Mar 21, 2026
22 postgresql.org ✅ ✅ ✅ ✅ Custom / Proprietary 70 Mar 21, 2026
23 eenadu.net ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 16, 2026
24 spaggiari.eu ✅ ✅ ✅ ✅ WordPress 80 Mar 15, 2026
25 staseraintv.com ✅ ✅ ✅ ✅ Custom / Proprietary 72 Mar 18, 2026
26 cmediahub.ru ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 16, 2026
27 postrelease.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 17, 2026
28 restream-media.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 15, 2026
29 people.com.cn ✅ ✅ ✅ ✅ Custom / Proprietary 80 Mar 21, 2026
30 nextmillmedia.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 21, 2026
31 ccc.de ✅ ✅ ✅ ✅ Custom / Proprietary 65 Mar 21, 2026
32 newscientist.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 18, 2026
33 aliexpress-media.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 16, 2026
34 minutemedia-prebid.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 21, 2026
35 blismedia.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 17, 2026
36 mcdonalds.com ✅ ✅ ✅ ✅ Express 72 Mar 21, 2026
37 voanews.com ✅ ✅ ✅ ✅ Custom / Proprietary 70 Mar 20, 2026
38 zdf.de ✅ ✅ ✅ ✅ Next.js 67 Mar 21, 2026
39 xlgmedia.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Mar 18, 2026
40 ardmediathek.de ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
41 technoratimedia.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 4, 2026
42 news18.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 21, 2026
43 qqqmedia.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 15, 2026
44 fraunhofer.de ✅ ✅ ✅ ✅ Adobe Experience Manager 74 Mar 19, 2026
45 japanpost.jp ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 16, 2026
46 wondershare.com ✅ ✅ ✅ ✅ Custom / Proprietary 70 Mar 21, 2026
47 apple.com.cn ✅ ✅ ✅ ✅ Custom / Proprietary 85 Mar 21, 2026
48 derstandard.at ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
49 depositphotos.com ✅ ✅ ✅ ✅ Custom / Proprietary 83 Mar 21, 2026
50 cgtn.com ✅ ✅ ✅ ✅ Custom / Proprietary 61 Mar 20, 2026
51 oxfordjournals.org ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 17, 2026
52 mac.com ✅ ✅ ✅ ✅ Next.js 78 Mar 17, 2026
53 blender.org ✅ ✅ ✅ ✅ WordPress 76 Mar 13, 2026
54 people.cn ✅ ✅ ✅ ✅ Custom / Proprietary 80 Mar 21, 2026
55 yango.com ✅ ✅ ✅ ✅ Next.js 70 Mar 21, 2026
56 china.com.cn ✅ ✅ ✅ ✅ Custom / Proprietary 79 Mar 21, 2026
57 laposte.fr ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 18, 2026
58 apple.co ✅ ✅ ✅ ✅ Custom / Proprietary 71 Mar 15, 2026
59 smartnews.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 16, 2026
60 donga.com ✅ ✅ ✅ ✅ Custom / Proprietary 75 Mar 15, 2026
61 mensjournal.com ✅ ✅ ✅ ✅ Custom / Proprietary 13 Mar 21, 2026
62 morgenpost.de ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 21, 2026
63 rainews.it ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 16, 2026
64 tritondigital.com ✅ ✅ ✅ ✅ Gatsby 62 Mar 21, 2026
65 kurier.at ✅ ✅ ✅ ✅ Cloudflare Pages 65 Mar 21, 2026
66 yna.co.kr ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 15, 2026
67 chinatimes.com ✅ ✅ ✅ ✅ Cloudflare Pages 89 Mar 21, 2026
68 documentcloud.org ✅ ✅ ✅ ✅ Svelte/SvelteKit 62 Mar 20, 2026
69 mediavitrina.ru ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 21, 2026
70 nrw.de ✅ ✅ ✅ ✅ Drupal 73 Mar 20, 2026
71 hani.co.kr ✅ ✅ ✅ ✅ Next.js 71 Mar 21, 2026
72 pointmediatracker.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 15, 2026
73 chinanews.com.cn ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 30, 2026
74 newsmax.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 16, 2026
75 itunes.com ✅ ✅ ✅ ✅ Custom / Proprietary 76 Mar 21, 2026
76 hessen.de ✅ ✅ ✅ ✅ Custom / Proprietary 69 Mar 15, 2026
77 news.ru ✅ ✅ ✅ ✅ Custom / Proprietary 60 Mar 17, 2026
78 fineartamerica.com ✅ ✅ ✅ ✅ Custom / Proprietary 75 Mar 17, 2026
79 gbnews.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 21, 2026
80 ovhnextmillmedia.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Apr 4, 2026
81 togetter.com ✅ ✅ ✅ ✅ Custom / Proprietary 78 Mar 15, 2026
82 mdr.de ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
83 chunichi.co.jp ✅ ❌ ❌ ✅ Custom / Proprietary 68 Mar 20, 2026
84 action-media.ru ✅ ✅ ✅ ✅ Next.js 69 Mar 17, 2026
85 deutschlandfunk.de ✅ ✅ ✅ ✅ Custom / Proprietary 65 Mar 15, 2026
86 pgammedia.com ✅ ✅ ✅ ✅ Vercel 62 Mar 21, 2026
87 indiapost.gov.in ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 18, 2026
88 sanspo.com ✅ ✅ ✅ ✅ Custom / Proprietary 67 Mar 15, 2026
89 nfpa.org ✅ ✅ ✅ ✅ Next.js 10 Mar 18, 2026
90 flashback.org ✅ ✅ ✅ ✅ Custom / Proprietary 68 Mar 19, 2026
91 lpsnmedia.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 15, 2026
92 rfa.org ✅ ✅ ✅ ✅ Custom / Proprietary 63 Mar 21, 2026
93 agrarheute.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
94 firstpost.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 18, 2026
95 particlenews.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Mar 15, 2026
96 nmas.com.mx ✅ ✅ ✅ ✅ Next.js 68 Mar 21, 2026
97 inews.co.uk ✅ ✅ ✅ ✅ Custom / Proprietary 18 Mar 20, 2026
98 detroitnews.com ❌ ❌ ❌ ❌ Next.js 10 Mar 18, 2026
99 delaval.com ✅ ✅ ✅ ✅ Custom / Proprietary 73 Mar 15, 2026
100 vodafone.de ✅ ✅ ✅ ✅ Custom / Proprietary 80 Mar 15, 2026

Want the full dataset?

Download the complete CSV with all indexed domains. Free for all users.

Sign Up Free →