The Global AI Blocklist Index

Which websites are blocking AI crawlers? Updated daily.

1173281
Domains Indexed
9.2%
Block GPTBot
8.6%
Block ClaudeBot
7.7%
Block CCBot
8.4%
Block Google-Extended

🏆 Most-Blocked Sites

All SaaS News E-commerce Finance
Bot filter: All Blocks GPTBot Blocks ClaudeBot Blocks Any Blocks All
#DomainGPTBotClaudeBotCCBotGoogle-ExtTechScoreLast Crawled
1 cnbc.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 16, 2026
2 t-online.de ❌ ❌ ✅ ✅ Next.js 15 Mar 21, 2026
3 techcrunch.com ❌ ❌ ❌ ❌ WordPress 15 Mar 13, 2026
4 fortune.com ✅ ✅ ❌ ❌ Next.js 61 Mar 21, 2026
5 sovcombank.ru ✅ ✅ ❌ ✅ Custom / Proprietary 16 Mar 19, 2026
6 smh.com.au ❌ ❌ ❌ ❌ Vue.js 15 Mar 21, 2026
7 seekingalpha.com ✅ ❌ ❌ ✅ React 70 Mar 21, 2026
8 glance.net ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
9 ilsole24ore.com ❌ ✅ ❌ ❌ Next.js 57 Mar 20, 2026
10 theage.com.au ❌ ❌ ❌ ❌ Express 15 Mar 20, 2026
11 liputan6.com ❌ ❌ ❌ ✅ Custom / Proprietary 15 Mar 15, 2026
12 cio.com ❌ ❌ ❌ ✅ Custom / Proprietary 5 Mar 13, 2026
13 bankbazaar.com ❌ ✅ ❌ ✅ Custom / Proprietary 62 Mar 15, 2026
14 dinamalar.com ❌ ✅ ❌ ❌ Next.js 44 Mar 21, 2026
15 investorgain.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
16 chittorgarh.com ❌ ✅ ❌ ✅ Next.js 64 Mar 21, 2026
17 builtin.com ❌ ✅ ✅ ✅ Express 63 Mar 20, 2026
18 newsnow.co.uk ❌ ✅ ✅ ✅ Express 65 Mar 16, 2026
19 lexology.com ✅ ❌ ❌ ❌ Custom / Proprietary 50 Mar 20, 2026
20 ipowatch.in ✅ ✅ ❌ ✅ WordPress 75 Mar 17, 2026
21 okx.cab ❌ ❌ ❌ ❌ Express 15 Mar 20, 2026
22 thehindubusinessline.com ❌ ❌ ❌ ❌ Cloudflare Pages 15 Mar 21, 2026
23 bnnbloomberg.ca ❌ ❌ ❌ ✅ Custom / Proprietary 15 Mar 18, 2026
24 okx.ac ❌ ❌ ❌ ❌ Express 15 Mar 14, 2026
25 mk.co.kr ❌ ❌ ✅ ✅ Custom / Proprietary 15 Mar 18, 2026
26 money.com ✅ ✅ ❌ ✅ Express 75 Mar 21, 2026
27 law360.com ✅ ✅ ✅ ❌ Express 63 Mar 19, 2026
28 redalyc.org ❌ ✅ ❌ ✅ Custom / Proprietary 48 Mar 15, 2026
29 quotidiano.net ✅ ❌ ❌ ✅ Next.js 52 Mar 20, 2026
30 cnbctv18.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
31 tracxn.com ❌ ❌ ❌ ❌ Next.js 15 Mar 20, 2026
32 wallethub.com ✅ ❌ ❌ ✅ Express 66 Mar 16, 2026
33 7news.com.au ❌ ✅ ✅ ✅ Express 59 Mar 18, 2026
34 rollcall.com ❌ ✅ ✅ ❌ WordPress 63 Mar 21, 2026
35 hotcopper.com.au ❌ ✅ ✅ ✅ Cloudflare Pages 68 Mar 21, 2026
36 patrika.com ✅ ❌ ✅ ✅ Next.js 64 Mar 21, 2026
37 cepr.org ❌ ❌ ❌ ❌ Drupal 15 Mar 21, 2026
38 juicyscore.com ❌ ❌ ❌ ❌ Next.js 15 Mar 14, 2026
39 additionfi.com ❌ ❌ ❌ ❌ HubSpot CMS 15 Mar 21, 2026
40 thenewstack.io ❌ ❌ ❌ ✅ WordPress 15 Mar 20, 2026
41 direct-credit.ru ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
42 haystack.tv ❌ ❌ ❌ ❌ Svelte/SvelteKit 15 Mar 18, 2026
43 irishnews.com ✅ ❌ ❌ ❌ Custom / Proprietary 46 Mar 21, 2026
44 palantir.com ❌ ✅ ✅ ✅ Next.js 10 Mar 21, 2026
45 alkamitech.com ❌ ❌ ❌ ❌ WordPress 15 Mar 16, 2026
46 capital.de ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 12, 2026
47 kotobank.jp ❌ ✅ ✅ ✅ Express 65 Mar 20, 2026
48 merdeka.com ❌ ❌ ❌ ✅ Custom / Proprietary 15 Mar 21, 2026
49 knoji.com ✅ ✅ ❌ ✅ Cloudflare Pages 68 Mar 21, 2026
50 financemagnates.com ✅ ✅ ❌ ✅ Nuxt.js 61 Mar 21, 2026
51 watoday.com.au ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 19, 2026
52 chrobinson.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
53 businessday.co.za ❌ ❌ ✅ ❌ Custom / Proprietary 15 Mar 21, 2026
54 babypips.com ❌ ✅ ❌ ✅ Cloudflare Pages 66 Mar 19, 2026
55 theedgemalaysia.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
56 josbank.com ✅ ✅ ❌ ✅ Custom / Proprietary 3 Mar 21, 2026
57 ftadviser.com ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026
58 nortonrosefulbright.com ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026
59 webwiki.nl ❌ ❌ ❌ ❌ WordPress 15 Mar 13, 2026
60 fox17.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
61 crikey.com.au ❌ ❌ ❌ ❌ WordPress 15 Mar 18, 2026
62 caixinglobal.com ❌ ✅ ❌ ✅ Custom / Proprietary 56 Mar 18, 2026
63 globalbankingandfinance.com ❌ ✅ ❌ ❌ Next.js 53 Mar 21, 2026
64 walletinvestor.com ✅ ✅ ❌ ✅ WordPress 70 Mar 21, 2026
65 luxoft.com ❌ ✅ ❌ ❌ Custom / Proprietary 66 Mar 21, 2026
66 lcb.org ✅ ❌ ✅ ✅ Custom / Proprietary 10 Mar 18, 2026
67 rzp.io ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
68 globest.com ❌ ❌ ❌ ❌ Nuxt.js 15 Mar 17, 2026
69 businesslive.co.za ❌ ❌ ✅ ❌ Custom / Proprietary 15 Mar 21, 2026
70 rttnews.com ❌ ❌ ❌ ❌ Express 15 Mar 19, 2026
71 realtytrac.com ❌ ❌ ✅ ✅ Next.js 15 Mar 21, 2026
72 dutchycorp.space ❌ ❌ ❌ ❌ Cloudflare Pages 15 Mar 19, 2026
73 etnownews.com ✅ ❌ ✅ ✅ Next.js 69 Mar 20, 2026
74 nextbigfuture.com ❌ ✅ ✅ ❌ WordPress 62 Mar 21, 2026
75 e27.co ❌ ❌ ✅ ❌ Express 15 Mar 19, 2026
76 business-live.co.uk ❌ ❌ ❌ ✅ Custom / Proprietary 15 Mar 20, 2026
77 imccertifications.com ❌ ❌ ❌ ❌ Express 15 Mar 17, 2026
78 ezetap.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 14, 2026
79 litefinance.org ✅ ✅ ❌ ✅ Custom / Proprietary 65 Mar 21, 2026
80 in-bank.ru ✅ ❌ ✅ ✅ Custom / Proprietary 54 Mar 21, 2026
81 newsroom.co.nz ❌ ❌ ❌ ❌ WordPress 15 Mar 20, 2026
82 criminalip.io ❌ ❌ ❌ ❌ Next.js 10 Mar 21, 2026
83 marketsmojo.com ❌ ✅ ❌ ✅ Next.js 63 Mar 21, 2026
84 forbes.it ❌ ✅ ❌ ❌ Next.js 48 Mar 21, 2026
85 vulcanpost.com ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
86 fint-xpert.com ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
87 starbucks88a.store ❌ ❌ ❌ ❌ Cloudflare Pages 10 Mar 21, 2026
88 fa-mag.com ❌ ❌ ❌ ❌ Cloudflare Pages 15 Mar 21, 2026
89 tirangagamesapp.co ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
90 centralcharts.com ❌ ❌ ❌ ❌ Cloudflare Pages 15 Mar 19, 2026
91 alpha66.online ❌ ❌ ❌ ❌ Cloudflare Pages 10 Mar 21, 2026
92 latoken.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
93 pavillion88.org ❌ ❌ ❌ ❌ Cloudflare Pages 10 Mar 21, 2026
94 vidyamana.net ❌ ❌ ❌ ❌ WordPress 15 Mar 16, 2026
95 a66.cool ❌ ❌ ❌ ❌ Cloudflare Pages 10 Mar 21, 2026
96 derainservices.com ❌ ❌ ❌ ❌ Django 15 Mar 21, 2026
97 skyexch.ag ❌ ❌ ❌ ❌ Cloudflare Pages 15 Mar 21, 2026
98 amphitheatreberrybankpark.co.uk ❌ ✅ ❌ ✅ Cloudflare Pages 71 Mar 13, 2026
99 thebanker.com ❌ ❌ ❌ ❌ Express 15 Mar 18, 2026
100 finans.dk ❌ ✅ ❌ ❌ Next.js 46 Mar 17, 2026

Want the full dataset?

Download the complete CSV with all indexed domains. Free for all users.

Sign Up Free →