The Global AI Blocklist Index

Which websites are blocking AI crawlers? Updated daily.

1173281
Domains Indexed
9.2%
Block GPTBot
8.6%
Block ClaudeBot
7.7%
Block CCBot
8.4%
Block Google-Extended

🏆 Most-Blocked Sites

All SaaS News E-commerce Finance
Bot filter: All Blocks GPTBot Blocks ClaudeBot Blocks Any Blocks All
#DomainGPTBotClaudeBotCCBotGoogle-ExtTechScoreLast Crawled
1 cnbc.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 16, 2026
2 t-online.de ❌ ❌ ✅ ✅ Next.js 15 Mar 21, 2026
3 techcrunch.com ❌ ❌ ❌ ❌ WordPress 15 Mar 13, 2026
4 smh.com.au ❌ ❌ ❌ ❌ Vue.js 15 Mar 21, 2026
5 glance.net ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
6 ilsole24ore.com ❌ ✅ ❌ ❌ Next.js 57 Mar 20, 2026
7 theage.com.au ❌ ❌ ❌ ❌ Express 15 Mar 20, 2026
8 liputan6.com ❌ ❌ ❌ ✅ Custom / Proprietary 15 Mar 15, 2026
9 cio.com ❌ ❌ ❌ ✅ Custom / Proprietary 5 Mar 13, 2026
10 bankbazaar.com ❌ ✅ ❌ ✅ Custom / Proprietary 62 Mar 15, 2026
11 dinamalar.com ❌ ✅ ❌ ❌ Next.js 44 Mar 21, 2026
12 investorgain.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
13 chittorgarh.com ❌ ✅ ❌ ✅ Next.js 64 Mar 21, 2026
14 builtin.com ❌ ✅ ✅ ✅ Express 63 Mar 20, 2026
15 newsnow.co.uk ❌ ✅ ✅ ✅ Express 65 Mar 16, 2026
16 okx.cab ❌ ❌ ❌ ❌ Express 15 Mar 20, 2026
17 thehindubusinessline.com ❌ ❌ ❌ ❌ Cloudflare Pages 15 Mar 21, 2026
18 bnnbloomberg.ca ❌ ❌ ❌ ✅ Custom / Proprietary 15 Mar 18, 2026
19 okx.ac ❌ ❌ ❌ ❌ Express 15 Mar 14, 2026
20 mk.co.kr ❌ ❌ ✅ ✅ Custom / Proprietary 15 Mar 18, 2026
21 redalyc.org ❌ ✅ ❌ ✅ Custom / Proprietary 48 Mar 15, 2026
22 cnbctv18.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
23 tracxn.com ❌ ❌ ❌ ❌ Next.js 15 Mar 20, 2026
24 7news.com.au ❌ ✅ ✅ ✅ Express 59 Mar 18, 2026
25 rollcall.com ❌ ✅ ✅ ❌ WordPress 63 Mar 21, 2026
26 hotcopper.com.au ❌ ✅ ✅ ✅ Cloudflare Pages 68 Mar 21, 2026
27 cepr.org ❌ ❌ ❌ ❌ Drupal 15 Mar 21, 2026
28 juicyscore.com ❌ ❌ ❌ ❌ Next.js 15 Mar 14, 2026
29 additionfi.com ❌ ❌ ❌ ❌ HubSpot CMS 15 Mar 21, 2026
30 thenewstack.io ❌ ❌ ❌ ✅ WordPress 15 Mar 20, 2026
31 direct-credit.ru ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
32 haystack.tv ❌ ❌ ❌ ❌ Svelte/SvelteKit 15 Mar 18, 2026
33 palantir.com ❌ ✅ ✅ ✅ Next.js 10 Mar 21, 2026
34 alkamitech.com ❌ ❌ ❌ ❌ WordPress 15 Mar 16, 2026
35 capital.de ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 12, 2026
36 kotobank.jp ❌ ✅ ✅ ✅ Express 65 Mar 20, 2026
37 merdeka.com ❌ ❌ ❌ ✅ Custom / Proprietary 15 Mar 21, 2026
38 watoday.com.au ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 19, 2026
39 chrobinson.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
40 businessday.co.za ❌ ❌ ✅ ❌ Custom / Proprietary 15 Mar 21, 2026
41 babypips.com ❌ ✅ ❌ ✅ Cloudflare Pages 66 Mar 19, 2026
42 theedgemalaysia.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
43 ftadviser.com ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026
44 nortonrosefulbright.com ❌ ❌ ❌ ❌ Express 15 Mar 21, 2026
45 webwiki.nl ❌ ❌ ❌ ❌ WordPress 15 Mar 13, 2026
46 fox17.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
47 crikey.com.au ❌ ❌ ❌ ❌ WordPress 15 Mar 18, 2026
48 caixinglobal.com ❌ ✅ ❌ ✅ Custom / Proprietary 56 Mar 18, 2026
49 globalbankingandfinance.com ❌ ✅ ❌ ❌ Next.js 53 Mar 21, 2026
50 luxoft.com ❌ ✅ ❌ ❌ Custom / Proprietary 66 Mar 21, 2026
51 rzp.io ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 20, 2026
52 globest.com ❌ ❌ ❌ ❌ Nuxt.js 15 Mar 17, 2026
53 businesslive.co.za ❌ ❌ ✅ ❌ Custom / Proprietary 15 Mar 21, 2026
54 rttnews.com ❌ ❌ ❌ ❌ Express 15 Mar 19, 2026
55 realtytrac.com ❌ ❌ ✅ ✅ Next.js 15 Mar 21, 2026
56 dutchycorp.space ❌ ❌ ❌ ❌ Cloudflare Pages 15 Mar 19, 2026
57 nextbigfuture.com ❌ ✅ ✅ ❌ WordPress 62 Mar 21, 2026
58 e27.co ❌ ❌ ✅ ❌ Express 15 Mar 19, 2026
59 business-live.co.uk ❌ ❌ ❌ ✅ Custom / Proprietary 15 Mar 20, 2026
60 imccertifications.com ❌ ❌ ❌ ❌ Express 15 Mar 17, 2026
61 ezetap.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 14, 2026
62 newsroom.co.nz ❌ ❌ ❌ ❌ WordPress 15 Mar 20, 2026
63 criminalip.io ❌ ❌ ❌ ❌ Next.js 10 Mar 21, 2026
64 marketsmojo.com ❌ ✅ ❌ ✅ Next.js 63 Mar 21, 2026
65 forbes.it ❌ ✅ ❌ ❌ Next.js 48 Mar 21, 2026
66 vulcanpost.com ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
67 fint-xpert.com ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
68 starbucks88a.store ❌ ❌ ❌ ❌ Cloudflare Pages 10 Mar 21, 2026
69 fa-mag.com ❌ ❌ ❌ ❌ Cloudflare Pages 15 Mar 21, 2026
70 tirangagamesapp.co ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
71 centralcharts.com ❌ ❌ ❌ ❌ Cloudflare Pages 15 Mar 19, 2026
72 alpha66.online ❌ ❌ ❌ ❌ Cloudflare Pages 10 Mar 21, 2026
73 latoken.com ❌ ❌ ❌ ❌ Next.js 15 Mar 21, 2026
74 pavillion88.org ❌ ❌ ❌ ❌ Cloudflare Pages 10 Mar 21, 2026
75 vidyamana.net ❌ ❌ ❌ ❌ WordPress 15 Mar 16, 2026
76 a66.cool ❌ ❌ ❌ ❌ Cloudflare Pages 10 Mar 21, 2026
77 derainservices.com ❌ ❌ ❌ ❌ Django 15 Mar 21, 2026
78 skyexch.ag ❌ ❌ ❌ ❌ Cloudflare Pages 15 Mar 21, 2026
79 amphitheatreberrybankpark.co.uk ❌ ✅ ❌ ✅ Cloudflare Pages 71 Mar 13, 2026
80 thebanker.com ❌ ❌ ❌ ❌ Express 15 Mar 18, 2026
81 finans.dk ❌ ✅ ❌ ❌ Next.js 46 Mar 17, 2026
82 achtcapitalltd.com ❌ ❌ ❌ ❌ Custom / Proprietary 14 Mar 19, 2026
83 silicon.co.uk ❌ ❌ ❌ ❌ WordPress 15 Mar 18, 2026
84 workforceaustralia.gov.au ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 19, 2026
85 ourbit.com ❌ ❌ ❌ ❌ Next.js 15 Mar 18, 2026
86 equifyfinance.com ❌ ❌ ❌ ❌ Cloudflare Pages 15 Mar 15, 2026
87 vitabank.ru ❌ ❌ ❌ ❌ Custom / Proprietary 5 Mar 16, 2026
88 bankingbloatedcaptive.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Mar 21, 2026
89 paperjam.lu ❌ ❌ ✅ ❌ Next.js 10 Mar 14, 2026
90 axisdirect.in ❌ ❌ ❌ ❌ Next.js 10 Mar 15, 2026
91 job7z.com ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
92 brokeret.com ❌ ❌ ❌ ❌ Express 15 Mar 15, 2026
93 housebets.com ❌ ❌ ✅ ❌ Express 15 Mar 21, 2026
94 awbest.com ❌ ❌ ❌ ❌ WordPress 15 Mar 18, 2026
95 exaffiliate.com ❌ ❌ ❌ ❌ Next.js 15 Mar 13, 2026
96 chaikinanalytics.com ❌ ❌ ❌ ✅ Cloudflare Pages 15 Mar 19, 2026
97 mrbetcasino.com ❌ ✅ ❌ ❌ Cloudflare Pages 51 Mar 21, 2026
98 levikfoto.com ❌ ❌ ❌ ❌ WordPress 15 Mar 21, 2026
99 ecopackersinc.ca ❌ ✅ ❌ ✅ Cloudflare Pages 71 Mar 21, 2026
100 pinupcasino.com ❌ ✅ ❌ ❌ Cloudflare Pages 54 Mar 21, 2026

Want the full dataset?

Download the complete CSV with all indexed domains. Free for all users.

Sign Up Free →