Crawl Activity
Rank4AI — rank4ai.co.uk
Bing crawl ran 15h ago · 23 Apr, 06:00 · runs daily 06:00
1400
Total Bing Crawls
544
Pages Indexed (Bing)
13
AI Bots Allowed
0
AI Bots Blocked
Crawler Activity
Bing (bars, left axis) vs AI bots (lines, right axis)
AI Crawler Access
GPTBot allowed
ChatGPT-User allowed
Google-Extended allowed
GoogleOther allowed
ClaudeBot allowed
Claude-Web allowed
PerplexityBot allowed
Bytespider allowed
CCBot allowed
cohere-ai allowed
Amazonbot not_mentioned
anthropic-ai allowed
FacebookBot not_mentioned
Applebot-Extended allowed
Bingbot allowed
Bing Index Growth
Live Crawler Access Test (HTTP Response)
Tests if each bot actually gets a 200 response when visiting the homepage
GPTBot 200
ClaudeBot 200
PerplexityBot 200
Googlebot 200
Bingbot 200
Browser 200
Social Profiles Detected
linkedin
https://www.linkedin.com/company/rank4ai
https://www.linkedin.com/in/adamparkerrank4ai/
twitter
https://x.com/rank4ai
facebook
https://www.facebook.com/rank4ai
instagram
https://www.instagram.com/rank4ai
tiktok
https://www.tiktok.com/@rank4ai
Topic Clusters (11 detected)
/learn/
240
pages in cluster
/blog/
126
pages in cluster
/ai-seo/
40
pages in cluster
/ai-search/
71
pages in cluster
/ai-marketing-growth/
15
pages in cluster
/ai-seo-agency-uk/
9
pages in cluster
/who-we-help/
28
pages in cluster
/research/
139
pages in cluster
/services/
15
pages in cluster
/about/
7
pages in cluster
/what-we-do/
5
pages in cluster
Terminology Consistency (H1 Analysis)
search
259x (35.4%)
business
128x (17.5%)
visibility
94x (12.8%)
businesses
69x (9.4%)
chatgpt
66x (9%)
agencies
64x (8.7%)
google
58x (7.9%)
agency
51x (7%)
should
33x (4.5%)
optimisation
30x (4.1%)