Crawl Activity
Market Invoice — marketinvoice.co.uk
Bing crawl ran 15h ago · 23 Apr, 06:00 · runs daily 06:00
26
Total Bing Crawls
0
Pages Indexed (Bing)
10
AI Bots Allowed
0
AI Bots Blocked
Crawler Activity
Bing (bars, left axis) vs AI bots (lines, right axis)
AI Crawler Access
GPTBot allowed
ChatGPT-User allowed
Google-Extended allowed
GoogleOther allowed
ClaudeBot allowed
Claude-Web not_mentioned
PerplexityBot allowed
Bytespider not_mentioned
CCBot allowed
cohere-ai not_mentioned
Amazonbot allowed
anthropic-ai not_mentioned
FacebookBot not_mentioned
Applebot-Extended allowed
Bingbot allowed
Bing Index Growth
Server-Side Bot Hits
Real crawler visits detected at the server level (last 3 days)
1252
Total Bot Hits
156
AI Crawler Hits
140
Search Crawler Hits
14
Unique Bots
Bot Breakdown
Other Crawler 703
Other Bot 115
SemrushBot 76
GoogleOther 64
ChatGPT-User 62
Googlebot 61
YandexBot 61
MajesticBot 60
ClaudeBot 23
Applebot 16
PerplexityBot 4
GPTBot 3
Bingbot 2
Facebook 2
Daily Hits
15 Apr
44 AI 77 search 1 social 60 seo 544
14 Apr
97 AI 50 search 1 social 69 seo 321
13 Apr
15 AI 13 search 7 seo 387
Live Crawler Access Test (HTTP Response)
Tests if each bot actually gets a 200 response when visiting the homepage
GPTBot 200
ClaudeBot 200
PerplexityBot 200
Googlebot 200
Bingbot 200
Browser 200
Topic Clusters (9 detected)
/providers/
90
pages in cluster
/compare/
13
pages in cluster
/questions/
109
pages in cluster
/locations/
50
pages in cluster
/guides/
24
pages in cluster
/blog/
23
pages in cluster
/best/
20
pages in cluster
/industries/
26
pages in cluster
/working-capital/
7
pages in cluster
Terminology Consistency (H1 Analysis)
finance
287x (73.6%)
invoice
259x (66.4%)
review
64x (16.4%)
factoring
19x (4.9%)
best
17x (4.4%)
invoices
15x (3.8%)
companies
15x (3.8%)
bank
14x (3.6%)
business
13x (3.3%)
credit
9x (2.3%)