Log In Sign Up

imuso.co.uk
robots.txt

Robots Exclusion Standard data for imuso.co.uk

Resource Scan

Scan Details

Site Domain imuso.co.uk
Base Domain imuso.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan3/22/2025, 1:15:10 PM
Next Scan 6/20/2025, 1:15:10 PM

Last Successful Scan

Scanned8/25/2024, 1:12:45 PM
URL https://imuso.co.uk/robots.txt
Redirect https://www.imuso.co.uk/robots.txt
Redirect Domain www.imuso.co.uk
Redirect Base imuso.co.uk
Domain IPs 104.21.43.64, 172.67.221.115, 2606:4700:3032::ac43:dd73, 2606:4700:3036::6815:2b40
Redirect IPs 104.21.43.64, 172.67.221.115, 2606:4700:3032::ac43:dd73, 2606:4700:3036::6815:2b40
Response IP 104.21.43.64
Found Yes
Hash de956523a206c28f6a275d38c36cc3b2a0c9bb8db77a68fcccbc0f174ae617d6
SimHash bb06d840d613

Groups

*

Rule Path
Disallow /go/*
Disallow /search/*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

httrack

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

brandverity

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

buck

Rule Path
Disallow /

tigerbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

bot@linkfluence.net

Rule Path
Disallow /

evc-batch

Rule Path
Disallow /

zgrab

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

applebot

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

zing-bottabot*

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

crawlera

Rule Path
Disallow /

wget

Rule Path
Disallow /

nutch

Rule Path
Disallow /

kikbot

Rule Path
Disallow /

voltron

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.imuso.co.uk/sitemap.xml
sitemap https://www.imuso.co.uk/sitemap-items1.xml
sitemap https://www.imuso.co.uk/sitemap-items2.xml
Back to top