sigdistribution.co.uk
robots.txt

Robots Exclusion Standard data for sigdistribution.co.uk

Resource Scan

Scan Details

Site Domain sigdistribution.co.uk
Base Domain sigdistribution.co.uk
Scan Status Ok
Last Scan2024-09-21T00:01:25+00:00
Next Scan 2024-10-21T00:01:25+00:00

Last Scan

Scanned2024-09-21T00:01:25+00:00
URL https://sigdistribution.co.uk/robots.txt
Domain IPs 104.18.18.229, 104.18.19.229, 2606:4700::6812:12e5, 2606:4700::6812:13e5
Response IP 104.18.19.229
Found Yes
Hash 75ea569bd4acfbc2d07156a5d6d794b99c9075df19f58b61db8c4d6c04ac0cf9
SimHash 2508cba34691

Groups

*

Rule Path
Disallow /

googlebot
googlebot-image
mediapartners-google
googlebot-mobile
googlebot-news
googlebot-video
storebot-google
adsbot-google
msnbot
msnbot-media
bingbot
adisxbot
slurp
yahoo-blogs
yahoo-mmcrawler
yandex
baiduspider
baiduspider-image
baiduspider-news
baiduspider-mobile

No rules defined. All paths allowed.

Comments

  • Basic robots.txt to block everything but major search engines