yeeg.co.uk
robots.txt

Robots Exclusion Standard data for yeeg.co.uk

Resource Scan

Scan Details

Site Domain yeeg.co.uk
Base Domain yeeg.co.uk
Scan Status Ok
Last Scan2025-10-25T01:44:46+00:00
Next Scan 2025-11-24T01:44:46+00:00

Last Scan

Scanned2025-10-25T01:44:46+00:00
URL http://yeeg.co.uk/robots.txt
Redirect http://www.yeeg.co.uk/robots.txt
Redirect Domain www.yeeg.co.uk
Redirect Base yeeg.co.uk
Domain IPs 199.34.228.100
Redirect IPs 199.34.228.100
Response IP 199.34.228.100
Found Yes
Hash 0f26052e4233340916b0ccf0f5d5ac619efcc279c0eb2fabde68c1fa21242e6a
SimHash 6854dca00233

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /information-members-only.html
Disallow /enviroccrime-convictions.html
Disallow /members-area.html

Other Records

Field Value
sitemap http://www.yeeg.co.uk/sitemap.xml