codes.co.uk
robots.txt

Robots Exclusion Standard data for codes.co.uk

Resource Scan

Scan Details

Site Domain codes.co.uk
Base Domain codes.co.uk
Scan Status Ok
Last Scan2025-09-26T17:35:57+00:00
Next Scan 2025-10-26T17:35:57+00:00

Last Scan

Scanned2025-09-26T17:35:57+00:00
URL https://codes.co.uk/robots.txt
Redirect https://www.codes.co.uk/robots.txt
Redirect Domain www.codes.co.uk
Redirect Base codes.co.uk
Domain IPs 51.140.87.39
Redirect IPs 51.140.87.39
Response IP 51.140.87.39
Found Yes
Hash abed71a5bc209fe1cb011af3bb34a4bc546969294bb2d8a100aeb0aac876b8e7
SimHash e4155cb0c791

Groups

*

Rule Path
Disallow /rc/
Disallow /rm/
Disallow /coupon/share/
Disallow /c/

adidxbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10