cornish-steam.co.uk
robots.txt

Robots Exclusion Standard data for cornish-steam.co.uk

Resource Scan

Scan Details

Site Domain cornish-steam.co.uk
Base Domain cornish-steam.co.uk
Scan Status Ok
Last Scan2024-09-28T11:15:32+00:00
Next Scan 2024-10-05T11:15:32+00:00

Last Scan

Scanned2024-09-28T11:15:32+00:00
URL https://cornish-steam.co.uk/robots.txt
Domain IPs 104.21.49.87, 172.67.189.109, 2606:4700:3034::6815:3157, 2606:4700:3036::ac43:bd6d
Response IP 104.21.49.87
Found Yes
Hash 052f173f746377f2d5cbc44a63facbf8f3614b147a3cc6667c370598ff4aa606
SimHash 2922de44e392

Groups

mediapartners-google
*

Rule Path
Disallow /misc.php

Other Records

Field Value
crawl-delay 300