portsmouthfc.co.uk
robots.txt

Robots Exclusion Standard data for portsmouthfc.co.uk

Resource Scan

Scan Details

Site Domain portsmouthfc.co.uk
Base Domain portsmouthfc.co.uk
Scan Status Ok
Last Scan2024-06-07T13:36:20+00:00
Next Scan 2024-06-14T13:36:20+00:00

Last Scan

Scanned2024-06-07T13:36:20+00:00
URL https://portsmouthfc.co.uk/robots.txt
Redirect https://www.portsmouthfc.co.uk/robots.txt
Redirect Domain www.portsmouthfc.co.uk
Redirect Base portsmouthfc.co.uk
Domain IPs 217.114.94.2
Redirect IPs 104.18.36.186, 172.64.151.70, 2606:4700:4400::6812:24ba, 2606:4700:4400::ac40:9746
Response IP 104.18.36.186
Found Yes
Hash 4ceb204af793253c77d1ac2e8394a8893e70bc0a63ce906963a1847506ee1a04
SimHash 6396b015e7b4

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.portsmouthfc.co.uk/sitemap.xml