agriapet.co.uk
robots.txt

Robots Exclusion Standard data for agriapet.co.uk

Resource Scan

Scan Details

Site Domain agriapet.co.uk
Base Domain agriapet.co.uk
Scan Status Ok
Last Scan2024-05-03T09:31:40+00:00
Next Scan 2024-06-02T09:31:40+00:00

Last Scan

Scanned2024-05-03T09:31:40+00:00
URL https://agriapet.co.uk/robots.txt
Redirect https://www.agriapet.co.uk/robots.txt
Redirect Domain www.agriapet.co.uk
Redirect Base agriapet.co.uk
Domain IPs 15.197.167.90, 3.33.186.135
Redirect IPs 13.215.31.72, 175.41.180.202, 2406:da18:b3d:e201::1f4, 2406:da18:b3d:e202::1f4
Response IP 13.215.246.123
Found Yes
Hash 71ef79fddb2ebc19b8682606ff3fd309b7f6fcbe5c8804bdc35013ff39f63428
SimHash 45488d434731

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.agriapet.co.uk/sitemap-index.xml

Warnings

  • `host` is not a known field.