sapi.dailymail.co.uk
robots.txt

Robots Exclusion Standard data for sapi.dailymail.co.uk

Resource Scan

Scan Details

Site Domain sapi.dailymail.co.uk
Base Domain dailymail.co.uk
Scan Status Ok
Last Scan2024-05-12T06:00:53+00:00
Next Scan 2024-06-11T06:00:53+00:00

Last Scan

Scanned2024-05-12T06:00:53+00:00
URL https://sapi.dailymail.co.uk/robots.txt
Domain IPs 23.195.153.197, 2600:1413:b000:699::16c2, 2600:1413:b000:69b::16c2
Response IP 184.51.96.225
Found Yes
Hash 8d5fe96a1f9cca8265e4ca237ac757bde8e46c6643f4703a1c7bed9614b72a9b
SimHash 41544bc195e0

Groups

googlebot

Rule Path
Allow /mobile/2.1/article/*
Allow /mobile/2.3/article/*
Allow /mobile/3.0/article/*
Allow /native/4.0/article/*
Disallow /

*

Rule Path
Disallow /

Comments

  • Updated - 23/09/2015
  • All Robots