nytimes.uk
robots.txt

Robots Exclusion Standard data for nytimes.uk

Resource Scan

Scan Details

Site Domain nytimes.uk
Base Domain nytimes.uk
Scan Status Ok
Last Scan2025-03-08T22:59:14+00:00
Next Scan 2025-03-15T22:59:14+00:00

Last Scan

Scanned2025-03-08T22:59:14+00:00
URL https://nytimes.uk/robots.txt
Redirect https://www.nytimes.uk/robots.txt
Redirect Domain www.nytimes.uk
Redirect Base nytimes.uk
Domain IPs 2a02:4780:b:1394:0:1c1c:f153:8, 89.116.192.188
Redirect IPs 2a02:4780:b:1394:0:1c1c:f153:8, 89.116.192.188
Response IP 89.116.192.188
Found Yes
Hash 79c21c487818f770bdc57d808355ab6173ed7a57f63d2ece414bf041f12bceb8
SimHash 490198400f92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.nytimes.uk/sitemap_index.xml