thenyindependent.com
robots.txt

Robots Exclusion Standard data for thenyindependent.com

Resource Scan

Scan Details

Site Domain thenyindependent.com
Base Domain thenyindependent.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-09-16T02:54:04+00:00
Next Scan 2024-12-15T02:54:04+00:00

Last Successful Scan

Scanned2023-08-23T03:58:13+00:00
URL https://thenyindependent.com/robots.txt
Redirect https://www.thenyindependent.com/robots.txt
Redirect Domain www.thenyindependent.com
Redirect Base thenyindependent.com
Domain IPs 54.225.158.118
Redirect IPs 54.225.158.118
Response IP 54.225.158.118
Found Yes
Hash 34b19f9395b75fe897bf48404d17382d147f54e91fb0be04e9406047e4b04322
SimHash 49009840cfb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.thenyindependent.com/sitemap.xml