nyp.com
robots.txt

Robots Exclusion Standard data for nyp.com

Resource Scan

Scan Details

Site Domain nyp.com
Base Domain nyp.com
Scan Status Ok
Last Scan2025-09-26T18:43:46+00:00
Next Scan 2025-10-26T18:43:46+00:00

Last Scan

Scanned2025-09-26T18:43:46+00:00
URL http://nyp.com/robots.txt
Domain IPs 216.146.192.1, 2607:f441::d892:c001
Response IP 216.146.192.1
Found Yes
Hash c499b52b0376cd79abd7763b6ad569b2ebae9c64293c8f293b3e3be35ef4c81b
SimHash a915d8a4af93

Groups

nerdybot

Rule Path
Disallow /

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap http://nyp.com/sitemap.xml