navytimes.com
robots.txt

Robots Exclusion Standard data for navytimes.com

Resource Scan

Scan Details

Site Domain navytimes.com
Base Domain navytimes.com
Scan Status Ok
Last Scan2024-05-14T23:18:37+00:00
Next Scan 2024-05-21T23:18:37+00:00

Last Scan

Scanned2024-05-14T23:18:37+00:00
URL https://navytimes.com/robots.txt
Redirect https://www.navytimes.com:443/robots.txt
Redirect Domain www.navytimes.com
Redirect Base navytimes.com
Domain IPs 23.23.44.12, 3.216.116.160, 3.224.248.98, 34.235.251.139, 34.236.215.55, 52.203.13.154
Redirect IPs 23.211.140.162, 23.211.140.56, 2600:1413:b000:14::b857:c146, 2600:1413:b000:14::b857:c159
Response IP 42.99.140.209
Found Yes
Hash 606b54c5112def7f49e92c6d4e14851cede656fc597f4f054b21904f02d81e64
SimHash 891ddd45ad93

Groups

*

Rule Path
Disallow /search/

Other Records

Field Value
sitemap https://www.navytimes.com/arc/outboundfeeds/sitemap-index/?outputType=xml
sitemap https://www.navytimes.com/arc/outboundfeeds/sitemap-news/?outputType=xml