d24.in.net
robots.txt

Robots Exclusion Standard data for d24.in.net

Resource Scan

Scan Details

Site Domain d24.in.net
Base Domain d24.in.net
Scan Status Ok
Last Scan2026-02-19T10:49:21+00:00
Next Scan 2026-03-21T10:49:21+00:00

Last Scan

Scanned2026-02-19T10:49:21+00:00
URL https://d24.in.net/robots.txt
Redirect https://nbcnews.co.com/robots.txt
Redirect Domain nbcnews.co.com
Redirect Base nbcnews.co.com
Domain IPs 104.21.76.162, 172.67.197.119, 2606:4700:3031::ac43:c577, 2606:4700:3036::6815:4ca2
Redirect IPs 104.21.85.166, 172.67.207.167, 2606:4700:3032::ac43:cfa7, 2606:4700:3035::6815:55a6
Response IP 172.67.207.167
Found Yes
Hash 0e5645f76c21e3859d1ece8fcf2e67d65fae9b5f298202c8dcc11b95a312f65a
SimHash 4901c800cdb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://nbcnews.co.com/sitemap_index.xml