detroitnews.us
robots.txt

Robots Exclusion Standard data for detroitnews.us

Resource Scan

Scan Details

Site Domain detroitnews.us
Base Domain detroitnews.us
Scan Status Ok
Last Scan2025-03-04T13:45:11+00:00
Next Scan 2025-04-03T13:45:11+00:00

Last Scan

Scanned2025-03-04T13:45:11+00:00
URL https://detroitnews.us/robots.txt
Redirect https://www.detroitnews.us/robots.txt
Redirect Domain www.detroitnews.us
Redirect Base detroitnews.us
Domain IPs 104.21.28.238, 172.67.147.228, 2606:4700:3032::6815:1cee, 2606:4700:3035::ac43:93e4
Redirect IPs 104.21.28.238, 172.67.147.228, 2606:4700:3032::6815:1cee, 2606:4700:3035::ac43:93e4
Response IP 104.21.28.238
Found Yes
Hash a29a25c403bc8990095f65c0d69c87f24ea898e061ab5751fbc4f92f9c033f91
SimHash 48445e8243d2

Groups

*

Rule Path
Disallow /comments/feed
Disallow /feed/$
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Disallow /trackback/
Disallow /wp-admin/
Disallow /*.inc$
Disallow */trackback/

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.detroitnews.us/sitemap_index.xml