unitedstatesnow.org
robots.txt

Robots Exclusion Standard data for unitedstatesnow.org

Resource Scan

Scan Details

Site Domain unitedstatesnow.org
Base Domain unitedstatesnow.org
Scan Status Ok
Last Scan2024-10-27T07:30:12+00:00
Next Scan 2024-11-03T07:30:12+00:00

Last Scan

Scanned2024-10-27T07:30:12+00:00
URL https://unitedstatesnow.org/robots.txt
Redirect https://www.unitedstatesnow.org/robots.txt
Redirect Domain www.unitedstatesnow.org
Redirect Base unitedstatesnow.org
Domain IPs 13.56.63.160, 13.57.89.2
Redirect IPs 2600:9000:2753:1000:9:2198:cb00:93a1, 2600:9000:2753:1e00:9:2198:cb00:93a1, 2600:9000:2753:4800:9:2198:cb00:93a1, 2600:9000:2753:8200:9:2198:cb00:93a1, 2600:9000:2753:a000:9:2198:cb00:93a1, 2600:9000:2753:b200:9:2198:cb00:93a1, 2600:9000:2753:c00:9:2198:cb00:93a1, 2600:9000:2753:c800:9:2198:cb00:93a1, 54.230.71.118, 54.230.71.39, 54.230.71.55, 54.230.71.6
Response IP 108.157.254.108
Found Yes
Hash 0e9be9a77deeb79663405385d7414264ae05f2af940b0ff7086a86c3f8097425
SimHash 2b11d33c2513

Groups

*

Rule Path
Disallow /s/
Disallow /templates/
Disallow /d/
Disallow /related/
Disallow /relevant/
Disallow /videos/
Disallow /captcha.php
Disallow /*?expand_article
Disallow /*.js?cb=
Disallow /quizzes*

mediapartners-google

Rule Path
Allow /s/
Allow /related/
Allow /relevant/

Other Records

Field Value
sitemap https://www.unitedstatesnow.org/sitemap-unitedstatesnow.org-index.xml