howstuffworks.com
robots.txt

Robots Exclusion Standard data for howstuffworks.com

Resource Scan

Scan Details

Site Domain howstuffworks.com
Base Domain howstuffworks.com
Scan Status Ok
Last Scan2024-05-24T19:39:47+00:00
Next Scan 2024-05-31T19:39:47+00:00

Last Scan

Scanned2024-05-24T19:39:47+00:00
URL https://howstuffworks.com/robots.txt
Redirect https://www.howstuffworks.com/robots.txt
Redirect Domain www.howstuffworks.com
Redirect Base howstuffworks.com
Domain IPs 13.33.30.105, 13.33.30.29, 13.33.30.66, 13.33.30.68
Redirect IPs 13.33.30.105, 13.33.30.29, 13.33.30.66, 13.33.30.68
Response IP 13.33.30.105
Found Yes
Hash d5a75e773ae8e3929a42f199c59c8be47f669bb2a5e48ffbf3608f71c7038011
SimHash 4b055c544d12

Groups

*

Rule Path
Disallow /framed.htm
Disallow /editor/

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.howstuffworks.com/www-sitemap-index.xml