history.howstuffworks.com
robots.txt

Robots Exclusion Standard data for history.howstuffworks.com

Resource Scan

Scan Details

Site Domain history.howstuffworks.com
Base Domain howstuffworks.com
Scan Status Ok
Last Scan2024-05-25T13:37:48+00:00
Next Scan 2024-06-24T13:37:48+00:00

Last Scan

Scanned2024-05-25T13:37:48+00:00
URL https://history.howstuffworks.com/robots.txt
Domain IPs 18.161.180.104, 18.161.180.15, 18.161.180.61, 18.161.180.90
Response IP 13.33.30.68
Found Yes
Hash e702bd02dccf4cc91186f07507fa1c49c0a6d06082f6354a3fd4f3189e498483
SimHash 4b055c55cd13

Groups

*

Rule Path
Disallow /framed.htm
Disallow /editor/

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
sitemap https://history.howstuffworks.com/history-sitemap-index.xml