express.howstuffworks.com
robots.txt

Robots Exclusion Standard data for express.howstuffworks.com

Resource Scan

Scan Details

Site Domain express.howstuffworks.com
Base Domain howstuffworks.com
Scan Status Ok
Last Scan2024-05-25T11:33:48+00:00
Next Scan 2024-06-24T11:33:48+00:00

Last Scan

Scanned2024-05-25T11:33:48+00:00
URL https://express.howstuffworks.com/robots.txt
Redirect https://animals.howstuffworks.com/robots.txt
Redirect Domain animals.howstuffworks.com
Redirect Base howstuffworks.com
Domain IPs 34.236.42.14, 44.197.139.54, 54.210.139.195, 54.81.165.217, 54.91.70.161
Redirect IPs 13.33.30.105, 13.33.30.29, 13.33.30.66, 13.33.30.68
Response IP 13.33.30.68
Found Yes
Hash 6c6ef8270aa74579dbe6fbdafc81519ec9e9194e41ddada5c64668b4fa2b872d
SimHash 4b018e744733

Groups

*

Rule Path
Disallow /framed.htm
Disallow /editor/
Allow /*?page
Allow /*?photo
Allow /*?utm
Disallow /*?

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
sitemap https://animals.howstuffworks.com/animals-sitemap-index.xml