scarymommy.com
robots.txt

Robots Exclusion Standard data for scarymommy.com

Resource Scan

Scan Details

Site Domain scarymommy.com
Base Domain scarymommy.com
Scan Status Ok
Last Scan2024-06-01T05:35:23+00:00
Next Scan 2024-06-08T05:35:23+00:00

Last Scan

Scanned2024-06-01T05:35:23+00:00
URL https://scarymommy.com/robots.txt
Redirect https://www.scarymommy.com/robots.txt
Redirect Domain www.scarymommy.com
Redirect Base scarymommy.com
Domain IPs 108.156.133.10, 108.156.133.113, 108.156.133.52, 108.156.133.54
Redirect IPs 108.156.133.10, 108.156.133.113, 108.156.133.52, 108.156.133.54
Response IP 108.156.133.54
Found Yes
Hash d162f9b75ec1dd76f345c57cb17e8f03bbf45c2c4bce1f0229f09ca3f18ebdd0
SimHash 39745840ef13

Groups

*

Rule Path
Disallow
Disallow /search?*

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

newswhipbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.scarymommy.com/sitemaps/pages.xml
sitemap https://www.scarymommy.com/sitemaps/news.xml