animalsinsider.com
robots.txt

Robots Exclusion Standard data for animalsinsider.com

Resource Scan

Scan Details

Site Domain animalsinsider.com
Base Domain animalsinsider.com
Scan Status Ok
Last Scan2025-12-22T15:41:56+00:00
Next Scan 2025-12-29T15:41:56+00:00

Last Scan

Scanned2025-12-22T15:41:56+00:00
URL https://www.animalsinsider.com/robots.txt
Domain IPs 104.21.14.160, 172.67.160.7, 2606:4700:3033::6815:ea0, 2606:4700:3033::ac43:a007
Response IP 172.67.160.7
Found Yes
Hash fb30d4dc1c20c02a41692cc89663949b9cb7f76e3b8b72f6c23bdc00b8c9417e
SimHash 59004d204b32

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /*blackhole
Disallow /?blackhole