popcrushs.com
robots.txt

Robots Exclusion Standard data for popcrushs.com

Resource Scan

Scan Details

Site Domain popcrushs.com
Base Domain popcrushs.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan5/25/2025, 6:24:50 AM
Next Scan 7/24/2025, 6:24:50 AM

Last Successful Scan

Scanned3/20/2025, 5:42:50 AM
URL https://popcrushs.com/robots.txt
Domain IPs 104.21.33.117, 172.67.162.85, 2606:4700:3033::6815:2175, 2606:4700:3033::ac43:a255
Response IP 104.21.33.117
Found Yes
Hash 448f76d9b3d00b1330cc5c20aa4c221b9d4c28bd0a86e190b8f7780d5641358a
SimHash 8800ca628bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

adbeat_bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.popcrushs.com/sitemap.xml
sitemap https://www.popcrushs.com/sitemap.rss