crushthenumbers.org
robots.txt

Robots Exclusion Standard data for crushthenumbers.org

Resource Scan

Scan Details

Site Domain crushthenumbers.org
Base Domain crushthenumbers.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-17T04:42:48+00:00
Next Scan 2025-07-16T04:42:48+00:00

Last Successful Scan

Scanned2023-03-05T23:16:55+00:00
URL https://crushthenumbers.org/robots.txt
Redirect https://www.crushthenumbers.org/robots.txt
Redirect Domain www.crushthenumbers.org
Redirect Base crushthenumbers.org
Domain IPs 104.21.37.140, 172.67.209.40, 2606:4700:3033::6815:258c, 2606:4700:3036::ac43:d128
Redirect IPs 104.21.37.140, 172.67.209.40, 2606:4700:3033::6815:258c, 2606:4700:3036::ac43:d128
Response IP 104.21.37.140
Found Yes
Hash 2de4140fc1f6239b1427c249790bcc266a6fc390dc6bd678fe53606e57e58756
SimHash 4900cc008fb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.crushthenumbers.org/wp-sitemap.xml