cryptoandtechnews.com
robots.txt

Robots Exclusion Standard data for cryptoandtechnews.com

Resource Scan

Scan Details

Site Domain cryptoandtechnews.com
Base Domain cryptoandtechnews.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-06T22:59:41+00:00
Next Scan 2026-03-07T22:59:41+00:00

Last Successful Scan

Scanned2025-11-07T21:15:48+00:00
URL https://cryptoandtechnews.com/robots.txt
Domain IPs 104.21.84.29, 172.67.185.97, 2606:4700:3032::ac43:b961, 2606:4700:3034::6815:541d
Response IP 172.67.185.97
Found Yes
Hash 9311bab30d8b5d05f5fa5563a251b8c96b8470873bb77c62d3d17c146d7acab7
SimHash 4100c8004bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php