crypto-guider.com
robots.txt
Robots Exclusion Standard data for crypto-guider.com
Resource Scan
Scan Details
Site Domain | crypto-guider.com |
Base Domain | crypto-guider.com |
Scan Status | Ok |
Last Scan | 2025-08-09T09:30:37+00:00 |
Next Scan | 2025-09-08T09:30:37+00:00 |
Last Scan
Scanned | 2025-08-09T09:30:37+00:00 |
URL | https://crypto-guider.com/robots.txt |
Domain IPs | 104.21.89.90, 172.67.157.101, 2606:4700:3034::ac43:9d65, 2606:4700:3035::6815:595a |
Response IP | 172.67.157.101 |
Found | Yes |
Hash | 3b43137ad472036912c5b5756783998a6d4a21eb2c09c84b2d959e39d1ff19c4 |
SimHash | e928cc022893 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /?s= |
Disallow | /page/*/?s= |
Disallow | /search/ |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | https://crypto-guider.com/sitemap.xml |