cryptotravellers.com
robots.txt
Robots Exclusion Standard data for cryptotravellers.com
Resource Scan
Scan Details
Site Domain | cryptotravellers.com |
Base Domain | cryptotravellers.com |
Scan Status | Ok |
Last Scan | 2024-10-29T00:04:16+00:00 |
Next Scan | 2024-11-28T00:04:16+00:00 |
Last Scan
Scanned | 2024-10-29T00:04:16+00:00 |
URL | https://cryptotravellers.com/robots.txt |
Domain IPs | 216.24.57.1 |
Response IP | 216.24.57.1 |
Found | Yes |
Hash | 0782f23e68af1a08910798a98f67742a2ae71b08705cc9a35e2a7c1b8f0b049c |
SimHash | f094d308e9d3 |
Groups
*
Rule | Path |
---|---|
Disallow | /tags/ |
Disallow | /categories/ |
Disallow | /page/ |
Disallow | /link/ |
Disallow | /search/ |