learncrypto.com
robots.txt
Robots Exclusion Standard data for learncrypto.com
Resource Scan
Scan Details
Site Domain | learncrypto.com |
Base Domain | learncrypto.com |
Scan Status | Ok |
Last Scan | 2025-09-28T11:15:03+00:00 |
Next Scan | 2025-10-28T11:15:03+00:00 |
Last Scan
Scanned | 2025-09-28T11:15:03+00:00 |
URL | https://learncrypto.com/robots.txt |
Domain IPs | 104.21.96.41, 172.67.172.252, 2606:4700:3034::6815:6029, 2606:4700:3034::ac43:acfc |
Response IP | 104.21.96.41 |
Found | Yes |
Hash | de1a0a511eb9fb3a249e5b6fc8912661fd49c00a3c11503cf73ad2c60074fb69 |
SimHash | 2d3051085910 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-content |
Disallow | /2019/ |
Disallow | /2020/ |
Disallow | *feed.xml |
Disallow | /2018/ |
Disallow | /tag/ |
Disallow | /genre/ |
Disallow | /wp-includes/ |
Disallow | /test/ |