cryptoscape.io
robots.txt
Robots Exclusion Standard data for cryptoscape.io
Resource Scan
Scan Details
| Site Domain | cryptoscape.io |
| Base Domain | cryptoscape.io |
| Scan Status | Ok |
| Last Scan | 2025-11-26T20:46:59+00:00 |
| Next Scan | 2025-12-26T20:46:59+00:00 |
Last Scan
| Scanned | 2025-11-26T20:46:59+00:00 |
| URL | https://cryptoscape.io/robots.txt |
| Redirect | https://itjob.uk.com/robots.txt |
| Redirect Domain | itjob.uk.com |
| Redirect Base | itjob.uk.com |
| Domain IPs | 104.21.7.168, 172.67.187.239, 2606:4700:3030::ac43:bbef, 2606:4700:3035::6815:7a8 |
| Redirect IPs | 104.21.31.45, 172.67.174.246, 2606:4700:3032::ac43:aef6, 2606:4700:3035::6815:1f2d |
| Response IP | 172.67.174.246 |
| Found | Yes |
| Hash | 20ac93b19a37858eca87625fcad11096309058aad052cf428c6407287d50bdaf |
| SimHash | 492cfe12c470 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?* |
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php* |
| Disallow | /customize.php* |
| Disallow | /?S= |
| Disallow | /p%3D* |
| Disallow | /?p=* |
| Disallow | /wp-ison/ |
| Disallow | /xmlrpc.php* |
| Disallow | /comment.php* |
| Disallow | /wp-includes/ |
| Disallow | /plugins/ |
| Disallow | /themes/ |
| Allow | /uploads/ |
| Allow | /*?a=* |
| Allow | /*?brandcode=* |
| Allow | / |
googlebot
| Rule | Path |
|---|---|
| Disallow | /feed/ |
| Disallow | /feed$ |
| Disallow | /comments/ |
| Disallow | /?add-to-cart= |
| Disallow | /?add_to_wishlist= |
*
| Rule | Path |
|---|---|
| Disallow | */feed/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://itjob.uk.com/sitemap_index.xml |
Comments