crystalblockchain.com
robots.txt
Robots Exclusion Standard data for crystalblockchain.com
Resource Scan
Scan Details
| Site Domain | crystalblockchain.com |
| Base Domain | crystalblockchain.com |
| Scan Status | Ok |
| Last Scan | 2025-11-19T23:49:09+00:00 |
| Next Scan | 2025-12-19T23:49:09+00:00 |
Last Scan
| Scanned | 2025-11-19T23:49:09+00:00 |
| URL | https://crystalblockchain.com/robots.txt |
| Redirect | https://crystalintelligence.com/robots.txt |
| Redirect Domain | crystalintelligence.com |
| Redirect Base | crystalintelligence.com |
| Domain IPs | 104.26.4.99, 104.26.5.99, 172.67.71.38, 2606:4700:20::681a:463, 2606:4700:20::681a:563, 2606:4700:20::ac43:4726 |
| Redirect IPs | 104.26.8.206, 104.26.9.206, 172.67.74.20, 2606:4700:20::681a:8ce, 2606:4700:20::681a:9ce, 2606:4700:20::ac43:4a14 |
| Response IP | 104.26.9.206 |
| Found | Yes |
| Hash | 51e5a9b7c9319f4eefecc069117302180d77542a9432c782f94348943f18ad0f |
| SimHash | 0808dbc294bd |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp- |
| Disallow | /wp/ |
| Disallow | *?s= |
| Disallow | %26s%3D |
| Disallow | /search/ |
| Disallow | /author/ |
| Disallow | /users/ |
| Disallow | /trackback |
| Disallow | /feed |
| Disallow | /rss |
| Disallow | /embed |
| Disallow | utm%3D |
| Disallow | openstat%3D |
| Allow | /wp-content/uploads/ |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.gif |
| Allow | /magiqih |
Other Records
| Field | Value |
|---|---|
| sitemap | https://crystalintelligence.com/sitemap_index.xml |
Warnings
- 1 invalid line.