cactustiquet.com
robots.txt
Robots Exclusion Standard data for cactustiquet.com
Resource Scan
Scan Details
| Site Domain | cactustiquet.com |
| Base Domain | cactustiquet.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T20:50:50+00:00 |
| Next Scan | 2024-09-27T20:50:50+00:00 |
Last Scan
| Scanned | 2024-09-20T20:50:50+00:00 |
| URL | https://cactustiquet.com/robots.txt |
| Domain IPs | 54.155.41.15 |
| Response IP | 54.155.41.15 |
| Found | Yes |
| Hash | 155847b7339c1c4f94f0025886527bc441a760bff3055c402f3d5ba3057e5c6e |
| SimHash | 1b54ddc66460 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/tag* |
| Disallow | /es/tag* |
| Disallow | /gl/tag* |
| Disallow | /ca/tag* |
| Disallow | /eu/tag* |
| Disallow | /pt/tag* |
| Disallow | /en/tag* |
| Disallow | /de/tag* |
| Disallow | /it/tag* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments