ciclistarodando.com
robots.txt
Robots Exclusion Standard data for ciclistarodando.com
Resource Scan
Scan Details
| Site Domain | ciclistarodando.com |
| Base Domain | ciclistarodando.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-18T06:27:50+00:00 |
| Next Scan | 2025-12-02T06:27:50+00:00 |
Last Successful Scan
| Scanned | 2025-11-02T01:23:37+00:00 |
| URL | https://ciclistarodando.com/robots.txt |
| Domain IPs | 104.21.19.40, 172.67.184.246, 2606:4700:3034::ac43:b8f6, 2606:4700:3035::6815:1328 |
| Response IP | 172.67.184.246 |
| Found | Yes |
| Hash | 48c4412eb8c5ea89995bfadba1e7d181cccc645e19d44fb6fe9c110d9537ab12 |
| SimHash | 48c0d8c0a910 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /archives/ |
| Allow | /wp-content/uploads/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-content/themes/ |
| Disallow | /wp-includes/ |
| Disallow | /wp- |
| Disallow | /readme.html |
| Disallow | /refer/ |
| Allow | /feed/$ |
| Disallow | /feed |
| Disallow | /comments/feed |
| Disallow | /*/feed/$ |
| Disallow | /*/feed/rss/$ |
| Disallow | /*/trackback/$ |
| Disallow | /*/*/feed/$ |
| Disallow | /*/*/feed/rss/$ |
| Disallow | /*/*/trackback/$ |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss/$ |
| Disallow | /*/*/*/trackback/$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |