freeride.se
robots.txt
Robots Exclusion Standard data for freeride.se
Resource Scan
Scan Details
| Site Domain | freeride.se |
| Base Domain | freeride.se |
| Scan Status | Ok |
| Last Scan | 2024-05-30T02:07:14+00:00 |
| Next Scan | 2024-06-06T02:07:14+00:00 |
Last Scan
| Scanned | 2024-05-30T02:07:14+00:00 |
| URL | https://freeride.se/robots.txt |
| Redirect | https://www.freeride.se/robots.txt |
| Redirect Domain | www.freeride.se |
| Redirect Base | freeride.se |
| Domain IPs | 46.21.99.152 |
| Redirect IPs | 46.21.99.152 |
| Response IP | 46.21.99.152 |
| Found | Yes |
| Hash | 246506358a1b48a6a969a0eacdd6788f58787f0401b80035bfc92f231267f77f |
| SimHash | 521cda60813b |
Groups
applebot
ahrefsbot
msnbot
proximic
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
semrushbot
slurp
yahoo! slurp
yandex
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | /a/ |
| Disallow | /annonser/report.php |
| Disallow | /misc/login.php |
| Disallow | /review/user_review.php |
| Disallow | /forum/account/preferences |
| Disallow | /skidorter/resort_edit.php |
Comments