studytravel.it
robots.txt
Robots Exclusion Standard data for studytravel.it
Resource Scan
Scan Details
| Site Domain | studytravel.it |
| Base Domain | studytravel.it |
| Scan Status | Ok |
| Last Scan | 2024-09-19T21:27:49+00:00 |
| Next Scan | 2024-10-03T21:27:49+00:00 |
Last Scan
| Scanned | 2024-09-19T21:27:49+00:00 |
| URL | https://studytravel.it/robots.txt |
| Redirect | https://www.studytravel.it/robots.txt |
| Redirect Domain | www.studytravel.it |
| Redirect Base | studytravel.it |
| Domain IPs | 2a04:9040:0:3100::160e:6161, 91.239.33.225 |
| Redirect IPs | 2a04:9040:0:3100::160e:6161, 91.239.33.225 |
| Response IP | 91.239.33.225 |
| Found | Yes |
| Hash | c4edefad314078d6d01cbbcd5687a46746e9334111970fdb5902363de0ba9168 |
| SimHash | 79b4145369d8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /reserveren |
| Disallow | /prenota |
| Disallow | /preventivo |
| Disallow | /disponibilita |
| Disallow | /cursus/reserveren.php |
| Disallow | /cursus/prijzen2.php |
| Disallow | /search |
| Disallow | /telmijnietmee.html |
| Disallow | /image.php |
| Disallow | /thumb.php |
| Disallow | /mailinglist |
| Disallow | /mijn |
rogerbot
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /reserveren |
| Disallow | /prenota |
| Disallow | /preventivo |
| Disallow | /disponibilita |
| Disallow | /cursus/reserveren.php |
| Disallow | /cursus/prijzen2.php |
| Disallow | /search |
| Disallow | /telmijnietmee.html |
| Disallow | /image.php |
| Disallow | /thumb.php |
| Disallow | /mailinglist |
| Disallow | /mijn |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.studytravel.it/sitemap.xml |