gadventures.com.au
robots.txt
Robots Exclusion Standard data for gadventures.com.au
Resource Scan
Scan Details
| Site Domain | gadventures.com.au |
| Base Domain | gadventures.com.au |
| Scan Status | Ok |
| Last Scan | 2024-09-25T02:58:46+00:00 |
| Next Scan | 2024-10-25T02:58:46+00:00 |
Last Scan
| Scanned | 2024-09-25T02:58:46+00:00 |
| URL | https://gadventures.com.au/robots.txt |
| Redirect | https://www.gadventures.com/robots.txt |
| Redirect Domain | www.gadventures.com |
| Redirect Base | gadventures.com |
| Domain IPs | 151.101.130.217, 151.101.194.217, 151.101.2.217, 151.101.66.217 |
| Redirect IPs | 151.101.130.217, 151.101.194.217, 151.101.2.217, 151.101.66.217 |
| Response IP | 199.232.46.217 |
| Found | Yes |
| Hash | 592d70f32686addf7ad6647a21ec53d07fdb228b380f8ea7a911107c0e855cf1 |
| SimHash | 2f081c528793 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /visa-forms/ |
| Disallow | /medical-form/ |
| Disallow | /trips/pricing/checkout/ |
| Disallow | /admin/ |
| Disallow | /site-media/ |
| Disallow | /api/ |
| Disallow | /debug/ |
| Disallow | /onlinebooking/ |
| Disallow | /careers/tour-guide-form/ |
| Disallow | /careers/tour-guide-form-confirm/ |
| Disallow | /localization/ |
| Disallow | /avatar/ |
| Disallow | /trips/indexed/ |
| Disallow | /expedition-tracking/ |
| Disallow | /agents/availability-reports/ |
| Disallow | /trips/*/*/*/trip-details-print/$ |
| Disallow | /fragments/ |
| Disallow | /trips/trip-styles/ |
| Disallow | /profiles/ |
| Disallow | /campaigns/g-normous/ |
| Disallow | /jsi18n/ |
| Disallow | /trips/json/* |
| Disallow | /trips/*/*/details/download |
| Allow | /.well-known/assetlinks.json |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.gadventures.com/sitemap.xml |
Warnings
- `host` is not a known field.