antarcticaflights.com.au
robots.txt
Robots Exclusion Standard data for antarcticaflights.com.au
Resource Scan
Scan Details
| Site Domain | antarcticaflights.com.au |
| Base Domain | antarcticaflights.com.au |
| Scan Status | Ok |
| Last Scan | 2024-11-08T03:11:29+00:00 |
| Next Scan | 2024-12-08T03:11:29+00:00 |
Last Scan
| Scanned | 2024-11-08T03:11:29+00:00 |
| URL | https://www.antarcticaflights.com.au/robots.txt |
| Domain IPs | 23.215.7.29, 23.215.7.30, 2600:1413:b000:1b::17d7:71d, 2600:1413:b000:1b::17d7:71e |
| Response IP | 23.215.7.30 |
| Found | Yes |
| Hash | 87b1a2a28d19442854e805c5671dc367749799327ce9cc056a3fb55b5a75eb4e |
| SimHash | 685c1c34e1d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*pdfhandler.ashx?id=* |
| Disallow | /trip-finder/trip-finder-results* |
| Disallow | /sitecore/* |
| Disallow | /sitecore_modules/* |
| Disallow | /sitecore_files/* |
| Disallow | /temp/* |
| Disallow | /upload/* |
| Disallow | /downloads/* |
| Disallow | /CarouselVideoPlayer* |
| Disallow | /search-results* |
| Disallow | /*?sc_camp=* |
| Disallow | /*?ajax=* |
| Disallow | /*?p=1* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.antarcticaflights.com.au/sitemap.xml |