aptouring.com.au
robots.txt
Robots Exclusion Standard data for aptouring.com.au
Resource Scan
Scan Details
Site Domain | aptouring.com.au |
Base Domain | aptouring.com.au |
Scan Status | Ok |
Last Scan | 2024-05-21T18:45:42+00:00 |
Next Scan | 2024-06-20T18:45:42+00:00 |
Last Scan
Scanned | 2024-05-21T18:45:42+00:00 |
URL | https://www.aptouring.com.au/robots.txt |
Domain IPs | 184.50.85.145, 96.17.180.33 |
Response IP | 96.17.180.44 |
Found | Yes |
Hash | 0c79de6dee9b206a148025124efae942c5ec938df89c57b127046ea9bb49a54e |
SimHash | 785c1c90e3d3 |
Groups
*
Rule | Path |
---|---|
Disallow | /*pdfhandler.ashx?id=* |
Disallow | /trip-finder/trip-finder-results* |
Disallow | /sitecore/* |
Disallow | /sitecore_modules/* |
Disallow | /sitecore_files/* |
Disallow | /temp/* |
Disallow | /upload/* |
Disallow | /downloads/* |
Disallow | /CarouselVideoPlayer* |
Disallow | /search-results* |
Disallow | /*?sc_camp=* |
Disallow | /*?ajax=* |
Disallow | /*?p=1* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.aptouring.com.au/sitemap.xml |