aptouring.com.au
robots.txt
Robots Exclusion Standard data for aptouring.com.au
Resource Scan
Scan Details
Site Domain | aptouring.com.au |
Base Domain | aptouring.com.au |
Scan Status | Ok |
Last Scan | 2024-10-11T01:39:31+00:00 |
Next Scan | 2024-11-10T01:39:31+00:00 |
Last Scan
Scanned | 2024-10-11T01:39:31+00:00 |
URL | https://www.aptouring.com.au/robots.txt |
Domain IPs | 125.56.219.2, 23.32.29.97 |
Response IP | 96.17.180.44 |
Found | Yes |
Hash | 0c79de6dee9b206a148025124efae942c5ec938df89c57b127046ea9bb49a54e |
SimHash | 785c1c90e3d3 |
Groups
*
Rule | Path |
---|---|
Disallow | /*pdfhandler.ashx?id=* |
Disallow | /trip-finder/trip-finder-results* |
Disallow | /sitecore/* |
Disallow | /sitecore_modules/* |
Disallow | /sitecore_files/* |
Disallow | /temp/* |
Disallow | /upload/* |
Disallow | /downloads/* |
Disallow | /CarouselVideoPlayer* |
Disallow | /search-results* |
Disallow | /*?sc_camp=* |
Disallow | /*?ajax=* |
Disallow | /*?p=1* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.aptouring.com.au/sitemap.xml |