oliversmotorcycles.com.au
robots.txt
Robots Exclusion Standard data for oliversmotorcycles.com.au
Resource Scan
Scan Details
Site Domain | oliversmotorcycles.com.au |
Base Domain | oliversmotorcycles.com.au |
Scan Status | Ok |
Last Scan | 2024-09-14T01:19:18+00:00 |
Next Scan | 2024-10-14T01:19:18+00:00 |
Last Scan
Scanned | 2024-09-14T01:19:18+00:00 |
URL | https://www.oliversmotorcycles.com.au/robots.txt |
Domain IPs | 2600:9000:2003:1c00:b:1e8b:60c0:93a1, 2600:9000:2003:2400:b:1e8b:60c0:93a1, 2600:9000:2003:5800:b:1e8b:60c0:93a1, 2600:9000:2003:6400:b:1e8b:60c0:93a1, 2600:9000:2003:d000:b:1e8b:60c0:93a1, 2600:9000:2003:d200:b:1e8b:60c0:93a1, 2600:9000:2003:e000:b:1e8b:60c0:93a1, 2600:9000:2003:e200:b:1e8b:60c0:93a1, 52.84.229.122, 52.84.229.30, 52.84.229.38, 52.84.229.50 |
Response IP | 52.84.229.50 |
Found | Yes |
Hash | 8d09d1321ab6199071da76414ecd3d3a3abff632a23529d0288f935374fd1df1 |
SimHash | 739c52c3c9c6 |
Groups
*
Rule | Path |
---|---|
Disallow | /*.zip$ |
Disallow | /*.doc$ |
Disallow | /*.exe$ |
Disallow | /vehicle/search/*? |
Other Records
Field | Value |
---|---|
sitemap | https://www.oliversmotorcycles.com.au/sitemap.xml |