brownandhurley.com.au
robots.txt
Robots Exclusion Standard data for brownandhurley.com.au
Resource Scan
Scan Details
Site Domain | brownandhurley.com.au |
Base Domain | brownandhurley.com.au |
Scan Status | Ok |
Last Scan | 2024-05-18T11:39:32+00:00 |
Next Scan | 2024-06-17T11:39:32+00:00 |
Last Scan
Scanned | 2024-05-18T11:39:32+00:00 |
URL | https://www.brownandhurley.com.au/robots.txt |
Domain IPs | 18.155.68.110, 18.155.68.123, 18.155.68.22, 18.155.68.77, 2600:9000:23d2:1600:b:2994:82c0:93a1, 2600:9000:23d2:6200:b:2994:82c0:93a1, 2600:9000:23d2:6800:b:2994:82c0:93a1, 2600:9000:23d2:bc00:b:2994:82c0:93a1, 2600:9000:23d2:e000:b:2994:82c0:93a1, 2600:9000:23d2:ec00:b:2994:82c0:93a1, 2600:9000:23d2:fa00:b:2994:82c0:93a1, 2600:9000:23d2:fe00:b:2994:82c0:93a1 |
Response IP | 18.155.68.77 |
Found | Yes |
Hash | 735b9561d52962d39e3865727497c2b821c3fa08f5ae5bd217ab4d34464c4a93 |
SimHash | 739d52c3c9c6 |
Groups
*
Rule | Path |
---|---|
Disallow | /*.zip$ |
Disallow | /*.doc$ |
Disallow | /*.exe$ |
Disallow | /vehicle/search/*? |
Other Records
Field | Value |
---|---|
sitemap | https://www.brownandhurley.com.au/sitemap.xml |