trivett.com.au
robots.txt
Robots Exclusion Standard data for trivett.com.au
Resource Scan
Scan Details
Site Domain | trivett.com.au |
Base Domain | trivett.com.au |
Scan Status | Ok |
Last Scan | 2024-09-15T11:31:10+00:00 |
Next Scan | 2024-10-15T11:31:10+00:00 |
Last Scan
Scanned | 2024-09-15T11:31:10+00:00 |
URL | https://www.trivett.com.au/robots.txt |
Domain IPs | 13.35.18.102, 13.35.18.23, 13.35.18.4, 13.35.18.85, 2600:9000:20c7:200:1a:7b25:31c0:93a1, 2600:9000:20c7:2800:1a:7b25:31c0:93a1, 2600:9000:20c7:5800:1a:7b25:31c0:93a1, 2600:9000:20c7:6800:1a:7b25:31c0:93a1, 2600:9000:20c7:be00:1a:7b25:31c0:93a1, 2600:9000:20c7:c400:1a:7b25:31c0:93a1, 2600:9000:20c7:f800:1a:7b25:31c0:93a1, 2600:9000:20c7:fa00:1a:7b25:31c0:93a1 |
Response IP | 13.35.18.85 |
Found | Yes |
Hash | d66423bd80a5c01291de1aeff828247c329be092f2093a0dc2363f8084f9f6d7 |
SimHash | 739d5ac3c9c6 |
Groups
*
Rule | Path |
---|---|
Disallow | /*.zip$ |
Disallow | /*.doc$ |
Disallow | /*.exe$ |
Disallow | /vehicle/search/*? |
Other Records
Field | Value |
---|---|
sitemap | https://www.trivett.com.au/sitemap.xml |