mccullough.com.au
robots.txt
Robots Exclusion Standard data for mccullough.com.au
Resource Scan
Scan Details
Site Domain | mccullough.com.au |
Base Domain | mccullough.com.au |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-22T01:12:31+00:00 |
Next Scan | 2024-11-20T01:12:31+00:00 |
Last Successful Scan
Scanned | 2023-07-06T20:55:17+00:00 |
URL | https://www.mccullough.com.au/robots.txt |
Domain IPs | 13.33.88.111, 13.33.88.2, 13.33.88.29, 13.33.88.96, 2600:9000:223b:1e00:1e:2dfc:340:93a1, 2600:9000:223b:2800:1e:2dfc:340:93a1, 2600:9000:223b:4c00:1e:2dfc:340:93a1, 2600:9000:223b:5a00:1e:2dfc:340:93a1, 2600:9000:223b:8000:1e:2dfc:340:93a1, 2600:9000:223b:8a00:1e:2dfc:340:93a1, 2600:9000:223b:c600:1e:2dfc:340:93a1, 2600:9000:223b:ea00:1e:2dfc:340:93a1 |
Response IP | 52.85.61.33 |
Found | Yes |
Hash | d1d7308bd71e4b9b2d11a59dcd81767ccb74600e5bbd4d0ac143be4928e62a0a |
SimHash | c110dc128413 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /Security/login |
Disallow | /?flush |
Disallow | /assets/ |
Disallow | /assets/theme-images |
Allow | / |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | sitemap.xml |