august.com.au
robots.txt

Robots Exclusion Standard data for august.com.au

Resource Scan

Scan Details

Site Domain august.com.au
Base Domain august.com.au
Scan Status Ok
Last Scan2024-06-21T09:25:55+00:00
Next Scan 2024-07-21T09:25:55+00:00

Last Scan

Scanned2024-06-21T09:25:55+00:00
URL https://august.com.au/robots.txt
Redirect https://www.august.com.au/robots.txt
Redirect Domain www.august.com.au
Redirect Base august.com.au
Domain IPs 13.237.152.9, 3.104.245.145, 3.106.103.226
Redirect IPs 13.237.152.9, 3.104.245.145, 3.106.103.226
Response IP 13.237.152.9
Found Yes
Hash 07de4a346f3c8ff2aafe6f346a43b900e85f9b8679559532a336e0ced9d86694
SimHash 7510d1406111

Groups

*

No rules defined. All paths allowed.

Comments

  • www.robotstxt.org/
  • http://code.google.com/web/controlcrawlindex/