Log In Sign Up

simple.com.au
robots.txt

Robots Exclusion Standard data for simple.com.au

Resource Scan

Scan Details

Site Domain simple.com.au
Base Domain simple.com.au
Scan Status Ok
Last Scan2024-10-25T19:42:10+00:00
Next Scan 2024-11-01T19:42:10+00:00

Last Scan

Scanned2024-10-25T19:42:10+00:00
URL https://simple.com.au/robots.txt
Redirect https://www.simple.com.au/robots.txt
Redirect Domain www.simple.com.au
Redirect Base simple.com.au
Domain IPs 43.250.142.91
Redirect IPs 13.33.88.111, 13.33.88.123, 13.33.88.27, 13.33.88.65, 2600:9000:223b:0:3:ee:ca80:93a1, 2600:9000:223b:6c00:3:ee:ca80:93a1, 2600:9000:223b:7e00:3:ee:ca80:93a1, 2600:9000:223b:8800:3:ee:ca80:93a1, 2600:9000:223b:9000:3:ee:ca80:93a1, 2600:9000:223b:aa00:3:ee:ca80:93a1, 2600:9000:223b:d800:3:ee:ca80:93a1, 2600:9000:223b:ec00:3:ee:ca80:93a1
Response IP 13.33.88.111
Found Yes
Hash a8ba7e71f5e650ae6af8945f2b0bdae546411fd32b5a654aec3f8df6a6904418
SimHash 413219566f93

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Back to top

Other Records

Field Value
sitemap https://www.simple.com.au/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://www.simple.com.au/
  • live - don't allow web crawlers to index cpresources/ or vendor/
Back to top