fullstop.org.au
robots.txt

Robots Exclusion Standard data for fullstop.org.au

Resource Scan

Scan Details

Site Domain fullstop.org.au
Base Domain fullstop.org.au
Scan Status Ok
Last Scan2025-10-26T10:50:16+00:00
Next Scan 2025-11-02T10:50:16+00:00

Last Scan

Scanned2025-10-26T10:50:16+00:00
URL https://fullstop.org.au/robots.txt
Domain IPs 116.90.51.191
Response IP 116.90.51.191
Found Yes
Hash 6ff6b4645d3459e868fa862ffc0b7632e4e16f9abbf057a1541c2d4173fcebac
SimHash a80c17004f90

Groups

*

Rule Path
Disallow /.well-know/
Disallow /cgi-bin/
Disallow /config/
Disallow /vendor/
Disallow /yump/

Comments

  • Allow robots access to everything
  • It's also highly recommended that any URLs blocked in robots.txt also have an X-Robots-Tag
  • header, otherwise they could still potentially make it into search results
  • See http://webmasters.stackexchange.com/questions/65184/will-the-already-indexed-urls-be-removed-if-i-use-a-robots-txt