sclqld.org.au
robots.txt

Robots Exclusion Standard data for sclqld.org.au

Resource Scan

Scan Details

Site Domain sclqld.org.au
Base Domain sclqld.org.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-03T09:21:34+00:00
Next Scan 2024-07-02T09:21:34+00:00

Last Successful Scan

Scanned2023-11-13T09:19:23+00:00
URL https://sclqld.org.au/robots.txt
Redirect https://www.sclqld.org.au/robots.txt
Redirect Domain www.sclqld.org.au
Redirect Base sclqld.org.au
Domain IPs 151.139.128.10
Redirect IPs 151.139.128.10
Response IP 151.139.128.10
Found Yes
Hash f2f7c9132cd007cb15b0b306baf1448cd2739a6f2b280942e1106eab1b410b28
SimHash 3186bf5bdf10

Groups

*

Rule Path
Allow /judicial-papers/
Allow /judicial-papers/judicial-profiles/
Allow /news/
Allow /news-and-events/
Allow /news-and-events/new-titles/
Allow /about-us/
Allow /caselaw/
Disallow /caselaw/sentencing-remarks/
Disallow /information-services/
Allow /core/*.css$
Allow /core/*.css?
Allow /core/*.js$
Allow /core/*.js?
Allow /core/*.gif
Allow /core/*.jpg
Allow /core/*.jpeg
Allow /core/*.png
Allow /core/*.svg
Allow /profiles/*.css$
Allow /profiles/*.css?
Allow /profiles/*.js$
Allow /profiles/*.js?
Allow /profiles/*.gif
Allow /profiles/*.jpg
Allow /profiles/*.jpeg
Allow /profiles/*.png
Allow /profiles/*.svg
Disallow /core/
Disallow /profiles/
Disallow /README.txt
Disallow /web.config
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /index.php/admin/
Disallow /index.php/comment/reply/
Disallow /index.php/filter/tips/
Disallow /index.php/node/add/
Disallow /index.php/search/
Disallow /index.php/user/password/
Disallow /index.php/user/register/
Disallow /index.php/user/login/
Disallow /index.php/user/logout/

Comments

  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)