penrith.city
robots.txt
Robots Exclusion Standard data for penrith.city
Resource Scan
Scan Details
Site Domain | penrith.city |
Base Domain | penrith.city |
Scan Status | Ok |
Last Scan | 2024-09-08T15:42:30+00:00 |
Next Scan | 2024-10-08T15:42:30+00:00 |
Last Scan
Scanned | 2024-09-08T15:42:30+00:00 |
URL | https://penrith.city/robots.txt |
Redirect | https://www.penrithcity.nsw.gov.au/robots.txt |
Redirect Domain | www.penrithcity.nsw.gov.au |
Redirect Base | nsw.gov.au |
Domain IPs | 20.28.229.183 |
Redirect IPs | 20.28.229.183 |
Response IP | 20.28.229.183 |
Found | Yes |
Hash | b4e46b473e4a8e9da8aec0cc08220b55c8b51b50c664a83010a2af16521266b1 |
SimHash | e21f1d1a03fd |
Groups
*
Rule | Path |
---|---|
Disallow | /administrator/ |
Disallow | /bin/ |
Disallow | /cache/ |
Disallow | /cli/ |
Disallow | /components/ |
Disallow | /includes/ |
Disallow | /installation/ |
Disallow | /language/ |
Disallow | /layouts/ |
Disallow | /libraries/ |
Disallow | /logs/ |
Disallow | /modules/ |
Disallow | /plugins/ |
Disallow | /tmp/ |
Disallow | /glenmoreridge |
Disallow | /building-development/1441-glenmoreridge |
Disallow | /images/building-development/development/Douglas_Partners_Report_on_Supplementary_Geotechnical_Investigation.pdf |
Disallow | /images/building-development/development/Dr_Peter_Mitchell_report-Glenmore_Park_Subsidence.pdf |
Comments