nsw.scouts.com.au
robots.txt
Robots Exclusion Standard data for nsw.scouts.com.au
Resource Scan
Scan Details
Site Domain | nsw.scouts.com.au |
Base Domain | scouts.com.au |
Scan Status | Ok |
Last Scan | 2024-09-19T07:48:48+00:00 |
Next Scan | 2024-10-19T07:48:48+00:00 |
Last Scan
Scanned | 2024-09-19T07:48:48+00:00 |
URL | https://nsw.scouts.com.au/robots.txt |
Domain IPs | 141.193.213.20, 141.193.213.21 |
Response IP | 141.193.213.20 |
Found | Yes |
Hash | 5da4961dca476937be0bb547ccd5bfc3f15290dc54c3257b8f6185702086527d |
SimHash | 6d28dc008151 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /enews |
Disallow | /index.php?option=com_sobi2 |
Other Records
Field | Value |
---|---|
sitemap | https://www.nsw.scouts.com.au/sitemap_index.xml |
Comments