csw-it.com.au
robots.txt

Robots Exclusion Standard data for csw-it.com.au

Resource Scan

Scan Details

Site Domain csw-it.com.au
Base Domain csw-it.com.au
Scan Status Ok
Last Scan2025-12-21T07:31:49+00:00
Next Scan 2026-01-20T07:31:49+00:00

Last Scan

Scanned2025-12-21T07:31:49+00:00
URL https://csw-it.com.au/robots.txt
Redirect https://www.csw-it.com.au/robots.txt
Redirect Domain www.csw-it.com.au
Redirect Base csw-it.com.au
Domain IPs 162.159.138.9
Redirect IPs 162.159.137.9, 162.159.138.9, 2606:4700:7::a29f:8909, 2606:4700:7::a29f:8a09
Response IP 162.159.137.9
Found Yes
Hash d9f7d031941a508703fe7dc632d81ee08a5409a5dc61a05af12785860e6fb6d6
SimHash 692050606693

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Allow /wp-content/uploads/
Disallow /?s=
Disallow /search
Disallow /trackback
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.csw-it.com.au/sitemap_index.xml