willysworkshop.com.au
robots.txt
Robots Exclusion Standard data for willysworkshop.com.au
Resource Scan
Scan Details
Site Domain | willysworkshop.com.au |
Base Domain | willysworkshop.com.au |
Scan Status | Ok |
Last Scan | 4/5/2025, 5:52:36 AM |
Next Scan | 5/5/2025, 5:52:36 AM |
Last Scan
Scanned | 4/5/2025, 5:52:36 AM |
URL | https://willysworkshop.com.au/robots.txt |
Domain IPs | 104.21.33.112, 172.67.161.227, 2606:4700:3031::6815:2170, 2606:4700:3031::ac43:a1e3 |
Response IP | 172.67.161.227 |
Found | Yes |
Hash | 08607397df48392cf425757aab938b1bfc48a1ce7d553a3ca9a4dcd22af70b6e |
SimHash | c9455cc22130 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-login.php |
Disallow | /wp-includes/ |
Disallow | /wp-json/ |
Disallow | /?s= |
Disallow | /page/*/?s= |
Disallow | /search/ |
Allow | /wp-admin/admin-ajax.php |
Allow | /wp-content/uploads/ |
Allow | /wp-includes/images/ |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://willysworkshop.com.au/sitemap_index.xml |
sitemap | https://willysworkshop.com.au/post-sitemap.xml |
sitemap | https://willysworkshop.com.au/page-sitemap.xml |
Comments