willysworkshop.com.au
robots.txt

Robots Exclusion Standard data for willysworkshop.com.au

Resource Scan

Scan Details

Site Domain willysworkshop.com.au
Base Domain willysworkshop.com.au
Scan Status Ok
Last Scan4/5/2025, 5:52:36 AM
Next Scan 5/5/2025, 5:52:36 AM

Last Scan

Scanned4/5/2025, 5:52:36 AM
URL https://willysworkshop.com.au/robots.txt
Domain IPs 104.21.33.112, 172.67.161.227, 2606:4700:3031::6815:2170, 2606:4700:3031::ac43:a1e3
Response IP 172.67.161.227
Found Yes
Hash 08607397df48392cf425757aab938b1bfc48a1ce7d553a3ca9a4dcd22af70b6e
SimHash c9455cc22130

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-includes/
Disallow /wp-json/
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /wp-includes/images/
Allow /

googlebot

Rule Path
Allow *.js
Allow *.css

Other Records

Field Value
sitemap https://willysworkshop.com.au/sitemap_index.xml
sitemap https://willysworkshop.com.au/post-sitemap.xml
sitemap https://willysworkshop.com.au/page-sitemap.xml

Comments

  • added Wordpress-specific rules above