Log In Sign Up

crowdpleaser.com.au
robots.txt

Robots Exclusion Standard data for crowdpleaser.com.au

Resource Scan

Scan Details

Site Domain crowdpleaser.com.au
Base Domain crowdpleaser.com.au
Scan Status Ok
Last Scan2026-02-26T22:05:19+00:00
Next Scan 2026-03-28T22:05:19+00:00

Last Scan

Scanned2026-02-26T22:05:19+00:00
URL https://crowdpleaser.com.au/robots.txt
Redirect https://www.crowdpleaser.com.au/robots.txt
Redirect Domain www.crowdpleaser.com.au
Redirect Base crowdpleaser.com.au
Domain IPs 104.26.14.166, 104.26.15.166, 172.67.72.33, 2606:4700:20::681a:ea6, 2606:4700:20::681a:fa6, 2606:4700:20::ac43:4821
Redirect IPs 104.26.14.166, 104.26.15.166, 172.67.72.33, 2606:4700:20::681a:ea6, 2606:4700:20::681a:fa6, 2606:4700:20::ac43:4821
Response IP 172.67.72.33
Found Yes
Hash 6372a5e8b719f93da1df3d28fc526a82f94a1f9cc3ec741bfb4f20d491e4f361
SimHash a2842d857474

Groups

*

Rule Path
Allow /
Allow /sitemap.htm
Back to top

Other Records

Field Value
sitemap https://www.crowdpleaser.com.au/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top