Log In Sign Up

rodsandblinds.co.nz
robots.txt

Robots Exclusion Standard data for rodsandblinds.co.nz

Resource Scan

Scan Details

Site Domain rodsandblinds.co.nz
Base Domain rodsandblinds.co.nz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/28/2025, 11:13:17 AM
Next Scan 8/26/2025, 11:13:17 AM

Last Successful Scan

Scanned10/8/2024, 7:22:59 AM
URL https://rodsandblinds.co.nz/robots.txt
Redirect https://www.rodsandblinds.co.nz/robots.txt
Redirect Domain www.rodsandblinds.co.nz
Redirect Base rodsandblinds.co.nz
Domain IPs 104.21.45.163, 172.67.216.165, 2606:4700:3032::6815:2da3, 2606:4700:3032::ac43:d8a5
Redirect IPs 104.21.45.163, 172.67.216.165, 2606:4700:3032::6815:2da3, 2606:4700:3032::ac43:d8a5
Response IP 172.67.216.165
Found Yes
Hash 8d305b2c83bdce6402ecaf4803d407b878c1cc1cd8b348733bca42b6c66050a5
SimHash 41151537d7b6

Groups

*

Rule Path
Disallow /edit/
Disallow /edit?
Disallow /sample?
Disallow /test/
Disallow /test?
Allow /edit/library/
Allow /edit/library?
Allow /edit/*.js
Allow /edit/*.css
Allow /edit/*.png
Allow /edit/*.jpg
Allow /edit/*.gif
Allow /
Back to top

Other Records

Field Value
sitemap http://www.rodsandblinds.co.nz/sitemap.xml
Back to top

Comments

  • Tell all the naughty search engines to be good and only
  • go to the directories they are allow to go to
  • This must be replace with an ABSOLUTE path to the sitemap
Back to top