harvestaire.com.au
robots.txt

Robots Exclusion Standard data for harvestaire.com.au

Resource Scan

Scan Details

Site Domain harvestaire.com.au
Base Domain harvestaire.com.au
Scan Status Ok
Last Scan2024-09-24T03:04:41+00:00
Next Scan 2024-10-24T03:04:41+00:00

Last Scan

Scanned2024-09-24T03:04:41+00:00
URL https://harvestaire.com.au/robots.txt
Redirect https://www.harvestaire.com.au/robots.txt
Redirect Domain www.harvestaire.com.au
Redirect Base harvestaire.com.au
Domain IPs 104.21.56.71, 172.67.179.208, 2606:4700:3033::6815:3847, 2606:4700:3035::ac43:b3d0
Redirect IPs 23.215.7.5, 23.215.7.8
Response IP 23.32.29.105
Found Yes
Hash 1659fd113df3fea195ab1baa2bfb361dee63d5b1c32b51444d8c09916c9a72ac
SimHash 3811e0a06382

Groups

*

Rule Path
Disallow /search*
Disallow /*%2C*

Comments

  • search
  • facets