hellocompany.com.au
robots.txt

Robots Exclusion Standard data for hellocompany.com.au

Resource Scan

Scan Details

Site Domain hellocompany.com.au
Base Domain hellocompany.com.au
Scan Status Ok
Last Scan2026-01-04T16:25:44+00:00
Next Scan 2026-01-11T16:25:44+00:00

Last Scan

Scanned2026-01-04T16:25:44+00:00
URL http://hellocompany.com.au/robots.txt
Redirect http://www.hellocompany.com.au/robots.txt
Redirect Domain www.hellocompany.com.au
Redirect Base hellocompany.com.au
Domain IPs 5.39.74.29
Redirect IPs 5.39.74.29
Response IP 5.39.74.29
Found Yes
Hash 616311ef9d28605ad09b04e8ca1d1ae66cc5c46f4226c8aa4c6edac55e47e74b
SimHash d854c182d163

Groups

*

Rule Path
Disallow /vendor

ahrefsbot
backlinkcrawler
bdbrandprotect
bpimagewalker
ezooms
findlinks
gigabot
httrack
httrack 3.0
ia_archiver
linkwalker
mj12bot/v1.4.3
mj12bot
net vampire
python-urllib
rogerbot
sogou web spider
sosospider
spbot
updownerbot
semalt.com
robothumb.com
trustpilot

Rule Path
Disallow /

Comments

  • Crawlers

Warnings

  • 1 invalid line.