pro.fluidra.com.au
robots.txt

Robots Exclusion Standard data for pro.fluidra.com.au

Resource Scan

Scan Details

Site Domain pro.fluidra.com.au
Base Domain fluidra.com.au
Scan Status Ok
Last Scan2026-02-27T06:19:19+00:00
Next Scan 2026-03-29T06:19:19+00:00

Last Scan

Scanned2026-02-27T06:19:19+00:00
URL https://pro.fluidra.com.au/robots.txt
Domain IPs 45.223.168.42
Response IP 45.223.168.42
Found Yes
Hash 74555337a77f4e9eb4d4004c233b1fab04d288464be0e5aef04c4105ac10d861
SimHash 84105c0283eb

Groups

teoma

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

nutch

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

psbot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

yahoo-blogs

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

*

Rule Path
Disallow /Enquiry/
Disallow /Admin
Disallow /Areas

Other Records

Field Value
crawl-delay 2

Comments

  • robots.txt
  • beweb robotos
  • these are generally useless bots