m.bigwarehouse.com.au
robots.txt

Robots Exclusion Standard data for m.bigwarehouse.com.au

Resource Scan

Scan Details

Site Domain m.bigwarehouse.com.au
Base Domain bigwarehouse.com.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-13T13:47:14+00:00
Next Scan 2026-01-12T13:47:14+00:00

Last Successful Scan

Scanned2025-08-22T22:14:08+00:00
URL https://m.bigwarehouse.com.au/robots.txt
Domain IPs 104.21.28.108, 172.67.145.219, 2606:4700:3033::6815:1c6c, 2606:4700:3034::ac43:91db
Response IP 104.21.28.108
Found Yes
Hash fa4a05c09158ede586a56a7c348f9f7b263bc9a83a4a79d7d37c2a0c3b2bae1a
SimHash 6c55ca056154

Groups

*

Rule Path
Disallow /
Disallow /images/files/
Disallow /imgs/

googlebot
googlebot-image
bingbot
bing
slurp

Rule Path
Disallow /file.php