flooringdomain.com.au
robots.txt

Robots Exclusion Standard data for flooringdomain.com.au

Resource Scan

Scan Details

Site Domain flooringdomain.com.au
Base Domain flooringdomain.com.au
Scan Status Ok
Last Scan2025-06-02T19:49:51+00:00
Next Scan 2025-06-09T19:49:51+00:00

Last Scan

Scanned2025-06-02T19:49:51+00:00
URL https://flooringdomain.com.au/robots.txt
Domain IPs 104.21.9.108, 172.67.159.193, 2606:4700:3030::ac43:9fc1, 2606:4700:3032::6815:96c
Response IP 104.21.9.108
Found Yes
Hash 89477e295a2bbe69e7fa11c7a2ca4dd1f5c6504caeba5ccfffc63175b6c72700
SimHash 6001295480b3

Groups

*

Rule Path
Disallow /admin/
Disallow /images/
Disallow /img/
Disallow /css/
Disallow /js/
Disallow /plugins/
Allow /images/*.jpg
Allow /img/*.png
Allow /css/*.css
Allow /js/*.css
Allow /js/*.js
Allow /plugins/*.css

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://flooringdomain.com.au/sitemap.xml