buildit-store.co.za
robots.txt

Robots Exclusion Standard data for buildit-store.co.za

Resource Scan

Scan Details

Site Domain buildit-store.co.za
Base Domain buildit-store.co.za
Scan Status Ok
Last Scan2024-10-04T20:32:33+00:00
Next Scan 2024-11-03T20:32:33+00:00

Last Scan

Scanned2024-10-04T20:32:33+00:00
URL https://buildit-store.co.za/robots.txt
Redirect https://www.buildit-store.co.za/robots.txt
Redirect Domain www.buildit-store.co.za
Redirect Base buildit-store.co.za
Domain IPs 35.190.95.30
Redirect IPs 104.18.30.208, 104.18.31.208, 2606:4700::6812:1ed0, 2606:4700::6812:1fd0
Response IP 104.18.30.208
Found Yes
Hash d4ce98be71007bdf03d126c2991b0389ab3ad7e07a51cf2c3ba815dca96d05d7
SimHash ad104a0e8911

Groups

*

Rule Path
Disallow /admin
Disallow /checkout
Disallow /order
Disallow /user
Disallow /account
Disallow /collections/*%2B*
Disallow /cart

adsbot-google

Rule Path
Disallow /admin
Disallow /checkout
Disallow /cart

nutch

Rule Path
Disallow /

Other Records

Field Value
sitemap https://buildit-store.co.za/sitemap.xml '