kentremovalsstorage.com.au
robots.txt

Robots Exclusion Standard data for kentremovalsstorage.com.au

Resource Scan

Scan Details

Site Domain kentremovalsstorage.com.au
Base Domain kentremovalsstorage.com.au
Scan Status Ok
Last Scan2024-06-04T19:43:24+00:00
Next Scan 2024-07-04T19:43:24+00:00

Last Scan

Scanned2024-06-04T19:43:24+00:00
URL https://kentremovalsstorage.com.au/robots.txt
Redirect https://www.kentremovalsstorage.com.au/robots.txt
Redirect Domain www.kentremovalsstorage.com.au
Redirect Base kentremovalsstorage.com.au
Domain IPs 172.66.40.74, 172.66.43.182, 2606:4700:3108::ac42:284a, 2606:4700:3108::ac42:2bb6
Redirect IPs 172.66.40.74, 172.66.43.182, 2606:4700:3108::ac42:284a, 2606:4700:3108::ac42:2bb6
Response IP 172.66.43.182
Found Yes
Hash dd284a939c2ea9872ff4c670125ec185bd62faa28ee9f10722b7a6224078bf77
SimHash b15597f1adb9

Groups

*

Rule Path
Disallow /*.log
Disallow /feedback-form
Disallow /.git
Disallow /moveconnect
Disallow /staging
Disallow /redline
Disallow /video-sitemap-generator
Disallow /x
Disallow /dev
Disallow /maintenance
Disallow /sr
Disallow /edm
Disallow /db

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.kentremovalsstorage.com.au/sitemap_index.xml
sitemap https://www.kentremovalsstorage.com.au/sitemap-suburbs-static.xml
sitemap https://www.kentremovalsstorage.com.au/storage/sitemap_index.xml
sitemap https://www.kentremovalsstorage.com.au/storage/sitemap-suburbs.xml