shop.spaworld.com.au
robots.txt
Robots Exclusion Standard data for shop.spaworld.com.au
Resource Scan
Scan Details
Site Domain | shop.spaworld.com.au |
Base Domain | spaworld.com.au |
Scan Status | Ok |
Last Scan | 2024-09-26T14:54:40+00:00 |
Next Scan | 2024-10-26T14:54:40+00:00 |
Last Scan
Scanned | 2024-09-26T14:54:40+00:00 |
URL | https://shop.spaworld.com.au/robots.txt |
Domain IPs | 104.16.183.152, 104.16.184.152, 104.16.185.152, 104.16.186.152, 104.16.187.152 |
Response IP | 104.16.184.152 |
Found | Yes |
Hash | 4e5a8222f4059c5af567411e43436f1b8399f00741cd7d80f551c24db3300cd4 |
SimHash | a9248a6a8591 |
Groups
*
Rule | Path |
---|---|
Disallow | /_cpanel |
Disallow | /cgi-bin/suppliers/ |
Disallow | /_mycart |
Disallow | /_myacct |
Disallow | /do/ |
Allow | /*?%2Fspa-filters%2F%3Frf=va&va=456 |
Disallow | /*?*rf= |
Other Records
Field | Value |
---|---|
sitemap | http://shop.spaworld.com.au/sitemap_index.xml.gz |
Comments