cityperfume.com.au
robots.txt
Robots Exclusion Standard data for cityperfume.com.au
Resource Scan
Scan Details
Site Domain | cityperfume.com.au |
Base Domain | cityperfume.com.au |
Scan Status | Ok |
Last Scan | 2024-06-09T19:44:39+00:00 |
Next Scan | 2024-07-09T19:44:39+00:00 |
Last Scan
Scanned | 2024-06-09T19:44:39+00:00 |
URL | https://www.cityperfume.com.au/robots.txt |
Domain IPs | 104.16.183.152, 104.16.184.152, 104.16.185.152, 104.16.186.152, 104.16.187.152 |
Response IP | 104.16.187.152 |
Found | Yes |
Hash | df6256bf3f7e8394df326052e3e377adb1f5a84190c1f648d3369d03e989aac0 |
SimHash | ec25884a839a |
Groups
*
Rule | Path |
---|---|
Disallow | /_cpanel |
Disallow | /cgi-bin/suppliers/ |
Disallow | /_mycart |
Disallow | /_myacct |
Disallow | /do/ |
Disallow | /*?*rf= |
Other Records
Field | Value |
---|---|
sitemap | http://www.cityperfume.com.au/sitemap_index.xml.gz |
Comments