au.fragrancenet.com
robots.txt
Robots Exclusion Standard data for au.fragrancenet.com
Resource Scan
Scan Details
| Site Domain | au.fragrancenet.com |
| Base Domain | fragrancenet.com |
| Scan Status | Ok |
| Last Scan | 2025-10-31T09:04:29+00:00 |
| Next Scan | 2025-11-07T09:04:29+00:00 |
Last Scan
| Scanned | 2025-10-31T09:04:29+00:00 |
| URL | https://au.fragrancenet.com/robots.txt |
| Domain IPs | 104.17.223.195, 104.18.176.199 |
| Response IP | 104.18.176.199 |
| Found | Yes |
| Hash | 8d8530c1caf9c7c1c7c485955f1fae322b682ba377786cb080fe7e6ac2efd390 |
| SimHash | f02c3555cd13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ni/ |
| Disallow | /*/ni/ |
| Disallow | /all/ |
| Disallow | /corpdisc/ |
| Disallow | /newsletter/ |
| Disallow | /f/net/newsletter.html |
| Disallow | /f/net/ni/ |
| Disallow | /f/net/process |
| Disallow | /f/net/ord/ |
| Disallow | /wsdata/ |
| Disallow | /signup |
| Disallow | /search |
| Disallow | /search/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://au.fragrancenet.com/sitemaps-au/sitemap_index1.xml |