harpersbazaar.com.hk
robots.txt
Robots Exclusion Standard data for harpersbazaar.com.hk
Resource Scan
Scan Details
| Site Domain | harpersbazaar.com.hk |
| Base Domain | harpersbazaar.com.hk |
| Scan Status | Ok |
| Last Scan | 2024-06-07T18:08:51+00:00 |
| Next Scan | 2024-06-14T18:08:51+00:00 |
Last Scan
| Scanned | 2024-06-07T18:08:51+00:00 |
| URL | https://harpersbazaar.com.hk/robots.txt |
| Redirect | https://www.harpersbazaar.com.hk/robots.txt |
| Redirect Domain | www.harpersbazaar.com.hk |
| Redirect Base | harpersbazaar.com.hk |
| Domain IPs | 104.21.67.78, 172.67.218.111, 2606:4700:3030::6815:434e, 2606:4700:3031::ac43:da6f |
| Redirect IPs | 163.181.160.224, 163.181.160.225, 163.181.160.226, 163.181.160.227, 163.181.160.228, 163.181.160.229, 163.181.160.230, 163.181.160.231 |
| Response IP | 163.181.42.249 |
| Found | Yes |
| Hash | d654715e2d595c17f9599a2584fe0d315334105e4fedc8a4fe4968b22fbadbbe |
| SimHash | 41dc55547718 |
Groups
googlebot
| Rule | Path |
|---|---|
| Allow | /tag/ |
| Disallow | /index.php |
| Disallow | /action/ |
| Disallow | /hub/ |
| Disallow | /search* |
| Disallow | /*/logSend$ |
| Disallow | /*/spmException$ |
| Disallow | /*/spmact$ |
| Disallow | /*/antiSpam$ |
| Disallow | /*/nameStorage$ |
| Disallow | /*/spmMonitor$ |
| Disallow | /*/pvData$ |
| Disallow | /*/goldlog$ |
| Disallow | /*/initLoad$ |
| Disallow | /*/beforeUnload$ |
| Disallow | /*/util$ |
| Disallow | /*/metaInfo$ |
| Disallow | /*/beaconBase$ |
| Disallow | /*/spm$ |
| Disallow | /*/makeid$ |
| Disallow | /*/referrer$ |
| Disallow | /*/pvid$ |
| Disallow | /*/etag$ |
| Disallow | /*/iframe$ |
| Disallow | /*/client$ |
| Disallow | /*/windvane$ |
| Disallow | /*/cookie$ |
| Disallow | /*/sendpv$ |
| Disallow | /*/personality/index$ |
| Disallow | /*/misc$ |
| Disallow | /*/client$ |
| Disallow | /*/log$ |
| Disallow | /*/compose$ |
| Disallow | /*/lib_b/*$ |
| Disallow | /topic/BAZAAR30/BAZAAR-30th$ |
*
| Rule | Path |
|---|---|
| Disallow | /index.php |
| Disallow | /action/ |
| Disallow | /hub/ |
| Disallow | /tags/ |
| Disallow | /search* |
| Disallow | /*/logSend$ |
| Disallow | /*/spmException$ |
| Disallow | /*/spmact$ |
| Disallow | /*/antiSpam$ |
| Disallow | /*/nameStorage$ |
| Disallow | /*/spmMonitor$ |
| Disallow | /*/pvData$ |
| Disallow | /*/goldlog$ |
| Disallow | /*/initLoad$ |
| Disallow | /*/beforeUnload$ |
| Disallow | /*/util$ |
| Disallow | /*/metaInfo$ |
| Disallow | /*/beaconBase$ |
| Disallow | /*/spm$ |
| Disallow | /*/makeid$ |
| Disallow | /*/referrer$ |
| Disallow | /*/pvid$ |
| Disallow | /*/etag$ |
| Disallow | /*/iframe$ |
| Disallow | /*/client$ |
| Disallow | /*/windvane$ |
| Disallow | /*/cookie$ |
| Disallow | /*/sendpv$ |
| Disallow | /*/personality/index$ |
| Disallow | /*/misc$ |
| Disallow | /*/client$ |
| Disallow | /*/log$ |
| Disallow | /*/compose$ |
| Disallow | /*/lib_b/*$ |
| Disallow | /topic/BAZAAR30/BAZAAR-30th$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.harpersbazaar.com.hk/sitemap.xml |
Warnings
- 13 invalid lines.