burberryplc.com
robots.txt
Robots Exclusion Standard data for burberryplc.com
Resource Scan
Scan Details
Site Domain | burberryplc.com |
Base Domain | burberryplc.com |
Scan Status | Ok |
Last Scan | 2024-05-25T10:16:04+00:00 |
Next Scan | 2024-06-24T10:16:04+00:00 |
Last Scan
Scanned | 2024-05-25T10:16:04+00:00 |
URL | https://burberryplc.com/robots.txt |
Redirect | https://www.burberryplc.com/robots.txt |
Redirect Domain | www.burberryplc.com |
Redirect Base | burberryplc.com |
Domain IPs | 212.58.42.47 |
Redirect IPs | 104.18.2.158, 104.18.3.158, 2606:4700::6812:29e, 2606:4700::6812:39e |
Response IP | 104.18.3.158 |
Found | Yes |
Hash | b2737d006dc4083835ae979520188589794dac357b8505503fed492faf49fc54 |
SimHash | c114dc72eb31 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 1 |