fantasie.com
robots.txt
Robots Exclusion Standard data for fantasie.com
Resource Scan
Scan Details
Site Domain | fantasie.com |
Base Domain | fantasie.com |
Scan Status | Ok |
Last Scan | 2024-05-31T06:24:32+00:00 |
Next Scan | 2024-06-30T06:24:32+00:00 |
Last Scan
Scanned | 2024-05-31T06:24:32+00:00 |
URL | https://fantasie.com/robots.txt |
Redirect | https://www.fantasie.com/robots.txt |
Redirect Domain | www.fantasie.com |
Redirect Base | fantasie.com |
Domain IPs | 20.26.43.247 |
Redirect IPs | 104.22.8.193, 104.22.9.193, 172.67.11.244, 2606:4700:10::6816:8c1, 2606:4700:10::6816:9c1, 2606:4700:10::ac43:bf4 |
Response IP | 172.67.11.244 |
Found | Yes |
Hash | 8004a64442d5d7f7d09b223bf724d625ad39792cf07f4c33df60ab533e5e607b |
SimHash | 7c44d79dedf0 |
Groups
*
Rule | Path |
---|---|
Disallow | */cart |
Disallow | */checkout |
Disallow | */my-account |
Other Records
Field | Value | Comment |
---|---|---|
crawl-delay | 10 | 10 seconds between page requests |
Other Records
Field | Value |
---|---|
sitemap | https://www.fantasie.com/sitemap.xml |
Warnings
- `request-rate` is not a known field.
- `visit-time` is not a known field.
Comments