herbeauty.co
robots.txt
Robots Exclusion Standard data for herbeauty.co
Resource Scan
Scan Details
Site Domain | herbeauty.co |
Base Domain | herbeauty.co |
Scan Status | Ok |
Last Scan | 2024-11-02T02:28:50+00:00 |
Next Scan | 2024-11-09T02:28:50+00:00 |
Last Scan
Scanned | 2024-11-02T02:28:50+00:00 |
URL | https://herbeauty.co/robots.txt |
Domain IPs | 104.18.33.19, 172.64.154.237, 2606:4700:4400::6812:2113, 2606:4700:4400::ac40:9aed |
Response IP | 104.18.33.19 |
Found | Yes |
Hash | 9e7eba486d92c9d69698d852d6137ea33ce3cf664e0e3089b2f531162546fd93 |
SimHash | 47405d65cbd2 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /xmlrpc.php |
Disallow | /template.html |
Disallow | /wp-admin |
Disallow | /archive |
Disallow | */trackback/ |
Disallow | */comments/ |
Disallow | /?feed= |
Other Records
Field | Value |
---|---|
sitemap | https://herbeauty.co/sitemap_index.xml |
Warnings
- `host` is not a known field.