ceyusa.com
robots.txt
Robots Exclusion Standard data for ceyusa.com
Resource Scan
Scan Details
Site Domain | ceyusa.com |
Base Domain | ceyusa.com |
Scan Status | Ok |
Last Scan | 2024-11-15T23:52:39+00:00 |
Next Scan | 2024-11-29T23:52:39+00:00 |
Last Scan
Scanned | 2024-11-15T23:52:39+00:00 |
URL | https://www.ceyusa.com/robots.txt |
Domain IPs | 79.137.32.114 |
Response IP | 79.137.32.114 |
Found | Yes |
Hash | e2a5a3b747e5a92328f9ffb36eefa5205a3493e3e966253584b4b6e1111a423b |
SimHash | 595454e96680 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /phoo/ |
Disallow | /blog/data/ |
Disallow | /blog/drafts/ |
Disallow | /blog/.well.known/ |
Disallow | /blog/gpg_key.asc |
Disallow | /blog/humans.txt |
Disallow | /media/ |
Disallow | /.well.known/ |
Disallow | /gpg_key.asc |
Disallow | /humans.txt |
Other Records
Field | Value |
---|---|
sitemap | https://www.ceyusa.com/blog/sitemap.xml |
Warnings
- `host` is not a known field.