cotterman.com
robots.txt
Robots Exclusion Standard data for cotterman.com
Resource Scan
Scan Details
Site Domain | cotterman.com |
Base Domain | cotterman.com |
Scan Status | Ok |
Last Scan | 2025-06-04T12:14:50+00:00 |
Next Scan | 2025-07-04T12:14:50+00:00 |
Last Scan
Scanned | 2025-06-04T12:14:50+00:00 |
URL | https://cotterman.com/robots.txt |
Domain IPs | 104.26.6.225, 104.26.7.225, 172.67.71.150, 2606:4700:20::681a:6e1, 2606:4700:20::681a:7e1, 2606:4700:20::ac43:4796 |
Response IP | 172.67.71.150 |
Found | Yes |
Hash | b1fe49752414fc9035e14e12831b56b538c487f391da2ecbb2e8d22bd678d109 |
SimHash | 6a00c832ca32 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /invoices/* |
Disallow | /payment-form |
Other Records
Field | Value |
---|---|
crawl-delay | 500 |
Other Records
Field | Value |
---|---|
sitemap | https://www.cotterman.com/sitemap_index.xml |