colder.com
robots.txt
Robots Exclusion Standard data for colder.com
Resource Scan
Scan Details
Site Domain | colder.com |
Base Domain | colder.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-02T03:23:41+00:00 |
Next Scan | 2024-08-01T03:23:41+00:00 |
Last Successful Scan
Scanned | 2024-03-12T03:22:26+00:00 |
URL | https://www.colder.com/robots.txt |
Redirect | https://www.cpcworldwide.com/robots.txt |
Redirect Domain | www.cpcworldwide.com |
Redirect Base | cpcworldwide.com |
Domain IPs | 23.52.171.121, 23.52.171.154, 2600:1413:b000:13::b857:c191, 2600:1413:b000:13::b857:c196 |
Redirect IPs | 173.222.148.42, 173.222.148.49, 2600:1413:b000:13::b857:c191, 2600:1413:b000:13::b857:c196 |
Response IP | 42.99.140.155 |
Found | Yes |
Hash | 7188cccfe768171d4912b3297a3e1f827b9d9ef03d14f2b2aa4c412b5d755fe5 |
SimHash | 4304116dcc73 |
Groups
*
Rule | Path |
---|---|
Disallow | /Admin |
Disallow | /DesktopModules/WarnerConnect/DisplayImage.aspx |
Disallow | /Portals/0/Library/Specialties/Bioprocessing/Documents/ValidationReports/*.pdf$ |
Disallow | /Portals/0/Library/ValidationReport/*.pdf$ |
Disallow | /Default/TabID/ |
Disallow | /Default.aspx |
Allow | /Portals/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://www.cpcworldwide.com/sitemap.xml |
Comments