collinsongroup.com
robots.txt
Robots Exclusion Standard data for collinsongroup.com
Resource Scan
Scan Details
Site Domain | collinsongroup.com |
Base Domain | collinsongroup.com |
Scan Status | Ok |
Last Scan | 2025-05-19T04:45:24+00:00 |
Next Scan | 2025-06-18T04:45:24+00:00 |
Last Scan
Scanned | 2025-05-19T04:45:24+00:00 |
URL | https://collinsongroup.com/robots.txt |
Redirect | https://www.collinsongroup.com/robots.txt |
Redirect Domain | www.collinsongroup.com |
Redirect Base | collinsongroup.com |
Domain IPs | 18.67.76.116, 18.67.76.27, 18.67.76.38, 18.67.76.78 |
Redirect IPs | 13.35.238.14, 13.35.238.43, 13.35.238.70, 13.35.238.84, 2600:9000:21d1:1c00:19:e58d:39c0:93a1, 2600:9000:21d1:4400:19:e58d:39c0:93a1, 2600:9000:21d1:5000:19:e58d:39c0:93a1, 2600:9000:21d1:5200:19:e58d:39c0:93a1, 2600:9000:21d1:7600:19:e58d:39c0:93a1, 2600:9000:21d1:c00:19:e58d:39c0:93a1, 2600:9000:21d1:c800:19:e58d:39c0:93a1, 2600:9000:21d1:f600:19:e58d:39c0:93a1 |
Response IP | 13.35.238.43 |
Found | Yes |
Hash | cc38862b86af888469ec10e88e65c91155ba807c690698f65e53d6b4fd5892b6 |
SimHash | e8393c646d90 |
Groups
*
Rule | Path |
---|---|
Disallow | /search/* |
Disallow | /search?* |
Disallow | /search?search=* |
Disallow | /404/* |
Disallow | /404?item=* |
Disallow | /404?item=%2%22 |
Disallow | /not-found%22 |
Disallow | /api/ |
Disallow | /api/* |
Disallow | /admin/* |
Disallow | /assets/* |
Disallow | /temp/ |
Disallow | /upload/ |
Disallow | /styles |
Disallow | /styles/* |
Disallow | /thank-you |
Disallow | /thank-you/* |
Disallow | *?tag* |
Other Records
Field | Value |
---|---|
sitemap | https://www.collinsongroup.com/sitemap.xml |