crossover.com
robots.txt
Robots Exclusion Standard data for crossover.com
Resource Scan
Scan Details
Site Domain | crossover.com |
Base Domain | crossover.com |
Scan Status | Ok |
Last Scan | 2024-10-18T03:52:25+00:00 |
Next Scan | 2024-11-17T03:52:25+00:00 |
Last Scan
Scanned | 2024-10-18T03:52:25+00:00 |
URL | https://crossover.com/robots.txt |
Redirect | https://www.crossover.com/robots.txt |
Redirect Domain | www.crossover.com |
Redirect Base | crossover.com |
Domain IPs | 108.157.254.100, 108.157.254.65, 108.157.254.73, 108.157.254.93 |
Redirect IPs | 108.157.254.100, 108.157.254.65, 108.157.254.73, 108.157.254.93, 2600:9000:2753:0:f:c744:e80:93a1, 2600:9000:2753:5200:f:c744:e80:93a1, 2600:9000:2753:7c00:f:c744:e80:93a1, 2600:9000:2753:8800:f:c744:e80:93a1, 2600:9000:2753:9c00:f:c744:e80:93a1, 2600:9000:2753:ca00:f:c744:e80:93a1, 2600:9000:2753:d800:f:c744:e80:93a1, 2600:9000:2753:f800:f:c744:e80:93a1 |
Response IP | 108.157.254.100 |
Found | Yes |
Hash | 58829bfb8c02cd82cb1a5c66fcac1b65a43f0d5b57ae74a33aae32e13cc76e89 |
SimHash | b92cd88d0593 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /*apply$ |
Disallow | /next-step |
Disallow | /prime |
Other Records
Field | Value |
---|---|
sitemap | https://www.crossover.com/sitemap.xml |
Warnings
- `noindex` is not a known field.