crossover.com
robots.txt

Robots Exclusion Standard data for crossover.com

Resource Scan

Scan Details

Site Domain crossover.com
Base Domain crossover.com
Scan Status Ok
Last Scan2024-06-20T03:50:22+00:00
Next Scan 2024-07-20T03:50:22+00:00

Last Scan

Scanned2024-06-20T03:50:22+00:00
URL https://crossover.com/robots.txt
Redirect https://www.crossover.com/robots.txt
Redirect Domain www.crossover.com
Redirect Base crossover.com
Domain IPs 13.224.163.102, 13.224.163.40, 13.224.163.62, 13.224.163.73
Redirect IPs 108.157.254.100, 108.157.254.65, 108.157.254.73, 108.157.254.93, 2600:9000:2753:0:f:c744:e80:93a1, 2600:9000:2753:1a00:f:c744:e80:93a1, 2600:9000:2753:3600:f:c744:e80:93a1, 2600:9000:2753:6e00:f:c744:e80:93a1, 2600:9000:2753:7400:f:c744:e80:93a1, 2600:9000:2753:a600:f:c744:e80:93a1, 2600:9000:2753:d800:f:c744:e80:93a1, 2600:9000:2753:f400:f:c744:e80:93a1
Response IP 108.157.254.65
Found Yes
Hash dc99d7ada3db802ac373143aa4daa6bc6e83b40347ced185a93f6e943eb02120
SimHash 2904d89c0593

Groups

*

Rule Path
Disallow
Disallow /*apply$
Disallow /next-step
Disallow /prime

Other Records

Field Value
sitemap https://www.crossover.com/sitemap.xml

Warnings

  • `noindex` is not a known field.