crossover.com
robots.txt

Robots Exclusion Standard data for crossover.com

Resource Scan

Scan Details

Site Domain crossover.com
Base Domain crossover.com
Scan Status Ok
Last Scan2024-10-18T03:52:25+00:00
Next Scan 2024-11-17T03:52:25+00:00

Last Scan

Scanned2024-10-18T03:52:25+00:00
URL https://crossover.com/robots.txt
Redirect https://www.crossover.com/robots.txt
Redirect Domain www.crossover.com
Redirect Base crossover.com
Domain IPs 108.157.254.100, 108.157.254.65, 108.157.254.73, 108.157.254.93
Redirect IPs 108.157.254.100, 108.157.254.65, 108.157.254.73, 108.157.254.93, 2600:9000:2753:0:f:c744:e80:93a1, 2600:9000:2753:5200:f:c744:e80:93a1, 2600:9000:2753:7c00:f:c744:e80:93a1, 2600:9000:2753:8800:f:c744:e80:93a1, 2600:9000:2753:9c00:f:c744:e80:93a1, 2600:9000:2753:ca00:f:c744:e80:93a1, 2600:9000:2753:d800:f:c744:e80:93a1, 2600:9000:2753:f800:f:c744:e80:93a1
Response IP 108.157.254.100
Found Yes
Hash 58829bfb8c02cd82cb1a5c66fcac1b65a43f0d5b57ae74a33aae32e13cc76e89
SimHash b92cd88d0593

Groups

facebookexternalhit

Rule Path
Disallow /*gad_source%3D

*

Rule Path
Disallow
Disallow /*apply$
Disallow /next-step
Disallow /prime

Other Records

Field Value
sitemap https://www.crossover.com/sitemap.xml

Warnings

  • `noindex` is not a known field.