motocross.com
robots.txt

Robots Exclusion Standard data for motocross.com

Resource Scan

Scan Details

Site Domain motocross.com
Base Domain motocross.com
Scan Status Ok
Last Scan2024-09-16T08:32:06+00:00
Next Scan 2024-09-23T08:32:06+00:00

Last Scan

Scanned2024-09-16T08:32:06+00:00
URL https://motocross.com/robots.txt
Domain IPs 151.101.130.98, 151.101.194.98, 151.101.2.98, 151.101.66.98
Response IP 151.101.66.98
Found Yes
Hash 200c3ffe7401b4b84ea93ae9ffbc0f627a1cd636fb41490f0d64cd7059d6d319
SimHash 411487058493

Groups

*

Rule Path
Disallow /.preview/
Disallow /.context-results
Disallow /.applenews/

Other Records

Field Value
sitemap https://motocross.com/sitemaps.xml
sitemap https://motocross.com/news-sitemap.xml

Comments

  • Tempest - motocross