motocross.transworld.net
robots.txt

Robots Exclusion Standard data for motocross.transworld.net

Resource Scan

Scan Details

Site Domain motocross.transworld.net
Base Domain transworld.net
Scan Status Ok
Last Scan2024-10-25T01:35:48+00:00
Next Scan 2024-11-24T01:35:48+00:00

Last Scan

Scanned2024-10-25T01:35:48+00:00
URL https://motocross.transworld.net/robots.txt
Redirect https://motocross.com/robots.txt
Redirect Domain motocross.com
Redirect Base motocross.com
Domain IPs 34.209.11.9, 52.24.45.151
Redirect IPs 151.101.130.98, 151.101.194.98, 151.101.2.98, 151.101.66.98
Response IP 151.101.66.98
Found Yes
Hash 200c3ffe7401b4b84ea93ae9ffbc0f627a1cd636fb41490f0d64cd7059d6d319
SimHash 411487058493

Groups

*

Rule Path
Disallow /.preview/
Disallow /.context-results
Disallow /.applenews/

Other Records

Field Value
sitemap https://motocross.com/sitemaps.xml
sitemap https://motocross.com/news-sitemap.xml

Comments

  • Tempest - motocross