rally-maps.com
robots.txt

Robots Exclusion Standard data for rally-maps.com

Resource Scan

Scan Details

Site Domain rally-maps.com
Base Domain rally-maps.com
Scan Status Ok
Last Scan2024-11-08T08:21:36+00:00
Next Scan 2024-11-15T08:21:36+00:00

Last Scan

Scanned2024-11-08T08:21:36+00:00
URL https://rally-maps.com/robots.txt
Redirect https://www.rally-maps.com/robots.txt
Redirect Domain www.rally-maps.com
Redirect Base rally-maps.com
Domain IPs 202.61.255.198
Redirect IPs 202.61.255.198
Response IP 202.61.255.198
Found Yes
Hash c5e758383a1ca39e96559d7dbe1f940de3baa278bba7cb34b8636b513778062e
SimHash 3839dc41c1b5

Groups

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 20

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
crawl-delay 30

googlebot-mobile

Rule Path
Disallow

Other Records

Field Value
crawl-delay 20

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 20

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 20

facebookexternalhit

Rule Path
Disallow

Other Records

Field Value
crawl-delay 30

twitterbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 30

*

Rule Path
Disallow /
Disallow /rest/*
Disallow /rm2/html/page/embedded/*
Disallow /out/*
Disallow /im-1
Disallow /pr-1
Disallow /di-1
Disallow /imprint
Disallow /contact
Disallow /kontakt
Disallow /disclaimer
Disallow /impressum
Disallow /haftungsausschluss
Disallow /wylaczenie-odpowiedzialnosci
Disallow /Sagittarius-A
Disallow /Sagittarius-B
Disallow */3D-Tour
Disallow */legend
Disallow */legenda

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.rally-maps.com/sitemap.xml
sitemap https://www.rallyekarte.de/sitemap.xml
sitemap https://www.rajdtrasa.pl/sitemap.xml

Comments

  • tool to test robots.txt files => https://www.google.com/webmasters/tools/robots-testing-tool
  • allow google
  • allow bing:
  • allow yahoo:
  • allow social media previews:
  • disallow all other bots
  • disallow certain directores:
  • Disallow: *.css
  • Disallow: *.js
  • Disallow: /rm2/*
  • sitemaps: